Seamless inventory management with AI

関数呼び出しやチャット補完など、LLM AIの機能を応用し、音声やテキストによる会話を通じて店舗の在庫を管理できるAIチャットボットの作成方法を示します。

Transcript

1. 4FBNMFTT
   JOWFOUPSZ
   NBOBHFNFOU
   XJUI
   "* -*/&
   $PNQBOZ
   5IBJMBOE +PSQIPDIBVEPN
   1IJTJU
   1PPN
2. %FNP
3. %FNP
   CZ
   5FYU
4. • 6TF
   "*
   UP
   DPOWFSU
   TQFFDI
   UP
   UFYU
   • 6TF
   "*
   UP
   UIJOL
   XIBU
   UP
   DBMM
   XIJDI
   "1*
   UP
   VTF • 6TF
   "*
   UP
   FYUSBDU
   EBUB
   GSPN
   +40/ • *OUFHSBUF
   XJUI
   -*/&
   .FTTBHJOH
   "1*
   BOE
   -*/&
   4IPQQJOH
   "1* • -*/&
   4IPQQJOH
   MFUT
   5IBJMBOE
   TFMMFST
   DSFBUF
   B
   TIPQ
   PO
   -*/&
   0GGJDJBM
   "DDPVOU • 8F
   DSFBUF
   B
   3JDI XPSLGMPX
   VTJOH
   "* *O
   UIF
   EFNP TVNNBSZ
5. • 0QFO"*
   "1* • 4QFFDI
   UP
   UFYU
   "1* • $IBU
   DPNQMFUJPO
   "1*
   • 'VODUJPO
   DBMMJOH • 4USVDUVSFE
   EBUB
   FYUSBDUJPO • -*/&
   "1* • -*/&
   .FTTBHJOH
   "1*
   GPS
   SFDFJWJOH
   XFCIPPL
   BOE
   TFOE
   B SFQMZ
   NFTTBHF • -*/&
   4)011*/(
   "1*
   GPS HFU
   QSPEVDU
   MJTUJOH
   BOE VQEBUF
   JOWFOUPSZ )PX
6. 8IBU
   JT
   'VODUJPO
   $BMMJOH • 'VODUJPO
   DBMMJOH
   BMMPXT
   VT
   UP
   DPOOFDU
   NPEFM
   UP
   FYUFSOBM
   UPPMT • 8F
   DBO
   FOIBODF
   PVS
   "*
   UP
   VTF
   FYUFSOBM
   GVODUJPOT
   UIBU
   XF
   DPEF 0QFO"*
   'VODUJPO
   $BMMJOH
7. "SDIJUFDUVSF LINE Webhook server OpenAI API 1. Webhook LINE Shopping API 2. Get Content 3. Audio 4. Speech to text 7. Get function call User 8. Call API 9. Send Reply Message 5. text 6. Chat completion
8. "SDIJUFDUVSF LINE Webhook server OpenAI API 1. Webhook LINE Shopping API 2. Get Content 3. Audio 4. Speech to text 7. Get function call User 8. Call API 9. Send Reply Message 5. text 6. Chat completion
9. { "destination": "xxxxxxxxxx", "events": [ { "replyToken": "nHuyWiB7yP5Zw52FIkcQobQuGDXCTA", "type": "message", "mode": "active", "timestamp": 1462629479859, "source": { "type": "user", "userId": "U4af4980629..." }, "webhookEventId": "01FZ74A0TDDPYRVKNK77XKC3ZR", "deliveryContext": { "isRedelivery": false }, "message": { "id": "325708", "type": "audio", "duration": 60000, "contentProvider": { "type": "line" } } } ] }
10. "SDIJUFDUVSF LINE Webhook server OpenAI API 1. Webhook LINE Shopping API 2. Get Content 3. Audio 4. Speech to text 7. Get function call User 8. Call API 9. Send Reply Message 5. text 6. Chat completion
11. -*/& (FU
    $POUFOU
    "1*
    UP
    (FU
    .FTTBHF
    $POUFOU
    CZ
    .FTTBHF
    *% 8F
    XJMM
    HFU
    BVEJP
    GJMF
    BOE
    TBWF
    UP
    PVS
    MPDBM
    EJTL
    GJ
12. "SDIJUFDUVSF LINE Webhook server OpenAI API 1. Webhook LINE Shopping API 2. Get Content 3. Audio 4. Speech to text 7. Get function call User 8. Call API 9. Send Reply Message 5. text 6. Chat completion
13. LINE Get Content API to Get Message Content by Message ID curl --request POST ¥ --url https://api.openai.com/v1/audio/transcriptions ¥ --header "Authorization: Bearer $OPENAI_API_KEY" ¥ --header 'Content-Type: multipart/form-data' ¥ --form file=@/path/to/file/speech.mp3 ¥ --form model=whisper-1 ¥ --form response_format=text response text = `Can I get a product list` And we use OpenAI speech to text API
14. "SDIJUFDUVSF LINE Webhook server OpenAI API 1. Webhook LINE Shopping API 2. Get Content 3. Audio 4. Speech to text 7. Get function call User 8. Call API 9. Send Reply Message 5. text 6. Chat completion
15. Use OpenAI function calling chat completion API curl https://api.openai.com/v1/chat/completions ¥ --header "Authorization: Bearer $OPENAI_API_KEY" ¥ --header 'Content-Type: application/json‘ ¥ -d '{ "model": "gpt-4o", "messages": [ { "role": "user", "content": "Can I get product list" } ], "tools": [ { "type": "function", "function": { "name": "get_products", "description": "Get products in MyShop", "parameters": { "type": "object", "properties": { "ids": { "type": "string", "description": “id of products" } }, "required": [] } } } ], "tool_choice": "auto" }'
16. Tools Definition "tools": [ { "type": "function", "function": { "name": "get_products", "description": "Get products in MyShop", "parameters": { "type": "object", "properties": { "ids": { "type": "string", "description": “id of products" } }, "required": [] } } } ], "tool_choice": "auto" }'
17. OpenAI function calling chat completion API Response { "id": "chatcmpl-abc123", "object": "chat.completion", "created": 1699896916, "model": "gpt-4o-mini", "choices": [ { "index": 0, "message": { "role": "assistant", "content": null, "tool_calls": [ { "id": "call_abc123", "type": "function", "function": { "name": “get_products", "arguments": "{¥n¥"ids¥": ¥"¥"¥n}" } } ] }, "logprobs": null, "finish_reason": "tool_calls" } ], "usage": { "prompt_tokens": 82, "completion_tokens": 17, "total_tokens": 99, "completion_tokens_details": { "reasoning_tokens": 0 } } }
18. Choices Response "choices": [ { "index": 0, "message": { "role": "assistant", "content": null, "tool_calls": [ { "id": "call_abc123", "type": "function", "function": { "name": "get_products", "arguments": "{¥n¥"ids¥": ¥"¥"¥n}" } } ] }, "logprobs": null, "finish_reason": "tool_calls" } ],
19. "SDIJUFDUVSF LINE Webhook server OpenAI API 1. Webhook LINE Shopping API 2. Get Content 3. Audio 4. Speech to text 7. Get function call User 8. Call API 9. Send Reply Message 5. text 6. Chat completion
20. Now we know we have to get products from LINE Shopping API curl https://developers-oaplus.line.biz/myshop/v1/products ¥ --header “X-API-KEY: Bearer $LINE_SHOPPING_API_KEY” ¥ --header ‘Content-Type: application/json‘ We then use normal LINE Messaging Reply API to reply to user 🤓 🥳
21. "SDIJUFDUVSF LINE Webhook server OpenAI API 1. Webhook LINE Shopping API 2. Get Content 3. Audio 4. Speech to text 7. Get function call User 8. Call API 9. Send Reply Message 5. text 6. Chat completion
22. Update product’s inventory is the same: LINE Get Content API to Get Message Content by Message ID to get audio Use OpenAI Speech to text to convert audio to text We get “Update inventory of LINE dev t-shirt to 20” 🤓 🥳
23. Now is function calling’s job curl https://api.openai.com/v1/chat/completions ¥ --header "Authorization: Bearer $OPENAI_API_KEY" ¥ --header 'Content-Type: application/json‘ ¥ -d '{ "model": "gpt-4o", "messages": [ { "role": "user", "content": "Update inventory of LINE dev t-shirt to 25" } ], "tools": [ { "type": "function", "function": { "name": "update_inventory_by_name", "description": "Update product inventory in MyShop by product name", "parameters": { "type": "object", "properties": { "name": { "type": "string", "description": “name of product" }, "amount": { "type": "integer", "description": “quantity of product" } }, "required": [] } } } ], "tool_choice": "auto" }' 🤓 🥳
24. But LINE Shopping API doesn’t have update inventory by product name How do we solve this? LINE Shopping API provides only update by `inventory id` 🤓 🥳
25. -FU
    "*
    TPMWF
    UIJT 8F
    DBO
    BTL
    "*
    UP
    HFU
    BMM
    QSPEVDUT
    BOE
    GJOE
    JOWFOUPSZ
    JE
    G 
    $BMM
    -*/&
    TIPQQJOH
    HFU
    QSPEVDUT 
    "TL
    "*
    UP
    GJOE
    JOWFOUPSZ
    JE
    CZ
    QSPEVDU
    OBNF 
    $BMM
    -*/&
    4IPQQJOH
    "1*
    VQEBUF
    JOWFOUPSZ
    CZ
    JE 🤓 🥳
26. curl https://api.openai.com/v1/chat/completions ¥ --header "Authorization: Bearer $OPENAI_API_KEY" ¥ --header 'Content-Type: application/json‘ ¥ -d '{ "model": "gpt-4o", "messages": [ { "role": "system", "content": "You are an expert at structured data extraction. You will be given json response api and should parse inventory id" }, { "role": "system", "content": "extract inventory id for $productName with following: $json" } ], "tools": [ { "type": "function", "function": { "name": "update_inventory_by_name", "description": "Update product inventory in MyShop by product name", "parameters": { "type": "object", "properties": { "name": { "type": "string", "description": “name of product" }, "amount": { "type": "integer", "description": “quantity of product" } }, "required": [] } } } ], "tool_choice": "auto" }' 🤓 🥳
27. "messages": [ { "role": "system", "content": "You are an expert at structured data extraction. You will be given json response from api and should parse inventory id" }, { "role": "system", "content": "extract inventory id for เสื$อไลน์เดฟ with following: { … // JSON … }” } ], 🤓 🥳
28. 5IJT
    JT
    B
    DPNCJOBUJPO
    PG
    EJGGFSFOU
    UFDIOJRVF  8F
    DBO
    BTL
    "*
    UP
    QBSTF
    EBUB
    GSPN
    +40/  5IFO
    XF
    BTL
    UIFN
    UP
    EP
    GVODUJPO
    DBMMJOH  8F
    UIFO
    DBMM
    PVS
    GVODUJPO
    JO
    PVS
    DPEF 🤓 🥳
29. "SDIJUFDUVSF LINE Webhook server OpenAI API 1. Webhook LINE Shopping API 2. Get Content 3. Audio 4. Speech to text 7. Get function call User 8. Call API 9. Send Reply Message 5. text 6. Chat completion
30. 1SJDJOH "U
    XIBU
    DPTU
31. 1SJDJOH "U
    XIBU
    DPTU { "id": "chatcmpl-abc123", "object": "chat.completion", "created": 1699896916, "model": "gpt-4o-mini", "choices": [ { "index": 0, "message": { "role": "assistant", "content": null, "tool_calls": [ { "id": "call_abc123", "type": "function", "function": { "name": “get_products", "arguments": "{¥n¥"ids¥": ¥"¥"¥n}" } } ] }, "logprobs": null, "finish_reason": "tool_calls" } ], "usage": { "prompt_tokens": 82, "completion_tokens": 17, "total_tokens": 99, "completion_tokens_details": { "reasoning_tokens": 0 } } } "MNPTU
    'SFF
32. 8IBU
    DBO
    CF
    JNQSPWFE • 8IBU
    JG
    XF
    IBWF
    IVOESFET
    PG
    QSPEVDUT • 6TJOH
    WFDUPS
    FNCFEEJOH
    UP
    EP
    UFYU
    TFBSDI • 6TJOH
    BTTJTUBOU
    "1*
    UP
    EP
    AUISFBEA
    DPOWFSTBUJPO • 0QFO"*
    OPX
    IBWF
    TQFFDI
    UP
    TQFFDI
    SFBM UJNF
    "1* • 8F
    DBO
    CVJME
    .$1
    TFSWFS
    GPS
    QSPEVDU
    
33. • 6TF
    "*
    UP
    DPOWFSU
    TQFFDI
    UP
    UFYU
    • 6TF
    "*
    UP
    UIJOL
    XIBU
    UP
    DBMM
    XIJDI
    "1*
    UP
    VTF • 6TF
    "*
    UP
    FYUSBDU
    EBUB
    GSPN
    +40/ • *OUFHSBUF
    XJUI
    -*/&
    .FTTBHJOH
    "1*
    BOE
    -*/&
    4IPQQJOH
    "1* • 8F
    DSFBUF
    B
    3JDI
    XPSLGMPX
    VTJOH
    "* 4VNNBSZ 8IBU
    IBWF
    XF
    EPOF