[GDG DevFest Bangkok 2024] - The Future of Retail E-commerce with Gemini AI

The talk showcases how Vertex AI and Gemini revolutionize retail e-commerce using Retrieval-Augmented Generation (RAG) to enhance product information and create a seamless shopping experience. The LINE Chatbot features three key functions: general product inquiries (Vertex AI Agent Builder), text-based product search (Vertex AI Search), and image-based product search (Gemini Image Understanding and Vertex AI Search).

Transcript

1. The Future of LINE Retail Chatbot using Gemini and Vertex AI Bangkok Punsiri Boonyakiat Senior Data Engineer @ CJ Express
2. About CJ MORE 1,432 Branches in Thailand
3. About CJ MORE 3.2M LINE OA Users
4. Enhance LINE User Experience with AI Shopping Assistance with in LINE OA Chat about Product Semantic and Image Search Add to Basket Search for Store or Payment
5. Challenge in Building LLM Chatbot Hallucination Speci fi c Knowledge Domain Dynamic Answer from External Data Clear Response Style
6. Challenge in Building LLM Chatbot Hallucination Speci fi c Knowledge Domain Dynamic Answer from External Data Clear Response Style
7. Challenge in Building LLM Chatbot Hallucination Speci fi c Knowledge Domain Dynamic Answer from External Data Clear Response Style
8. Challenge in Building LLM Chatbot Speci fi c Knowledge Domain Dynamic Answer from External Data Clear Response Style Hallucination
9. Challenge in Building LLM Chatbot Speci fi c Knowledge Domain Dynamic Answer from External Data Clear Response Style Hallucination
10. Retrieval Augmented Generation (RAG) Data Store Retrieval Augmented Generation Search Related Data (Document or Embedding Vector) +
11. Retrieval Augmented Generation (RAG) Data Store Retrieval Augmented Generation Search Related Data (Document or Embedding Vector) +
12. Retrieval Augmented Generation (RAG) Data Store Retrieval Augmented Generation Search Related Data (Document or Embedding Vector) +
13. Retrieval Augmented Generation (RAG) Data Store Augmented Generation Search Related Data (Document or Embedding Vector) + Retrieval
14. Tools Building to LLM Chatbot + +
15. Google AI Solution
16. Vertex AI Vertex AI Agent Builder Vertex AI Search Vertex AI Vector Search
17. Vertex AI Vertex AI Agent Builder Vertex AI Search Vertex AI Vector Search
18. Vertex AI Agent Builder Build natural language Agent
19. Vertex AI Agent Builder Build natural language Agent Create Data Store Create Agent De fi ne PlayBook Integration
20. Vertex AI Agent Builder Build natural language Agent Create Data Store Create Agent De fi ne PlayBook Integration
21. Vertex AI Agent Builder Build natural language Agent Create Data Store Create Agent De fi ne PlayBook Integration
22. Vertex AI Agent Builder Build natural language Agent Create Data Store Create Agent De fi ne PlayBook Integration
23. Vertex AI Agent Builder Build natural language Agent Create Data Store Create Agent De fi ne PlayBook Integration
24. Vertex AI Vertex AI Agent Builder Vertex AI Search Vertex AI Vector Search
25. Vertex AI Search Empower Retrieval with Google Search Engine for Enterprise data Build Collect Serve
26. Vertex AI Search Empower Retrieval with Google Search Engine for Enterprise data Create Data Store Create Search Agent Import Documents Search Results In both Widget and API Select LLM Model
27. Vertex AI Search Empower Retrieval with Google Search Engine for Enterprise data Create Data Store Create Search Agent Import Documents Search Results In both Widget and API Select LLM Model
28. Vertex AI Search Empower Retrieval with Kind of Google Search Engine Create Data Store Create Search Agent Import Documents Search Results In both Widget and API Select LLM Model
29. Vertex AI Search Empower Retrieval with Google Search Engine for Enterprise data Create Data Store Create Search Agent Import Documents Search Results In both Widget and API Select LLM Model
30. Vertex AI Search Empower Retrieval with Google Search Engine for Enterprise data Create Data Store Create Search Agent Import Documents Search Results In both Widget and API Select LLM Model
31. Vertex AI Vertex AI Agent Builder Vertex AI Search Vertex AI Vector Search
32. Vertex AI Vector Search Convert Image to Embedding Create Embedding index Embedding search
33. Building Retail Agent Solution
34. Building Retail Agent Solution Chat with CJ Product
35. Building Retail Agent Solution Text-based Semantic Search
36. Building Retail Agent Solution Image to Embedding with Vector Search
37. LINE Messaging Architecture
38. Integration LINE Messaging API With Python Line Bot SDK LINE Platform Handling Webhook
39. With Python Line Bot SDK Develop LINE Messaging API Callback Function Validate LINE Signature Image Handler Event Text Text Handler Image
40. Semantic Search Vertex AI Search Summary Product List Conversational Agent Chat with Product Text Event Text Answers Keyword : #ค้นหา
41. Semantic Search Vertex AI Search Summary Product List Conversational Agent Chat with Product Text Event Text Answers Keyword : #ค้นหา
42. Chat with CJ Product Create Agent
43. Semantic Search Vertex AI Search Summary Product List Conversational Agent Chat with Product Text Event Text Answers Keyword : #ค้นหา
44. Call Discovery Engine - Vertex AI Search Create Flex Carousel Related Products Vertex AI Search
45. Call Discovery Engine - Vertex AI Search
46. Call Discovery Engine - Vertex AI Search Pre-de fi ne Prompt
47. Call Discovery Engine - Vertex AI Search
48. Gemini Image Understanding Search Image Event - Solution 1 Image Description Vertex AI Search + Gemini Multimodal Image Event
49. Gemini Image Understanding Search Multimodal One-Shot Prompt Response Control
50. Gemini Image Understanding Search Multimodal One-Shot Prompt Response Control Both Image and Text pre-de fi ned prompt
51. Gemini Image Understanding Search One Example for output Multimodal One-Shot Prompt Response Control
52. Gemini Image Understanding Search Multimodal Recipe output Response Control One-Shot Prompt
53. Gemini Image Understanding Search Related Products Vertex AI Search Return Flex Carousel
54. Image to Embedding Vector Search Image Event - Solution 2 Vertex AI Vector Search Image Event Convert to Embedding Vector Similar Items
55. Generate Multimodal Embedding Convert to Embedding Vector
56. Create Vertex AI Vector Index Vertex AI Vector Search
57. Vertex AI Search for Embedding Related Products Vector Search Create Flex Carousel
58. Enhance Retail User Experience in LINE Platform • Customer Support Agent • Document Search Agent • Operational Service Agent
59. Summary Vertex AI Agent Builder Chat with Product Vertex AI Vector Search Image Vector Search Vertex AI Search Text Semantic Search Gemini + Vertex AI Search Image Understanding
60. Deep Dive into Vertex AI
61. CJ MORE, AI MORE