Discovering AI Innovations on Google Distributed Cloud - 蔡秀吉

近年來，各產業積極導入AI技術，期望藉由AI來賦能實現數位轉型。那麼，在實際部署AI應用時，需要注意什麼樣的限制和需求呢？ 為了解決這些挑戰，Google 推出了一套稱為 Google Distributed Cloud（GDC）的解決方案組合。本次演講將深入剖析 Google Distributed Cloud 的核心組件以及新增的軟/硬體設備，探索其如何協助企業，讓AI應用發揮最大功能。 此外，我們也會聚焦於 Google Cloud Next '24 及 Google I/O 2024 大會上介紹的最新進展，看看 Google Distributed Cloud 整合了大會中的哪些新技術來實現 AI 應用以及 Gemini Cloud Assist，本議程最後將提及 GDC 的未來展望。

相關參考資料：
Run AI anywhere with Google Distributed Cloud innovations

Google I/O Extended Kaohsiung 2024
https://gdg.community.dev/events/details/google-gdg-kaohsiung-presents-google-io-extended-kaohsiung-2024/
時間：2024 05/18
地點：高雄智慧科技創新園區(KO-IN 智高點)

講者：蔡秀吉
hctsai@linux.com
O-RAN 科普教育: http://o-ran.at.tw/
個人網站：https://www.thc1006.cc/

Transcript

1. Google Distributed Cloud (GDC) Discover AI innovations and modernization @thc1006
2. Google Cloud Proprietary & Confidential Google Distributed Cloud (GDC) GDC AI/ML Gemini Cloud Assist 01 02 03 04 Agenda 2
3. Why not use Public Cloud for everything? AI Section 1
4. “ ” Mark Lohmeyer
5. AI model
6. 5G/Wi-Fi CPE • • • Public Cloud video surveillance
7. Public Cloud
11. Google Cloud Proprietary & Confidential /
12. ⚫ ⚫ ⚫ ⚫
13. Section 1
14. From edge, to sovereign, to cross-cloud What is Google Distributed Cloud? Section 2
15. Google Cloud Proprietary & Confidential Edge (On premises ( )Air Gap Google Cloud
16. Google Distributed Cloud
17. 17 Configurations Air-Gapped Connected
18. GenAI Apps Use cases on Google Distributed Cloud Google Distributed Cloud Technology Stack Section 2
22. GDC enables the latest technology • Performance Tuning Operator • SR-IOV support for NICs • Multus - multiple NICs per container • Direct resource access (CPU and memory) • On-prem Nodes with 128 CPUs and 4TB of RAM • Support up to 30,000 pods per cluster • NVIDIA GPU support • Observability
23. NVIDIA L4 GPU NVIDIA H100 GPU on prem
24. Google Cloud Proprietary & Confidential
26. GDC enables the latest technology • Performance Tuning Operator • SR-IOV support for NICs • Multus - multiple NICs per container • Direct resource access (CPU and memory) • On-prem Nodes with 128 CPUs and 4TB of RAM • Support up to 30,000 pods per cluster • NVIDIA GPU support • Observability Multiple networking
27. GDC Service Platform & IaaS Service Platform(Full Cloud-Native Stack) (observability) (hardening) Dashboard Network fabric topology Spanning from IAM, monitoring, logging, management Sys IaaS Stack: GKE Enterprise load balancer Life Cycle Management (LCM) https://cloud.google.com/blog/products/management-tools/introducing-customizable-observability-dashboards/
28. GDC PaaS Stack ⚫ AI AlloyDB GDC Vector search ⚫ GDC Dataproc GDC
29. Google Cloud Proprietary & Confidential Vertex AI Search & Prediction AlloyDB Omni Dataproc Spark
30. Google Cloud Proprietary & Confidential AI Stack GDC Workbench Data Pipelines AI AI
31. Google Cloud Proprietary & Confidential Migration GDC GDC MongoDB, Elasticsearch, etc,.
32. AI/ML on Google Distributed Cloud (GDC) Section 3
33. Google Cloud Proprietary & Confidential DEMO
36. GDC Apigee API
37. From edge, to sovereign, to cross-cloud Cross-CIoud Network Section 2
39. GenAI Apps Use cases on Google Distributed Cloud Gemini Cloud Assist Section 2
40. DEMO
41. 41 Configuration-as-Data is Declarative (Not Imperative) I’m thirsty… I want soda in my blue cup. Sure! Thanks for trusting me to figure out how to get you a soda. Express intent… ...without the toil of “how” Declarative: User Friendly Imperative : I’m thirsty… Go to the kitchen Open the fridge Reach in the back to get the soda Close the fridge Grab a blue cup from the left cupboard Pour out the soda in the cup Bring the cup back to me Ummm… okay thanks for telling me exactly what to do...sheesh!
42. GDC ⚫ ⚫
43. Děkuji za pozornost! GDSC Lead