Share
Embed
データサイエンスを加速するAIチップ / Introduction to AI chips which accelerate data science
2024年6月14日開催 Women in Data Science Tokyo @ IBM
DATA SCIENTIST TALK 資料
Speaker: 伊藤 愛
日本アイ・ビー・エム株式会社
東京基礎研究所 セミコンダクター
スタッフ・リサーチ・サイエンティスト
https://widstokyoibm2024.splashthat.com/
wids-tky-i
June 14, 2024
Transcript
25 slides
-
⾃⼰紹介 ࢯ໊ɿҏ౻ Ѫ ձࣾɿຊΞΠɾϏʔɾΤϜגࣜձࣾ ॴଐɿ౦ژجૅݚڀॴ ηϛίϯμΫλʔ ৬छɿελοϑɾϦαʔνɾαΠΤϯςΟετ ུྺɿ ͷຊ*#.ೖࣾҎདྷɺ౦ژجૅݚڀॴͰ ੑೳੳɺੑೳ࠷దԽɺ"*νοϓͷݚڀʹैࣄɻ
݄ΑΓ/PSUI1PMFϓϩδΣΫτʹࢀՃ͠ɺ ཧઃܭɺݕূɺిྗධՁͳͲΛ୲ɻ ݄ΑΓηϛίϯμΫλʔॴଐͱͳΓɺ ΑΓಋମͷݚڀʹྗ͍ͯ͠Δɻ -
©2024 IBM Corporation AIʹΑΔσʔλੳ 3 ػցֶश $IBU(15 ੜ"* ը૾ೝࣝ σΟʔϓϥʔχϯά
ࣗવݴޠॲཧ νϟοτϘοτ धཁ༧ଌ '"2 ނোݕ ࣗಈӡస -
©2024 IBM Corporation AIͷֶशͱਪ 4 𝑓 𝐱 𝐱 𝐲 ਪ:
ߏங͞Εͨؔ 𝑓 Λͬͯɺ৽͍͠ 𝐱 ͔Β 𝐲 Λਪଌ ֶश: ೖྗσʔλֶशσʔλΛ͍ɺ 𝐱 ͔Β 𝐲 Λਪଌ͢Δؔ 𝑓 Λߏங͢Δ cat dog ߏங Cat: 80% Dog: 20% ֶशσʔλ ਪଌ݁Ռ ਪσʔλ ྫɿڭࢣ͋Γֶश -
©2024 IBM Corporation ؔ 𝑓 ͷߏஙํ๏ͷྫ 5 ઢܗճؼ αϙʔτϕΫλʔϚγϯ ΫϥελϦϯά
χϡʔϥϧωοτϫʔΫ ʢ"*Ϟσϧʣ ܾఆ ڠௐϑΟϧλϦϯά 𝑥! 𝑥" 𝑥 𝑦 𝑦 = 𝛼𝑥 𝑥! 𝑥" 𝑥! 𝑥# 𝑦! 𝑥" 𝑦# 𝑦" ॻ੶ A B C D E ސ٬ 1 Like Like 2 Like Like Like Like 3 Like ? Like 4 Like Like φΠʔϒϕΠζ ཧ༝ ݁Ռ ؍ଌ ਪଌ -
©2024 IBM Corporation χϡʔϥϧωοτϫʔΫͷԋࢉ 𝑦! 𝑦! , 𝑦" , …
, 𝑦# = 𝜑 𝑥! , 𝑥" , … , 𝑥# 𝑤!! 𝑤!" … 𝑤!# 𝑤"! 𝑤"" … 𝑤"# ⋮ ⋮ ⋱ ⋮ 𝑤#! 𝑤#" ⋯ 𝑤## + 𝑩 𝑥! 𝑥" 𝑥# 𝑤!! 𝑤"! 𝑤#! 𝜑 ∑𝑥𝑤 + 𝑏 ׆ੑԽؔ ϕΫτϧߦྻੵ ∑𝑥𝑤 ∑𝑥𝑤 − όΠΞε 𝑦" 𝑦# … • χϡʔϥϧωοτϫʔΫߦྻͰද͢͜ͱ͕Ͱ͖Δ • χϡʔϥϧωοτϫʔΫͷԋࢉʹɺଟ͘ͷߦྻԋࢉؚ͕·Ε͍ͯΔ … … 6 -
©2024 IBM Corporation AIͷԋࢉΛ࣮ߦ͢ΔνοϓΞʔΩςΫνϟ CPU AIνοϓ ݩʑ3Dը૾ॲཧͷͨΊʹ ։ൃ͞Εͨνοϓɻը૾ॲ ཧͷͨΊͷߦྻϕΫλࢉ ثΛ๛ʹඋ͓͑ͯΓɺAI
ͷԋࢉಘҙɻ AIͷԋࢉઐ༻ʹઃܭ͞Εͨ νοϓɻAIͷॲཧʹಛԽ͠ ͨػೳΛ๛ʹඋ͑ɺߴ͍ ੑೳΛތΔɻ ҰൠతͳԋࢉͷͨΊʹઃܭ ͞Εͨνοϓɻ࠷ۙͷCPU AIͷԋࢉʹඞཁͳߦྻϕ Ϋλࢉثඋ͍͑ͯΔɻ GPU IntelʮIntel Launches Xeon D Processor Built for the Network and Edge”ʯ https://www.intel.com/content/www/us/en/newsr oom/news/intel-launches-new-processor-built- edge.html#gs.0mokh7 (2024/6/11) ZDNETʮ NVIDIAͷ৽νοϓʮH100ʯɺAIʹΑΔਓؒཧղͷՃΛࢦ͢ʯ https://japan.zdnet.com/article/35187234/ (2024/6/11) νοϓ FPGA AMD ʮADM-PCIE-9H3ʯ https://japan.xilinx.com/products/boards-and-kits/1-zihv8r.html (2024/6/11) ಛఆͷԋࢉઐ༻ͷճ࿏Λϓ ϩάϥϜ͢Δ͜ͱ͕Ͱ͖Δ νοϓɻAIԋࢉઐ༻ͷճ࿏ Λ࡞Δ͜ͱ͕Ͱ͖Δɻ 7 -
©2024 IBM Corporation νοϓΞʔΩςΫνϟؒͷੑೳൺֱ Nature 「Hardware implementation of memristor-based artificial
neural networks」 https://www.nature.com/articles/s41467-024-45670-9 (2024/6/11) 8 -
©2024 IBM Corporation AIͷීٴʹΑΔফඅిྗ IDC ʮࠃσʔληϯλʔͷAI͚ిྗਪఆΛൃදʯ https://www.idc.com/getdoc.jsp?containerId=prJPJ51802224 (2024/6/11) IEA 「Electricity
2024 Executive summary」 https://www.iea.org/reports/electricity-2024/executive-summary (2024/6/11) IDC JapanʹΑΔࠃσʔληϯλʔʹ͓͚ ΔAIαʔόʔ͚ిྗΩϟύγςΟͷਪܭ IEAʢࠃࡍΤωϧΪʔػؔʣʹΑΔϨϙʔτ ʢElectricity 2024ʣ “After globally consuming an estimated 460 terawatt-hours (TWh) in 2022, data centres’ total electricity consumption could reach more than 1000 TWh in 2026. This demand is roughly equivalent to the electricity consumption of Japan. ” “2022ʹશੈքͰਪఆ460TWhΛফඅͨ͠ σʔληϯλʔͷ૯ిྗফඅྔɺ2026ʹ 1000TWhΛ͑ΔՄೳੑ͕͋Δɻ͜Εຊ શମͷిྗফඅྔʹ΄΅ඖఢ͢Δɻ” “2027࣌ʹ͓͚ΔAIαʔόʔ͚ిྗ ΩϟύγςΟɺ2024࣌ͷ1.5ഒͱ ͳΔ” 9 -
©2024 IBM Corporation ओཁͳAIνοϓ Google TPU ֶश༻ʢਪՄೳʣ ਪઐ༻ Intel Gaudi
PFN MN-Core LeapMind Efficiera IBM NorthPole Google͕։ൃͨ͠AIઐ༻ͷϋʔυΣΞɻ Google CloudͰ׆༻͞Ε͍ͯΔɻ Intel͕։ൃͨ͠AIઐ༻ͷϋʔυΣΞɻ σʔληϯλʔͰͷੜAILLMͷ࣮ߦΛ తʹ͍ͯ͠Δɻ Preferred Networks͕։ൃͨ͠AIઐ༻ͷ ϋʔυΣΞɻ AI/ج൫ϞσϧͷֶशϑΣʔζʹ࠷దԽ͍ͯ͠Δɻ LeapMind͕։ൃͨ͠AIઐ༻ͷϋʔυΣΞIPɻ CNN (Convolutional Neural Network) ͷ ਪԋࢉॲཧʹಛԽ͍ͯ͠Δɻ IBM͕։ൃͨ͠AIਪઐ༻ͷϋʔυΣΞɻ AIϞσϧͷใΛશͯνοϓʹ֨ೲ͢Δ ͜ͱʹΑΓσʔλͷҠಈΛେ෯ʹݮΒ͠ɺ ফඅిྗΛ͍͑ͯΔɻ ͜ͷAIνοϓͷݚڀʹ5ܞΘ͍ͬͯ·͢ 10 -
©2024 IBM Corporation IBM NorthPole • 2018͔ΒIBM ResearchͰݚڀ։ൃ ͞ΕͨAIਪઐ༻νοϓ •
202310݄ʹScienceࢽʹจܝࡌ • σʔλͷҠಈʹ͔͔Δίετʹண͠ɺ AIͷԋࢉʹ͓͚ΔσʔλҠಈΛۃྗ ݮͨ͠ • ଟ͘ͷAIϞσϧͰɺGPUʹൺͯ ѹతͳফඅిྗΛ࣮ݱ • ҏ౻ϩδοΫઃܭɺγϛϡϨʔγϣϯɺ ফඅిྗͷݕূͳͲΛ୲ 11 -
©2024 IBM Corporation ϑΥϯɾϊΠϚϯɾΞʔΩςΫνϟͱͦͷϘτϧωοΫ ϝϞϦ ΞΫηεͷน CPU ϝϞϦ ϑΥϯɾϊΠϚϯɾΞʔΩςΫνϟ ·ͣɺը૾σʔλͷ࠷ॳͷ෦
ͱχϡʔϥϧωοτϫʔΫ ͷ࠷ॳͷ෦Λ͖࣋ͬͯͯॲ ཧ͢Δ 13 -
©2024 IBM Corporation ϑΥϯɾϊΠϚϯɾΞʔΩςΫνϟͱͦͷϘτϧωοΫ ϝϞϦ ΞΫηεͷน CPU ϝϞϦ ϑΥϯɾϊΠϚϯɾΞʔΩςΫνϟ ࣍ʹɺχϡʔϥϧωοτϫʔ
Ϋͷ࣍ͷ෦Λ͖࣋ͬͯͯɺ ࠷ॳͷॲཧ݁Ռͱ߹Θͤͯॲ ཧ͢Δ 14 -
©2024 IBM Corporation ϑΥϯɾϊΠϚϯɾΞʔΩςΫνϟͱͦͷϘτϧωοΫ ϝϞϦ ΞΫηεͷน CPU ϝϞϦ ϑΥϯɾϊΠϚϯɾΞʔΩςΫνϟ ը૾σʔλͷ࠷ॳͷ෦ͷॲ
ཧ͕શͯऴΘͬͨΒɺը૾σ ʔλͷ࣍ͷ෦ͱɺχϡʔϥ ϧωοτϫʔΫͷ࠷ॳͷ෦ Λ͖࣋ͬͯͯॲཧ͢Δ 15 -
©2024 IBM Corporation ϑΥϯɾϊΠϚϯɾΞʔΩςΫνϟͱͦͷϘτϧωοΫ ϝϞϦ ΞΫηεͷน ϑΥϯɾϊΠϚϯɾϘτϧωοΫ CPU ϝϞϦ CPUχϡʔϥϧωοτϫʔΫͱσʔλΛ
ϝϞϦ͔Β͖࣋ͬͯͯॲཧ͢Δඞཁ͕͋Δ ϑΥϯɾϊΠϚϯɾΞʔΩςΫνϟ 16 -
©2024 IBM Corporation NorthPoleͷΞʔΩςΫνϟ֓ཁ ԋࢉث ϝϞϦ TPU NorthPole GPU (A100)
CPU (Zen 3) 10ԯτϥϯδελ 18 -
©2024 IBM Corporation NorthPoleͷΞʔΩςΫνϟ • ϝϞϦͱԋࢉث͕1ͭͷίΞͷத Ͱີʹஔ͞Ε͍ͯΔ • χϡʔϥϧωοτϫʔΫͷσʔλ ɺ֤ίΞͷϝϞϦʹϩʔυ
͞ΕΔ • νοϓશମͰ192MBͷϝϞϦΛ ࣋ͭ • χϡʔϥϧωοτϫʔΫͷԋࢉʹ ಛԽͨ͠ԋࢉثΛ࣋ͭ • 8/4/2ϏοτͷྔࢠԽΛαϙʔτ 19 ϢχϑΝΠυϝϞϦ ʢॏΈɺϕΫτϧɺ ϓϩάϥϜʣ ॏΈ όοϑΝ ෦ όοϑΝ ϓϩάϥϜ όοϑΝ ཧ ϕΫτϧ ԋࢉث ੵ ԋࢉث ϢχϑΝΠυϝϞϦ ʢॏΈɺϕΫτϧɺ ϓϩάϥϜʣ ॏΈ όοϑΝ ෦ όοϑΝ ϓϩάϥϜ όοϑΝ ཧ ϕΫτϧ ԋࢉث ੵ ԋࢉث 1ίΞ 2 x 2 ίΞߦྻ ࣜਤ ԋࢉ ϝϞϦ ཧ ϨΠΞτ ࣜਤ ωοτϫʔΫɾΦϯɾνοϓ ϨΠΞτ ϑϧνοϓ -
©2024 IBM Corporation NorthPoleͷιϑτΣΞελοΫ 20 NorthPole SDK NorthPole Validator NorthPole
Runtime OS, Libraries RedHad Enterprise Linux NorthPole Compiler PyTorch python OpenCV podman OpenShift PyTorch Λ͍ɺ GPUΛͬͯNorthPoleʹ͚ͯ χϡʔϥϧωοτϫʔΫͷྔࢠԽΛߦ͏ ֶशͨ͠χϡʔϥϧωοτϫʔΫΛ Compiler Λͬͯ NorthPoleͰ࣮ߦՄೳͳܗʹม͢Δ ίϯύΠϧͨ͠χϡʔϥϧωοτϫʔΫΛ Runtime API ΛͬͯNorthPole্ʹల։͠ɺೖྗσʔλͱ݁ ՌͷΓऔΓΛߦ͏ Validator ΛͬͯίϯύΠϧͨ͠χϡʔϥϧωοτ ϫʔΫͷݕূΛιϑτΣΞͰߦ͏͜ͱ͕Ͱ͖Δ ֶश ਪ NorthPole Runtime NorthPole Validator NorthPole Compiler PyTorch -
©2024 IBM Corporation NorthPoleͷը૾ೝࣝϞσϧʢResNet-50ʣʹ͓͚Δੑೳ ిྗޮ (frames/joule) ۭؒޮ (frames/ඵ)/10ԯτϥϯδελ NorthPoleΑΓߴͳಋମٕज़Ͱ͞ΕͨνοϓΛؚΊͨ ଞͷΞʔΩςΫνϟશͯͷੑೳΛNorthPole྇կ͍ͯ͠Δ
• NorthPoleͱಉ͡12nmͰ ͞ΕͨGPU (V100) ͱൺֱͯ͠ɺ 25ഒͷిྗޮͱ5ഒͷۭؒޮ Λୡ • 4nmͰ͞ΕͨGPU (H100) ͱ ൺֱͯ͠ɺ5ഒͷిྗޮΛୡ 21 -
©2024 IBM Corporation NorthPoleͷϢʔεέʔεྫ • ফඅిྗ͕ٻΊΒΕΔΤοδͰͷAIར༻ • αʔόʔͰͷAIਪΛΑΓফඅిྗͰ࣮ߦ • ࣗಈӡసʹ͓͚ΔΧϝϥը૾ͷମݕग़
• υϩʔϯͷΧϝϥը૾ͷମݕग़ • ߤۭը૾ʹ͓͚Δମݕग़ • … ϦαʔνϓϩτλΠϓ 23