Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
Adallocation-9
Search
Shinya Akiba
August 31, 2016
Research
1
57
Adallocation-9
Shinya Akiba
August 31, 2016
Tweet
Share
More Decks by Shinya Akiba
See All by Shinya Akiba
RS for HP Opt
shinya_akiba
0
3.3k
Mining_Data_Stream
shinya_akiba
0
380
社内勉強会 NIPS2015
shinya_akiba
1
1.1k
Other Decks in Research
See All in Research
[輪講] Transformer Layers as Painters
nk35jk
4
580
한국어 오픈소스 거대 언어 모델의 가능성: 새로운 시대의 언어 이해와 생성
inureyes
PRO
0
150
第 2 部 11 章「大規模言語モデルの研究開発から実運用に向けて」に向けて / MLOps Book Chapter 11
upura
0
460
[ECCV2024読み会] 衛星画像からの地上画像生成
elith
1
990
論文紹介: COSMO: A Large-Scale E-commerce Common Sense Knowledge Generation and Serving System at Amazon (SIGMOD 2024)
ynakano
1
300
Weekly AI Agents News! 9月号 プロダクト/ニュースのアーカイブ
masatoto
2
180
Weekly AI Agents News! 9月号 論文のアーカイブ
masatoto
1
170
「熊本県内バス・電車無料デー」の振り返りとその後の展開@土木計画学SS:成功失敗事例に学ぶ公共交通運賃設定
trafficbrain
0
120
打率7割を実現する、プロダクトディスカバリーの7つの極意(pmconf2024)
geshi0820
0
190
ソフトウェア研究における脅威モデリング
laysakura
0
1.2k
PetiteSRE_GenAIEraにおけるインフラのあり方観察
ichichi
0
240
2038年問題が思ったよりヤバい。検出ツールを作って脅威性評価してみた論文 | Kansai Open Forum 2024
ran350
8
3.7k
Featured
See All Featured
How to Think Like a Performance Engineer
csswizardry
22
1.3k
Easily Structure & Communicate Ideas using Wireframe
afnizarnur
192
16k
Music & Morning Musume
bryan
46
6.3k
Visualizing Your Data: Incorporating Mongo into Loggly Infrastructure
mongodb
44
9.4k
Performance Is Good for Brains [We Love Speed 2024]
tammyeverts
7
570
Side Projects
sachag
452
42k
VelocityConf: Rendering Performance Case Studies
addyosmani
327
24k
Large-scale JavaScript Application Architecture
addyosmani
510
110k
The Power of CSS Pseudo Elements
geoffreycrofte
74
5.4k
Code Reviewing Like a Champion
maltzj
521
39k
Save Time (by Creating Custom Rails Generators)
garrettdimon
PRO
29
960
Facilitating Awesome Meetings
lara
51
6.2k
Transcript
0OMJOF.BUDIJOHBOE"E"MMPDBUJPO
"6OJpFE7JFX#JE4DBMJOH"MHPSJUINT 0CKFDUJWF'VODUJPOT6TFEJO1SBDUJDF 1VCMJTIFE3FTVMUTGSPNUIF*OEVTUSZ "EBQUJWF#JETDBMJOH)FVSJTUJDT 5ISPUUMJOH
"EBQUJWF#JETDBMJOH)FVSJTUJDT ͜Ε·ͰɺछྨͷCJETDBMJOHΞϧΰϦζϜΛհͨ͠ɻ "EWFSTBSJBM ΫΤϦʹΛԾఆ͠ͳ͍ ࠷ѱέʔεͷධՁ %JTUSJCVUJPOCBTFE
4UBUJDͳΛԾఆ ࠷ॳ ͘͠લͳͲ ͷαϯϓϦϯάʹΑΔ͕શମͷΛಉ͡ ͱ͍͏Ծఆ ࣮ࡍɺͷதͰಉ͡Ͱͳ͍͠ɺมԽ͍ͯ͘͠ɻ
"EBQUJWF#JETDBMJOH)FVSJTUJDT ఆظతʹϦαϯϓϦϯάSFDPNQVUF-1`TEVBMWBSJBCMFT "EWFSTBSJBMNPEFMΛར༻͢Δɻ< > )ZCSJEBMHPSJUINTΛ͏ɻ<> "UJNFWBSZJOHEJTUSJCVUJPOJOQVUNPEFM<
> )FVSJTUJDͳख๏ GFFECBDLMPPQ TUBUJDEJTUSJCVUJPO OPOTUBUJDEJTUSJCVUJPO
<>'BTU"MHPSJUINTGPS'JOEJOH.BUDIJOHTJO-PQTJEFE #JQBSUJUF(SBQITXJUI"QQMJDBUJPOTUP%JTQMBZ"ET ࠂओͷ༧ࢉ͕ҟͳΔέʔεͰɺΑΓ#BMBODFEͳΞϧΰϦζϜɻ <>.477ͱ0⒐JOF-1ͷIZCSJE "MMPDBUJOHPOMJOFBEWFSUJTFNFOUTQBDFXJUIVOSFBMFTUJNBUFT .BIEJBO :BIPP3FTFBSDI .477Ͱར༻͍ͯͨ͠ЇFGͱ͍͏ؔΛ ЇFЋ G
ͱ͢ΔɻGɺ ͓ͬͨۚ༧ࢉ <>"E$FMM"E"MMPDBUJPOJO$FMMVMBS/FUXPSLT "E$FMMBOFXNPCJMFBEWFSUJTJOHDPODFQU ࣌ؒଳҐஔใʹΑͬͯΧελϚʔΛධՁ
<>"E8PSETBOE(FOFSBMJ[FE0OMJOF.BUDIJOH ڝ߹ൺFͱͳΔΑ͏ͳΞϧΰϦζϜ ҎԼͷ࣮༻తͳ݅ΛԾఆ͠ɺFΛ࣮ݱͨ͠ɻ ೖࡳऀ ࠂओ ɺVTFS͕ࠂΛΫϦοΫͨ͠ͱ͖ͷΈDPTUΛ ࢧ͏ ࠂओɺ͝ͱʹҟͳΔ༧ࢉΛ࣋ͭ
J൪ͷೖࡳऀɺJ ൪ͷೖࡳऀͷೖࡳֹΛࢧ͏ ͭͷΫΤϦ ྫݕࡧΩʔϫʔυ ʹର͠ɺෳͷࠂ͕දࣔ͞ ΕΔ ࠂओ͝ͱͰɺೖࡳճ͕ҟͳΔ
<>3FBM5JNF#JEEJOH"MHPSJUINTGPS1FSGPSNBODF #BTFE%JTQMBZ"E"MMPDBUJPO OPOTUBUJDEJTUSJCVUJPOʹରͯ͠ɺ༗ޮͳख๏ɻ NBSLFUͷมԽʹରͯ͠ɺ ࣌ؒత ཻͷࡉ͔͍CJEΛઃఆɻ ϦΞϧλΠϜͰิਖ਼߲Λߋ৽͍͖ͯ͠ɺ͍࣌ؒͰͷͷ มԽʹରԠɻ
5ISPUUMJOH CJETDBMJOHͱ5ISPUUMJOHͷҧ͍ 5ISPUUMJOHͷత 5ISPUUMJOHͷߟ͑ํͭ "OFXJOQVUNPEFM
0OMJOF,OBQTBDL1SPCMFNXJUIFTUJNBUFT 0QUJNJ[JOHGPSBMMBEWFSUJTFSTTJNVMUBOFPVTMZ #FTUF⒎PSUSFHSFUGSFFUISPUUMJOH
5ISPUUMJOH CJETDBMJOHͱ5ISPUUMJOHͷҧ͍ 6 7 6 7 TDBMF͞ΕͨCJET͔Β ࠷େͷͷΛબͿ ΦʔΫγϣϯʹࢀՃ͢Δ͔
Ͳ͏͔ΛܾΊ͔ͯΒબͿ PSʹTDBMF͢Δ CJETDBMJOH UISPUUMJOH
5ISPUUMJOH CJETDBMJOHͱ5ISPUUMJOHͷҧ͍ 6 7 6 7 TDBMF͞ΕͨCJET͔Β ࠷େͷͷΛબͿ ΦʔΫγϣϯʹࢀՃ͢Δ͔
Ͳ͏͔ΛܾΊ͔ͯΒબͿ PSʹTDBMF͢Δ 5ISPUUMF͞Εͨ ࠂΩϟϯϖʔϯ CJETDBMJOH UISPUUMJOH
5ISPUUMJOH 5ISPUUMJOHͷత ࠂΩϟϯϖʔϯͷ༧ࢉҎ্ʹೖࡳ͠ͳ͍ͨΊ ΩϟϯϖʔϯظؒதɺTNPPUIʹඅফ͍ͤͯͨ͘͞Ί 5ISPUUMJOHͷํ๏
*NQSFTTJPOWʹରͯ͠ɺVΛUISPUUMF͢Δ͔Ͳ͏͔ͷ֬QVΛ V͕Ωϟϯϖʔϯऴྃͱಉ࣌ʹඅফ͖͠ΕΔΑ͏ʹબͿɻ <>Ͱɺ࠷େԽͨ͠తؔΛ࠷େԽ͢ΔΑ͏ͳ0QUJNJ[FE UISPUUMJOHͱ͍͏ߟ͑ํΛಋೖ͍ͯ͠Δɻ
5ISPUUMJOH "OFXJOQVUNPEFM BVDUJPOUJNFQFSBEWFSUJTFSNFUSJDЖΛఆٛ͢Δɻ ྫ͑ɺࠂΩϟϯϖʔϯVʹର͢Δ*NQSFTTJPOWͷ$53 4V Y ЖV W
≥YͷΑ͏ͳYʹ͍ͭͯɺΫΤϦWʹର͢Δظඅফɻ 4V͕ࣄલʹ͔͍ͬͯΔͱ͍͏Ծఆɻ
5ISPUUMJOH "OFXJOQVUNPEFM ༧ࢉ#Vͱ͖ɺЖ $53 ≥НͷΫΤϦʹೖࡳ͢Δɻ ЖΛ$1$ͱ͓͍ͨ߹ɺЖ $1$ ≤НͷΫΤϦʹೖࡳ͢Δɻ
5ISPUUMJOH 0OMJOF,OBQTBDL1SPCMFNXJUIFTUJNBUFT ЗVVͷWBMVFQFSDMJDL ΫϦοΫͨΓͷظച্ 30*Λ࠷େԽ͢ΔΑ͏ͳ,OBQTBDL P⒐JOF Λߟ͑Δɻ 30*Λ࠷େԽ͢Δ͜ͱɺЗV$1$Λ࠷େԽ͢Δ͜ͱͱಉ͡ɻ ЗVࠂΩϟϯϖʔϯ͝ͱʹݻఆͳͷͰɺ$1$Λখ͘͢͞Δɻ
ඪͷඅফΛୡͭͭ͠ɺ30*Λ࠷େԽ͢Δʹɺ$1$Нͷ ΫΤϦWΛUISPUUMF͢Δɻ
5ISPUUMJOH 0OMJOFͰͷΞϧΰϦζϜɻ 0OMJOF,OBQTBDL1SPCMFNXJUIFTUJNBUFT
5ISPUUMJOH 0QUJNJ[JOHGPSBMMBEWFSUJTFSTTJNVMUBOFPVTMZ ͜Ε·Ͱͭͷࠂओ Ωϟϯϖʔϯ ʹ͍ͭͯɺUISPUUMJOHͷ Λߟ͖͑ͯͨɻ࣮ࡍʹɺෳͷࠂओ͕ΦʔΫγϣϯʹࢀ Ճ͍ͯ͠ΔͷͰɺͦΕͧΕͷඅফЖͷಠཱͰͳ͍ɻ ෳࠂओͷࢀՃʹΑΓʜ
ܝࡌॱҐ͕Լ͕Γɺ$53͕མͪΔ TFDPOEQSJDFΦʔΫγϣϯʹΑΓɺ$1$͕࣍ͷॱҐͷVͷ ͷͱͳΔ <>ͰɺଞͷࠂओΛߟྀͨ͠UISPUUMJOHΛఏҊ͍ͯ͠Δ
5ISPUUMJOH #FTUF⒎PSUSFHSFUGSFFUISPUUMJOH ෳࠂओͰͷ࠷దԽΛߟ͑ͨͱ͖ʹɺෆެฏ͞ͷ͕ੜ͡Δɻ ྫ͑ɺ HMPCBMͳ ΫϦοΫ࠷େԽͷͱ͖ɺ༧ࢉͷେ͖ͳࠂओ ͷΫϦοΫ͕૿͑Δɻ <>ͰCFTUF⒎PSUɺ<>ͰSFHSFUGSFFͱ͍͏ख๏Ͱɺ ࠂओ͝ͱʹෆެฏ͕ੜ͡ͳ͍Α͏ʹ͍ͯ͠Δɻ