Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
Federated Learning 連合学習
Search
regonn
March 24, 2023
Technology
4
1.6k
Federated Learning 連合学習
Regonn @関西Kaggler交流会 2023/03/24
regonn
March 24, 2023
Tweet
Share
More Decks by regonn
See All by regonn
Submission with Numerai Compute using GCP Batch
regonn
0
520
HelloMoon x Orca=HelloOrca
regonn
0
120
The Challenge of Automatically Configuring Numerai Compute Environment
regonn
0
80
PLATEAUをデータベースに取り込んでみた
regonn
0
1.7k
古参Numerai参加者の戯言
regonn
1
2.4k
Nim + Cloud Run + TerraformでGCPにNimのサーバーレス環境を作る
regonn
1
630
S+ Camera Basicと似た環境をラズパイから構築してみる
regonn
0
500
衛星画像のゴルフ場写り込み判定AIモデルを作る
regonn
0
740
データラーニングギルド での活動と今後
regonn
0
160
Other Decks in Technology
See All in Technology
LT:組込み屋さんのオシロが壊れた!
windy_pon
0
350
セキュリティSaaS企業が実践するCursor運用ルールと知見 / How a Security SaaS Company Runs Cursor: Rules & Insights
tetsuzawa
0
220
大手企業のAIツール導入の壁を越えて:サイバーエージェントのCursor活用戦略
gunta
6
810
積み上げられた技術資産と向き合いながら、プロダクトの信頼性をどう守るか
plaidtech
PRO
0
850
令和トラベルQAのAI活用
seigaitakahiro
0
520
データプレーンプログラミングとは? DPU&スイッチASICの開発経験から語る
ebiken
PRO
1
260
All About Sansan – for New Global Engineers
sansan33
PRO
1
1.2k
GitHub Coding Agent 概要
kkamegawa
1
1.6k
超簡単!RAGアプリケーション構築術
oracle4engineer
PRO
0
120
TypeScript と歩む OpenAPI の discriminator / OpenAPI discriminator with TypeScript
kaminashi
1
150
会社員しながら本を書いてきた知見の共有
sat
PRO
3
690
Slackひと声でブログ校正!Claudeレビュー自動化編
yusukeshimizu
3
170
Featured
See All Featured
Automating Front-end Workflow
addyosmani
1370
200k
How to Create Impact in a Changing Tech Landscape [PerfNow 2023]
tammyeverts
52
2.8k
jQuery: Nuts, Bolts and Bling
dougneiner
63
7.8k
Scaling GitHub
holman
459
140k
10 Git Anti Patterns You Should be Aware of
lemiorhan
PRO
656
60k
Rebuilding a faster, lazier Slack
samanthasiow
81
9k
Typedesign – Prime Four
hannesfritz
41
2.6k
Chrome DevTools: State of the Union 2024 - Debugging React & Beyond
addyosmani
6
650
Understanding Cognitive Biases in Performance Measurement
bluesmoon
29
1.7k
XXLCSS - How to scale CSS and keep your sanity
sugarenia
248
1.3M
JavaScript: Past, Present, and Future - NDC Porto 2020
reverentgeek
48
5.4k
Six Lessons from altMBA
skipperchong
28
3.8k
Transcript
Regonn @ؔKagglerަྲྀձ 2023/03/24 Federated Learning ࿈߹ֶश
Regonn (@regonn_haizine) • Kaggle Competition Expert • Kaggle ؔ࿈ Podcast
(with ΧϨʔͪΌΜ) • ౡࠜͷϑϦʔϥϯε • ϒϩοΫνΣʔϯɾϝλόʔεɾػցֶश(Ӵσʔλɾ)ͷࣄҊ݅ • Solana Japan Orca(DEX: ࢄऔҾॴ) ͷ CM • ڈ͔Βۀ࢝Ίͯ·͢
࠷ۙ AI ͷਐา֮·͍͠ • ChatGPT-4 • Hugging Face ͷ͓͔͛Ͱɺత(Task)ʹ߹ͬͨɺֶशࡁΈϞσϧΛར༻͠ ͘͢ͳ͖͍ͬͯͯΔ
औಘ͕͍͠σʔλᶃ • ΤοδσόΠεσʔλ • ௨৴ଳҬͳͲͷ੍ݶ • શͯͷηϯαʔσʔλऔಘ͍͠
औಘ͕͍͠σʔλᶄ • ҩྍσʔλɾސ٬σʔλ • ϓϥΠόγʔ • ଞࣾؒͰͷڞ༗
Federated Learning(FL) ࢄͯ͠อ࣋͞ΕͨσʔλΛऩूɾू͢Δ͜ͱͳ͘ػցֶशϞσϧͷ܇࿅ʹ ༻͍Δํ๏
Federated Learning(FL)ͷछྨ • ਫฏ࿈߹ֶश • ਨ࿈߹ֶश • ࿈߹సҠֶश
ਫฏ࿈߹ֶश • ͦΕͧΕ͕ɺಉ͡ಛྔͰɺҟͳΔσʔληοτΛ͍࣋ͬͯͨ߹ • ΤοδσόΠεͰ͜ͷλΠϓ
ਫฏ࿈߹ֶश ᶃ ᶄ ᶅ ᶃϩʔΧϧͰֶश ᶄதԝαʔόʔʹଛࣦޯใΛૹΔ ᶅதԝαʔόʔͰΞϯαϯϒϧతॲཧ(ޯฏۉԽ) ᶆߋ৽͞ΕͨϞσϧΛશͯฦ͢ ᶆ
ਨ࿈߹ֶश • ͦΕͧΕಛྔҟͳΔ͕ɺಉ͡λʔήοτͷσʔλΠϯσοΫε͕ଘࡏ͢ Δ߹ ߴ ϩʔϯ ސ٬A xx yy ௨৴ྔ
՝ֹۚ ސ٬A xx yy ΫϨδοτΧʔυͷσϑΥϧτ༧ଌ σϑΥϧτ ސ٬A 1
ਨ࿈߹ֶश ߴ ϩʔϯ ސ٬A xx yy ސ٬C zz ww ௨৴ྔ
՝ֹۚ ސ٬A kk mm ސ٬B aa bb σϑΥϧτ ސ٬A 1 ސ٬D 0 ※ݫີͰͳ͍ தԝαʔόʔͰ҉߸伴Λ࡞Γެ։伴Λɺ ͦΕͧΕͷϩʔΧϧͰ҉߸Խ͠ɺ ΞϊχϚΠζ͞ΕͨσʔλͰֶश ߴ ϩʔϯ ௨৴ྔ աֹۚ σϑΥϧτ ސ٬A xx yy kk mm 1
࿈߹సҠֶश • ಛྔλʔήοτҟͳΔ߹ • ࣅ͍ͯΔυϝΠϯྖҬ • αΠζ͕େ෯ʹҟͳΔ߹
Federated Learningͷใु • ͦΕͧΕͷɺϞσϧߩݙʹԠͯ͡ใुΛܭࢉ͢ΔϩδοΫݚڀ͞Εͯ ͍Δ
Numerai • ۚ༥σʔλͷਨ࿈߹ֶशతͳͷ͕Ͱ͖͍ͯΔ • શੈքגࣜࢢͷגՁͷಈ͖ΛNumeraiଆ͕࡞ͨ͠Target 0~1Ͱ༧ଌ͢Δ • Numerai Signals ͰɺಛྔࣗͰ༻ҙͯ͘͠Δ
• ࣮ࡍʹσʔλͰϑΝϯυ͕ӡ༻͞ΕͯɺརӹͷҰ෦ΛϞσϧͷߩݙʹԠ͡ ͯ͞ΕΔ
Federated Learning ϥΠϒϥϦؔ࿈ • େ͖Ίͷͷͩͱ • https://github.com/tensorflow/federated • TensorflowFederated: Tensorflow
ͷެࣜ Federated ϥΠϒϥϦ • https://github.com/OpenMined/PySyft • PySyft: PyTorch Λ͏߹ͩͬͨΒɺͪ͜ΒΛ͏ • ͓ͦΒ͘ɺϥΠϒϥϦ͚ͩͰͳ͘αʔϏεࠓޙ૿͖͑ͯͦ͏
ࢀߟਤॻ Federated Learning: ϓϥΠόγʔอޢԼʹ͓͚Δػցֶश
ऴΘΓ