Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
Federated Learning 連合学習
Search
regonn
March 24, 2023
Technology
4
1.3k
Federated Learning 連合学習
Regonn @関西Kaggler交流会 2023/03/24
regonn
March 24, 2023
Tweet
Share
More Decks by regonn
See All by regonn
HelloMoon x Orca=HelloOrca
regonn
0
84
The Challenge of Automatically Configuring Numerai Compute Environment
regonn
0
44
PLATEAUをデータベースに取り込んでみた
regonn
0
1.6k
古参Numerai参加者の戯言
regonn
1
2.1k
Nim + Cloud Run + TerraformでGCPにNimのサーバーレス環境を作る
regonn
1
550
S+ Camera Basicと似た環境をラズパイから構築してみる
regonn
0
430
衛星画像のゴルフ場写り込み判定AIモデルを作る
regonn
0
560
データラーニングギルド での活動と今後
regonn
0
92
伝説の生き物を飼ってみた
regonn
0
140
Other Decks in Technology
See All in Technology
普段有償でサポート業務をしているCSAが技術知見を無料で公開する理由
07jp27
1
640
PHPカンファレンス小田原2024
ysknsid25
3
660
Oracle Cloud Infrastructure:2024年4月度サービス・アップデート
oracle4engineer
PRO
1
120
Databricks における 『MLOps』
databricksjapan
2
140
Delivering Millions of Messages within seconds @ Duolingo
pelelgrino
0
340
KubeCon EU 2024 Recap “Kubernetes Policy Time Machine: Where to Next?”
ryysud
0
140
シン・Kafka / shin-kafka
oracle4engineer
PRO
8
2.7k
オブザーバビリティの Primary Signals
onk
PRO
0
550
反実仮想機械学習とは何か
usaito
PRO
7
2.4k
Terraformあれやこれ/terraform-this-and-that
emiki
7
610
SPI原点回帰論:事業課題とFour Keysの結節点を見出す実践的ソフトウェアプロセス改善 / DevOpsDays Tokyo 2024
visional_engineering_and_design
4
1.6k
GraphQL 成熟度モデルの紹介と、プロダクトに当てはめた事例 / GraphQL maturity model
mh4gf
4
260
Featured
See All Featured
The Language of Interfaces
destraynor
151
23k
RailsConf 2023
tenderlove
2
530
BBQ
matthewcrist
80
8.7k
Refactoring Trust on Your Teams (GOTO; Chicago 2020)
rmw
24
2.3k
Building a Scalable Design System with Sketch
lauravandoore
455
32k
Keith and Marios Guide to Fast Websites
keithpitt
408
22k
WebSockets: Embracing the real-time Web
robhawkes
59
7k
Docker and Python
trallard
33
2.7k
"I'm Feeling Lucky" - Building Great Search Experiences for Today's Users (#IAC19)
danielanewman
220
21k
Code Reviewing Like a Champion
maltzj
513
39k
VelocityConf: Rendering Performance Case Studies
addyosmani
320
23k
Become a Pro
speakerdeck
PRO
10
4.5k
Transcript
Regonn @ؔKagglerަྲྀձ 2023/03/24 Federated Learning ࿈߹ֶश
Regonn (@regonn_haizine) • Kaggle Competition Expert • Kaggle ؔ࿈ Podcast
(with ΧϨʔͪΌΜ) • ౡࠜͷϑϦʔϥϯε • ϒϩοΫνΣʔϯɾϝλόʔεɾػցֶश(Ӵσʔλɾ)ͷࣄҊ݅ • Solana Japan Orca(DEX: ࢄऔҾॴ) ͷ CM • ڈ͔Βۀ࢝Ίͯ·͢
࠷ۙ AI ͷਐา֮·͍͠ • ChatGPT-4 • Hugging Face ͷ͓͔͛Ͱɺత(Task)ʹ߹ͬͨɺֶशࡁΈϞσϧΛར༻͠ ͘͢ͳ͖͍ͬͯͯΔ
औಘ͕͍͠σʔλᶃ • ΤοδσόΠεσʔλ • ௨৴ଳҬͳͲͷ੍ݶ • શͯͷηϯαʔσʔλऔಘ͍͠
औಘ͕͍͠σʔλᶄ • ҩྍσʔλɾސ٬σʔλ • ϓϥΠόγʔ • ଞࣾؒͰͷڞ༗
Federated Learning(FL) ࢄͯ͠อ࣋͞ΕͨσʔλΛऩूɾू͢Δ͜ͱͳ͘ػցֶशϞσϧͷ܇࿅ʹ ༻͍Δํ๏
Federated Learning(FL)ͷछྨ • ਫฏ࿈߹ֶश • ਨ࿈߹ֶश • ࿈߹సҠֶश
ਫฏ࿈߹ֶश • ͦΕͧΕ͕ɺಉ͡ಛྔͰɺҟͳΔσʔληοτΛ͍࣋ͬͯͨ߹ • ΤοδσόΠεͰ͜ͷλΠϓ
ਫฏ࿈߹ֶश ᶃ ᶄ ᶅ ᶃϩʔΧϧͰֶश ᶄதԝαʔόʔʹଛࣦޯใΛૹΔ ᶅதԝαʔόʔͰΞϯαϯϒϧతॲཧ(ޯฏۉԽ) ᶆߋ৽͞ΕͨϞσϧΛશͯฦ͢ ᶆ
ਨ࿈߹ֶश • ͦΕͧΕಛྔҟͳΔ͕ɺಉ͡λʔήοτͷσʔλΠϯσοΫε͕ଘࡏ͢ Δ߹ ߴ ϩʔϯ ސ٬A xx yy ௨৴ྔ
՝ֹۚ ސ٬A xx yy ΫϨδοτΧʔυͷσϑΥϧτ༧ଌ σϑΥϧτ ސ٬A 1
ਨ࿈߹ֶश ߴ ϩʔϯ ސ٬A xx yy ސ٬C zz ww ௨৴ྔ
՝ֹۚ ސ٬A kk mm ސ٬B aa bb σϑΥϧτ ސ٬A 1 ސ٬D 0 ※ݫີͰͳ͍ தԝαʔόʔͰ҉߸伴Λ࡞Γެ։伴Λɺ ͦΕͧΕͷϩʔΧϧͰ҉߸Խ͠ɺ ΞϊχϚΠζ͞ΕͨσʔλͰֶश ߴ ϩʔϯ ௨৴ྔ աֹۚ σϑΥϧτ ސ٬A xx yy kk mm 1
࿈߹సҠֶश • ಛྔλʔήοτҟͳΔ߹ • ࣅ͍ͯΔυϝΠϯྖҬ • αΠζ͕େ෯ʹҟͳΔ߹
Federated Learningͷใु • ͦΕͧΕͷɺϞσϧߩݙʹԠͯ͡ใुΛܭࢉ͢ΔϩδοΫݚڀ͞Εͯ ͍Δ
Numerai • ۚ༥σʔλͷਨ࿈߹ֶशతͳͷ͕Ͱ͖͍ͯΔ • શੈքגࣜࢢͷגՁͷಈ͖ΛNumeraiଆ͕࡞ͨ͠Target 0~1Ͱ༧ଌ͢Δ • Numerai Signals ͰɺಛྔࣗͰ༻ҙͯ͘͠Δ
• ࣮ࡍʹσʔλͰϑΝϯυ͕ӡ༻͞ΕͯɺརӹͷҰ෦ΛϞσϧͷߩݙʹԠ͡ ͯ͞ΕΔ
Federated Learning ϥΠϒϥϦؔ࿈ • େ͖Ίͷͷͩͱ • https://github.com/tensorflow/federated • TensorflowFederated: Tensorflow
ͷެࣜ Federated ϥΠϒϥϦ • https://github.com/OpenMined/PySyft • PySyft: PyTorch Λ͏߹ͩͬͨΒɺͪ͜ΒΛ͏ • ͓ͦΒ͘ɺϥΠϒϥϦ͚ͩͰͳ͘αʔϏεࠓޙ૿͖͑ͯͦ͏
ࢀߟਤॻ Federated Learning: ϓϥΠόγʔอޢԼʹ͓͚Δػցֶश
ऴΘΓ