Federated Learning 連合学習

Regonn @関西Kaggler交流会 2023/03/24

Transcript

1. Regonn @ؔ੢Kagglerަྲྀձ 2023/03/24 Federated Learning ࿈߹ֶश
2. Regonn (@regonn_haizine) • Kaggle Competition Expert • Kaggle ؔ࿈ Podcast (with ΧϨʔͪΌΜ) • ౡࠜͷϑϦʔϥϯε • ϒϩοΫνΣʔϯɾϝλόʔεɾػցֶश(Ӵ੕σʔλɾ೴೾)ͷ࢓ࣄҊ݅ • Solana Japan ΍ Orca(DEX: ෼ࢄऔҾॴ) ͷ CM • ڈ೥͔Β೶ۀ΋࢝Ίͯ·͢
3. ࠷ۙ AI ͷਐา΋໨֮·͍͠ • ChatGPT-4 • Hugging Face ౳ͷ͓͔͛Ͱɺ໨త(Task)ʹ߹ͬͨɺֶशࡁΈϞσϧΛར༻͠ ΍͘͢ͳ͖͍ͬͯͯΔ
4. औಘ͕೉͍͠σʔλᶃ • ΤοδσόΠεσʔλ • ௨৴ଳҬͳͲͷ੍ݶ • શͯͷηϯαʔσʔλऔಘ͸೉͍͠
5. औಘ͕೉͍͠σʔλᶄ • ҩྍσʔλɾސ٬σʔλ • ϓϥΠόγʔ໰୊ • ଞࣾؒͰͷڞ༗
6. Federated Learning(FL) ෼ࢄͯ͠อ࣋͞ΕͨσʔλΛऩूɾू໿͢Δ͜ͱͳ͘ػցֶशϞσϧͷ܇࿅ʹ ༻͍Δํ๏
7. Federated Learning(FL)ͷछྨ • ਫฏ࿈߹ֶश • ਨ௚࿈߹ֶश • ࿈߹సҠֶश
8. ਫฏ࿈߹ֶश • ͦΕͧΕ͕ɺಉ͡ಛ௃ྔͰɺҟͳΔσʔληοτΛ͍࣋ͬͯͨ৔߹ • ΤοδσόΠε౳Ͱ΋͜ͷλΠϓ
9. ਫฏ࿈߹ֶश ᶃ ᶄ ᶅ ᶃϩʔΧϧͰֶश ᶄதԝαʔόʔʹଛࣦ΍ޯ഑৘ใΛૹΔ ᶅதԝαʔόʔͰΞϯαϯϒϧతॲཧ(ޯ഑ฏۉԽ) ᶆߋ৽͞ΕͨϞσϧΛશͯ΁ฦ͢ ᶆ
10. ਨ௚࿈߹ֶश • ͦΕͧΕಛ௃ྔ͸ҟͳΔ͕ɺಉ͡λʔήοτͷσʔλΠϯσοΫε͕ଘࡏ͢ Δ৔߹ ࢒ߴ ϩʔϯ ސ٬A xx yy ௨৴ྔ ՝ֹۚ ސ٬A xx yy ΫϨδοτΧʔυͷσϑΥϧτ༧ଌ σϑΥϧτ ސ٬A 1
11. ਨ௚࿈߹ֶश ࢒ߴ ϩʔϯ ސ٬A xx yy ސ٬C zz ww ௨৴ྔ ՝ֹۚ ސ٬A kk mm ސ٬B aa bb σϑΥϧτ ސ٬A 1 ސ٬D 0 ※ݫີͰ͸ͳ͍ தԝαʔόʔͰ҉߸伴Λ࡞Γެ։伴Λ഑෍ɺ ͦΕͧΕͷϩʔΧϧͰ҉߸Խ͠ɺ ΞϊχϚΠζ͞ΕͨσʔλͰֶश ࢒ߴ ϩʔϯ ௨৴ྔ աֹۚ σϑΥϧτ ސ٬A xx yy kk mm 1
12. ࿈߹సҠֶश • ಛ௃ྔ΋λʔήοτ΋ҟͳΔ৔߹ • ࣅ͍ͯΔυϝΠϯྖҬ • ෼෍΍αΠζ͕େ෯ʹҟͳΔ৔߹
13. Federated Learningͷใु • ͦΕͧΕͷɺϞσϧߩݙ౓ʹԠͯ͡ใुΛܭࢉ͢ΔϩδοΫ౳΋ݚڀ͞Εͯ ͍Δ
14. Numerai • ۚ༥σʔλͷਨ௚࿈߹ֶशతͳ΋ͷ͕Ͱ͖͍ͯΔ • શੈքגࣜࢢ৔ͷגՁͷಈ͖ΛNumeraiଆ͕࡞੒ͨ͠Target 0~1Ͱ༧ଌ͢Δ • Numerai Signals Ͱ͸ɺಛ௃ྔ͸ࣗ෼Ͱ༻ҙͯ͘͠Δ • ࣮ࡍʹσʔλͰϑΝ΢ϯυ͕ӡ༻͞ΕͯɺརӹͷҰ෦ΛϞσϧͷߩݙ౓ʹԠ͡ ͯ෼഑͞ΕΔ
15. Federated Learning ϥΠϒϥϦؔ࿈ • େ͖Ίͷ΋ͷͩͱ • https://github.com/tensorflow/federated • TensorflowFederated: Tensorflow ͷެࣜ Federated ϥΠϒϥϦ • https://github.com/OpenMined/PySyft • PySyft: PyTorch Λ࢖͏৔߹ͩͬͨΒɺͪ͜ΒΛ࢖͏ • ͓ͦΒ͘ɺϥΠϒϥϦ͚ͩͰͳ͘αʔϏε΋ࠓޙ૿͖͑ͯͦ͏
16. ࢀߟਤॻ Federated Learning: ϓϥΠόγʔอޢԼʹ͓͚Δػցֶश
17. ऴΘΓ