pytorchで機械学習しない

pytorchでマクローリン展開とニュートン法を試してみました。

Transcript

1. pytorchͰػցֶश͠ͳ͍ ػցֶश/Kaggle΋͘΋͘ձ#10ˏ େࡕ(10/21 19:00ʙ) ാɹྒྷհ
2. ͜͡͠ΐ͏͔͍ twitter (@hattan0523) ϝʔΧʔۈ຿ ීஈ͸$"%ϙνϙνͯ͠ɼ
   
   
   ͦΕͬΆ͍ਤΛग़͢ਓ
   ɹɹʢ୆෩ͷͱ͖ʹΨϥεʹςʔϓషΔ΂͖ͱ͔ܭࢉ͢ΔɻͲΜͳਤͰ΋࡞Ε·͢ʣ
   
   
   ػցֶश͸ओۀ຿Ͱ͸͋Γ·ͤΜ
   
   
   
   େֶ࣌୅ʹྔࢠޫֶͷݚڀʹूத͠ɼ
   
   
   ໟ൅Λࣦ͍ത࢜Λऔಘɻ
   
   http://www.breault.com/software/asap-nextgen https://www.muratasoftware.com/products/ examples/watgal004/
3. ಈػ pytorchͱ͔ਂ૚ֶशͷϥΠϒϥϦɼ ίϯϖʹ͍ͬͺ͍࢖ΘΕͯΔ͠ ը૾ͱ͔NLPͷਂ૚ֶशΛ΍Δͱ͖ ͱΓ͋͑ͣ࢖ͬͱ͖Ό͑͑΍Ζɻ https://twitter.com/nino_pira/status/1181913845507354626
4. ಈػ pytorchԿΛ΍ͬͯΔͷʁ ͡Ͳ͏ͼͿΜʁ ͠Μͦ͏͕͘͠ΎʔͷϥΠϒϥϦͰ͸ʁ ͦ͏ͩʂ
   ඍ෼Λ͠Α͏ʂ
   
5. ࠓճɿࣗಈඍ෼Λ࢖ͬͯܭࢉ ϚΫϩʔϦϯల։
   sinؔ਺Λ10࣍·Ͱ
   sinؔ਺Λ20࣍·Ͱ
   χϡʔτϯ๏ɹɹɹɹɹɹɹɹͷղΛग़͢
   
6. ࣗಈඍ෼ is Կʁ https://github.com/pytorch/pytorch/blob/edb88b5f3af03718b443d015f195faa1832ce95b/caffe2/operators/sin_op.cu ɾ਺஋ඍ෼ ࣮ࡍʹಋؔ਺ͷఆٛʹैͬͯ਺஋తʹܭࢉ͢Δɻ ޡ͕ࠩͰ͖Δɻ ɾࣗಈඍ෼ ܭࢉ͢Δؔ਺ͷಋؔ਺Λ༧Ίఆ͓ٛͯ͘͠ɻ
   ؔ਺ʹ୅ೖ͢Δ͚ͩͳͷͰޡࠩ͸΄΅ͳ͍ɻ
   pytorchͷsinͷಋؔ਺ͷఆٛ ໢ֻ͚ͷͱ͜ΖΛݟΔͱɼ ಋؔ਺(cos)͕ఆٛ͞Ε͍ͯΔ ͜ͱ͕Θ͔Δɻ ࢀߟɿࣗಈඍ෼Λ࣮૷ͯ͠ཧղ͢Δ https://qiita.com/lotz/items/39c52f08cc9b5d8439ca https://qiita.com/lotz/items/f1d4ab1d83dc13a5d81a
7. ࢖ͬͯΈΔ ී௨ʹΈͳ͞Μ͕࣮ߦ͍ͯ͠Δ͜ͱɻ requires_grad=Trueͱ͢Δ͜ͱͰɼඍ෼͢ΔΑʔͬͯએݴ͢Δɻ backward()ͰܭࢉάϥϑʹԊͬͯࣗಈඍ෼͕ݺͼग़͞Εɼ x.gradͰඍ෼܎਺͕ಘΒΕ·͢ɻ ࢀߟɿPyTorchͰߴ֊ภඍ෼܎਺ (https://qiita.com/tmasada/items/ 9dee38e5bc1482217493)
8. ೋ֊ඍ෼ ‘torch.autograd.grad(f, x, create_graph=True)’Ͱɼfʹ͍ͭͯxͰඍ ෼͢ΔΑʔͱએݴ͢Δɻ ܭࢉάϥϑΛ࡞Βͳ͍ͱඍ෼ͯ͘͠Εͳ͍ɻ ࡉ͔͍͜ͱ͸্ͷQiitaͷهࣄͰɻ ࢀߟɿPyTorchͰߴ֊ภඍ෼܎਺ (https://qiita.com/tmasada/items/ 9dee38e5bc1482217493)
9. ԿճͰ΋ඍ෼Ͱ͖·͢ʂ ࢀߟɿPyTorchͰߴ֊ภඍ෼܎਺ (https://qiita.com/tmasada/items/ 9dee38e5bc1482217493) ඍ෼͕Ͱ͖ΔʂͰ͖Δͧʂʂ
   
10. ϚΫϩʔϦϯల։ ׈Β͔ͳؔ਺Λ্ͷΑ͏ͳܗʹల։ͯ͠ɼ ۙࣅతͳؔ਺ͱͯ͠ද͢͜ͱ͕Ͱ͖Δɻ ਺ֶ͸ಘҙ͡Όͳ͍ͷͰɼ ݫີͳఆٛ͸Α͘Θ͔͍ͬͯ·ͤΜɻ ͜ΕΛpytorchͰ࣮૷ͯ͠ΈΑ͏ʂ (kaggleͷnotebookࢀর)
11. sinؔ਺ͰಘΒΕͨάϥϑ ΍ͬͨ͜ͱ 1.೚ҙͷ࣍਺·ͰܭࢉάϥϑΛ࡞੒ͯ͠ɼඍ෼܎਺Λܭࢉ͢Δ 2.֤ԣ࣠ͷ஋ʹରͯ͠ܭࢉͨ͠ඍ෼܎਺Ͱॎ࣠ͷ஋Λग़͢ɻ େมͳͷͰ1,2ΛߦྻͰܭࢉ͢Δ sinؔ਺Λ10࣍·Ͱ
    sinؔ਺Λ20࣍·Ͱ
    https://www.kaggle.com/hattan0523/pytorch-maclaurin-series? scriptVersionId=22206309
12. χϡʔτϯ๏ ඍ෼Λ࢖ͬͯํఔࣜΛղ͘ํ๏ ʹ͍ͭͯࣗಈඍ෼Λ࢖ͬͯղ͍ͯΈΔɻ ղ͸ x=ln2≒0.69314718056 C++ - ඇઢܗํఔࣜͷղ๏ʢχϡʔ τϯ๏ʣʂ https://www.mk-mode.com/blog/ 2012/11/21/21002047/# ΑΓҾ༻
13. σϞ̎ɿ݁Ռ ࣮૷ίʔυ: https://www.kaggle.com/hattan0523/newton-raphson-method-by- pytorch ղ͸ x=ln2≒0.69314718056 ॳظ஋ͱؔ਺Λ༩͑Ε͹ɼ೚ҙͷճ਺ܭࢉΛߦͬͯ͘ΕΔɻ ֓ͶऩଋͰ͖ͨʂ
14. ·ͱΊ ɾpytorch͸ࣗಈඍ෼ͷϥΠϒϥϦ Ͱ͌ʔ΀ΒʔʹΜ͙Ͱ͸ͳͦ͞͏ɻ ɾܭࢉάϥϑΛ໌ࣔతʹ࡞ͬͯ͋͛Δ͜ͱͰ ɹඍ෼Մೳͳؔ਺Λ࢖͍ͬͯΖΜͳ༡ͼ͕Ͱ͖ͦ͏ɻ ɾྫͱͯ͠ɼ sinؔ਺ͷϚΫϩʔϦϯల։ χϡʔτϯ๏Λ࢖ͬͨํఔࣜͷղΛಋग़ͨ͠ɻ ɾඍ෼͸ָ͍͠ΊΔͬ