クックパッドの機械学習を支える基盤のつくりかた ~番外編~ / Machine Learning ops at Cookpad

第12回 Machine Learning 15minutes! にて https://machine-learning15minutes.connpass.com/event/52835/

Transcript

1. ΫοΫύουͷػցֶशΛ
 ࢧ͑Δج൫ͷͭ͘Γ͔ͨ
   d൪֎ฤd છ୩
   ༔Ұ࿠
   !
   ΫοΫύουגࣜձࣾ
2.  ࣗݾ঺հ ‣ www.ayemos.me ‣ github.com/ayemos ‣ twitter.com/ayemos_y ‣ છ୩
   ༔Ұ࿠
   <:VJDIJSP
   4PNFZB>
    ೥݄
   ౦ژ޻ۀେֶେֶӃ
   ܭࢉ޻ֶઐ߈
   म࢜
    ೥݄ʙݱࡏ
   ΫοΫύουגࣜձࣾ
   ݚڀ։ൃ෦
3.  
4. ΫοΫύου
   ݚڀ։ൃ෦ͷྺ࢙
5.  ೥݄
   ݚڀ։ൃνʔϜ ඇެࣜ
   ൃ଍
   ೥݄
   ݚڀ։ൃνʔϜ ެࣜ
   ൃ଍
   ೥݄
   ݚڀ։ൃࣨൃ଍
   ೥݄
   ݚڀ։ൃ෦ൃ଍ 
6. 
   
   ೥݄
    ྉཧ͖Ζ͘
   ެ։
7.  ྉཧ͖Ζ͘ ‣ εϚʔτϑΥϯͷࣸਅͷ಺ɺྉཧΛࣗಈతʹ ऩूه࿥
    $//ʹΑΔྉཧը૾ೝࣝ 
8.  ೥݄
   ݚڀ։ൃνʔϜ ඇެࣜ
   ൃ଍
   ೥݄
   ݚڀ։ൃνʔϜ ެࣜ
   ൃ଍
   ೥݄
   ݚڀ։ൃࣨൃ଍
   ೥݄
   ݚڀ։ൃ෦ൃ଍
   ೥݄
   ྉཧ͖Ζ͘
   ެ։
   
9.  ೥݄
   ݚڀ։ൃνʔϜ ඇެࣜ
   ൃ଍
   ೥݄
   ݚڀ։ൃνʔϜ ެࣜ
   ൃ଍
   ೥݄
   ݚڀ։ൃࣨൃ଍
   ೥݄
   ݚڀ։ൃ෦ൃ଍
   ೥݄
   ྉཧ͖Ζ͘
   ެ։
   ೥݄
   ਓ޻஌ೳֶձ
     
   IUUQTLBJHJPSHKTBJXFCQSPHSBNQBQFSIUNM
10. ݚڀ։ൃج൫
11. ݚڀ։ൃͷ؀ڥ΍ӡ༻ʹؔΘΔ
    ͋ΒΏΔٕज़త՝୊
    Λղܾ
12. ՝୊Ћ
    ܭࢉػ؀ڥߏஙίετ
13.  ‣ ݚڀ։ൃ෦ʹઐ೚ͷΠϯϑϥ୲౰͕͍ͳ͍
     ೥݄౰࣌ͷঢ়گ
    ‣ (16؀ڥͷߏங͸೉͍͠
     OWJEJBESJWFS
    DVEB
    DVEOO
    %//ϑϨʔϜϫʔΫ
    ʜ
    ‣ (16؀ڥ͕ඞཁʹͳ͔ͬͯΒ࢖͍࢝ΊΔ·Ͱिؒ 
14.   IUUQTXXXQBDLFSJP
15.  { "builders": [{ "type": "amazon-ebs", "region": "ap-northeast-1", "ami_regions": ["us-east-1", "ap-northeast-1"], "source_ami": "ami-d85e7fbf", "instance_type": "g2.2xlarge", "ssh_username": "ubuntu", "ssh_timeout": "10m", }], "provisioners": [ { "type": "chef-solo", "cookbook_paths": ["cookbooks", "site-cookbooks"], "run_list": [ "recipe[apt]", "nvidia-driver", "docker-install", "cuda-apt-source", "cuda", "cudnn", "awscli" ] } ] }  package 'nvidia-361' do end execute "install nvidia driver" do command "curl -sLo /tmp/nvidia-driver #{node["nvidia_driver"]["source"]} "test #{node["nvidia_driver"]["sha256sum"]} '=' \"$(sha256sum /tmp/nvid "chmod +x /tmp/nvidia-driver && " \ "/tmp/nvidia-driver -asZN && " \ "rm /tmp/nvidia-driver" not_if "test -d /proc/driver/nvidia" end
16.  
17.  
18. (16؀ڥߏஙͷ಺੡ԽʗࣗಈԽ
19. (16؀ڥߏஙͷ಺੡ԽʗࣗಈԽ ৽͍͠(16؀ڥΛ෼Ͱߏங
20. ՝୊Ќ
    ܭࢉػίετ
21.  
22.  
23.  
24.  
25.   IUUQUIFRVPUFTJOXQDPOUFOUVQMPBETLBSMNBSYRVPUFTKQH
26.   IUUQUIFRVPUFTJOXQDPOUFOUVQMPBETLBSMNBSYRVPUFTKQH
27. ՝୊Ѝ
    ܭࢉػ؅ཧίετ
28.  ‣ མͪͨΠϯελϯεΛຖேཱͯΔͷ͕໘౗
    ‣ 8FCίϯιʔϧ໘౗ɺ$-*͸೉͍͠ 
29.  ‣ ![PPFZ
    ‣ $IBU#PU
     HJUIVCDPNMJUBJPMJUB
    ੡
30.   ‣ ![PPFZ
    ‣ $IBU#PU
     HJUIVCDPNMJUBJPMJUB
    ੡
31.  ‣ མͪͨΠϯελϯεΛຖேཱͯΔͷ͕໘౗
    ‣ 8FCίϯιʔϧ໘౗ɺ$-*͸೉͍͠ 
32. σʔλج൫
33.  ‣ %8)
    "NB[PO
    3FETIJGU 
34.  "QQ@:  "QQ@9 %8)
35.   IUUQTXXXTMJEFTIBSFOFUNJOFSPBPLJDPPLQBEUFDIDPOGEXI
36. ՝୊
    σʔλ࠶ݱੑ
37.   ‣ %8)ʹग़དྷͳ͍͜ͱ
     ը૾ͳͲɺҰ෦σʔλιʔεͱͯ͠ѻ͑ͳ͍΋ͷ͕͋Δ
38.  
39.  ‣ %8)ʹग़དྷͳ͍͜ͱ
     ը૾ͳͲɺҰ෦σʔλιʔεͱͯ͠ѻ͑ͳ͍΋ͷ͕͋Δ
    ‣ ࣮ݧʹ͓͚Δσʔλͷ࠶ݱੑ͕௿͘ͳΓ͕ͪ
     ࠶ݱ͕໘౗
    PS
    ࠶ݱ͕೉͍͠
     1ZUIPO͔Β֤छσʔλιʔεΛ৮Δํ๏͕ෳࡶ 
40.   IUUQHJUIVCDPNBZFNPTBLBHJ
41.  ‣ σʔληοτΛந৅Խͯ͠ɺ
     ྫ͑͹ɺ
 ʮσʔληοτͱ͸GPSจͰճͨ͠ΓϩʔΧϧ'4ʹ
 อଘͨ͠Γग़དྷΔଘࡏʯ
    ‣ ֤छσʔλιʔε΁ͷΞΫηεΛ؆୯ʹ͢Δ
     .Z42-
    4
    3FE4IJGU
    4QSFBE4IFFU
    -PDBM'4
    ʜ 
42.  
43.  ‣ %POF
     ՝୊Ћ
    ܭࢉػ؀ڥߏஙίετ
     ՝୊Ќ
    ܭࢉػίετ
     ՝୊Ѝ
    ܭࢉػ؅ཧίετ
    ‣ %PJOH
     ՝୊
    σʔλ࠶ݱੑ