Rustとtonicで始める gRPC再入門

gunmaweb #50

Transcript

1. Rustͱ tonicͰ࢝ΊΔ gRPC࠶ೖ໳ Advanced guide for development gRPC service with Rust and tonic. Gunma.web #50 ςʔϚϑϦʔ 2023.09.10 @ Takasaki Met., Empire of Gunma Tsubasa SEKIGUCHI
2. TinyKitten Freelance frontend engineer I 💖 OSS & Cat🐈 Born in Gunma🐴 Live in Tokyo🗼
3. Tsubasa SEKIGUCHI ౎಺Λڌ఺ͱ͢Δ܈അݝલڮࢢੜ·ΕͷϑϦʔϥϯεͷ 
 ϑϩϯτΤϯυΤϯδχΞɻ
   ͖ͬͨΜͱݺ͹Ε͍ͯ·͢ɻ
4. ೥ͿΓʹ໊ࢗͷσβΠϯΛߋ৽͠·ͨ͠ɻ
5. NFCνοϓ͕͋Γ·͢
   ࠓൃදͰ࢖༻͍ͯ͠ΔMacBook Airͷఱ൘ʹషΒΕͨεςοΧʔͷཪଆʹ NFCνοϓΛຒΊࠐΜͰ͍·͢ɻ 
 ձ৔ࢀՃͷํ͸NFCରԠεϚϗͰੋඇ͓ࢼ͍ͩ͘͠͞ɻ
   ࣮͸໊ࡳʹ΋/'$λάΛજ·͍ͤͯ·͢ɻ
6. TrainLCD ೔ຊશࠃͷమಓ࿏ઢͰ࢖͑Δ ৽ײ֮ͷφϏήʔγϣϯΞϓϦͰ͢ɻ
7. ిޫܝࣔ൘෩ςʔϚ
   ۙ೔഑৴༧ఆ ˞ը૾͸։ൃதͷ΋ͷͰ͢ɻ
8. J1BE04ɺJ04൛͕͠ΕͬͱφϏήʔγϣϯΧςΰϦͰҐҎ಺ʹϥϯΫΠϯͯ͠·ͨ͠
9. TrainLCDͷݪܕதͷݪܕͷΞϓϦʹؔͯ͠ͷηογϣϯΛͨ͠ࡍͷ഑৴͕YouTubeʹ͋Γ·͢
10. ˞͜ͷ23ίʔυ͸ಈతʹ63-ΛมߋͰ͖ΔͨΊɺࠓޙϦϯΫ͕ػೳ͠ͳ͘ͳΔՄೳੑ͕͋Γ·͢
11. ࠓճͷLTͰ࿩͢ൣғ  લճ(Gunma.web #49) ͷଓ͖ 
 લճݟ͍ͯͳ͍ํ΋Θ͔ΔΑ͏ʹਐΊ·͢ 
 ۩ମతʹ͸RustΛ࢖͍͍ͬͨͩͨ۩ମతͳ࣮૷ͱ͔ɻ 
 લճͷηογϣϯ͸Speaker Deckʹ্͕ͬͯ·͢ɻ
12. ࠓճͷLTͰ࿩͢ൣғ  લճ(Gunma.web #49) ͷଓ͖ 
 લճݟ͍ͯͳ͍ํ΋Θ͔ΔΑ͏ʹਐΊ·͢ 
 ۩ମతʹ͸RustΛ࢖͍͍ͬͨͩͨ۩ମతͳ࣮૷ͱ͔ɻ 
 લճͷηογϣϯ͸Speaker Deckʹ্͕ͬͯ·͢ɻ ˞͜ͷ23ίʔυ͸ಈతʹ63-ΛมߋͰ͖ΔͨΊɺࠓޙϦϯΫ͕ػೳ͠ͳ͘ͳΔՄೳੑ͕͋Γ·͢
13. ࠓճͷLTͰ࿩͞ͳ͍ൣғ  ϋϯζΦϯͰ͖ΔϨϕϧͷ࣮૷ͷ࿩ 
 ͔Μ΂Μ͍ͯͩ͘͠͞
     README.mdʹॻ͍ͯ͋Δఔ౓ͷ஌ࣝ 
 10෼Ͱ͸͕࣌ؒ଍Γ·ͤΜ
     JSͷόϯυϧαΠζͰ͸ͳ͘ମॏΛݮΒ͢ํ๏ 
 ૫ͤΔͨΊͷ͕࣌ؒͳ͍Ͱ͢
     ਅ໷தʹ΍Δؾ͕ग़Δݱ৅ʹ͍ͭͯ 
 ͜ͷεϥΠυ͸େମ࢓ࣄ͕ऴΘͬͯՋʹͳͬͨ໷தʹ࡞ͬͯ·͢
14. Introduction جૅ஌ࣝ
15. લճͷ͓͞Β͍  GoogleࣾͷߟҊͨ͠RPCϓϩτίϧ 
 RPC͸Remote Procedure Call(ԕִखଓ͖ݺͼग़͠ ͷུͰ͢ 
 gRPC͸ࣗࣾϚΠΫϩαʔϏεؒͰͷ಺੡γεςϜʮStubbyʯ͕લ਎
     IDL͔Β༷ʑͳݴޠͷίʔυ͕ੜ੒Ͱ͖Δ 
 ΋ͪΖΜJavaScript΋ՄೳͰ͢
     gRPC-webͰWebϒϥ΢β͔ΒgRPCαʔόʔΛୟ͚Δ 
 8FCϒϥ΢βͰͷ࢖༻Ͱ͸੍ݶ͕͋Δ 
 
    αʔόʔͱͷʮ௚઀ʯ௨৴͸Ͱ͖ͳ͍ʢجຊతʹ&OWPZ౳ͷϓϩΩγͷ༻ҙ͕ඞཁʣ 
  Bi-directional streaming(C/SؒͰ೚ҙͷλΠϛϯάͰ௨৴͕Ͱ͖Δ)ʹରԠ͍ͯ͠ͳ͍
16. ࠓճͷϓϩμΫγϣϯͳ୊ࡐ  TrainLCDΞϓϦͷAPI࣮૷ʮStationAPIʯ 
 TrainLCDͱ͍͏ΞϓϦΛझຯͰ࡞͍ͬͯ·͢ɻ
 ͜ͷΞϓϦͷAPIαʔόʔͷStationAPI͕͋Γɺ
 ͜ͷStationAPIΛ୊ࡐͱͯ͠஌ݟΛڞ༗͠·͢ɻ
 ͳ͓ɺStationAPI͸਺ϲ݄લʹNestJSΛ࢖ͬͨGraphQLαʔόʔͱͯ͠Քಇ͍ͤͯͯ͞ɺ
 NestJSͱApollo Server(GraphQL)ͷελοΫΛ
 Rust+tonic(gRPC)ʹҠߦ׬ྃͨ͠ͱ͜ΖͰ͢ɻ ˞͜ͷ23ίʔυ͸ಈతʹ63-ΛมߋͰ͖ΔͨΊɺࠓޙϦϯΫ͕ػೳ͠ͳ͘ͳΔՄೳੑ͕͋Γ·͢
17. ࠓճ঺հ͢ΔελοΫ
18. Rustͱ͸  ݴΘͣͱ஌Εͨϓϩάϥϛϯάݴޠ 
 CݴޠɺC++ʹ୅ΘΔγεςϜϓϩάϥϛϯάݴޠΛ໨ࢦ͍ͯ͠Δ
     GCͳΜͯ΋ͷ͸ͳ͍ 
 GCͳ͠ͰͷϝϞϦ҆શੑΛอূ͍ͯ͠Δ 
 ($ͷΑ͏ͳػߏ͕ඞཁͳ৔໘Ͱ͸εϚʔτϙΠϯλΛ࢖༻Մೳ 
 AtomicͳArcɺͦ͏Ͱ͸ͳ͍Rc͕͋Δ 
 WebAssemblyʹͩͬͯ࢖͑·͢
     ֶशίετߴΊ 
 आ༻ɺϥΠϑλΠϜͱࠓ·Ͱͳ͔ͬͨ֓೦͕͋Δ͕ɺ 
 ͦΕΒ͕ϝϞϦ҆શΛୡ੒͍ͤͯ͞Δ
19. tonicͱ͸  RustͷgRPC࣮૷ 
 3VTUͰ࢖͑ΔϋΠύϑΥʔϚϯεͰOSSɺ൚༻తͳgRPCϑϨʔϜϫʔΫ
     ϋΠύϑΥʔϚϯεʹϑΥʔΧε 
 ଞʹ΋૬ޓӡ༻ੑ͕͋ΓॊೈͳϥΠϒϥϦͱᨳ͍ͬͯΔ
    - ࢖͍ํʹΑͬͯ͸֎෦ϓϩΩγෆཁ 
 grpc-webͷαʔόʔͱͯ͠࢖͍͍ͨ৔߹͸ɺtonic-web crate͕͋Γ·͢ 
 tonic-web crateΛ࢖͏͜ͱͰɺϑϨʔϜϫʔΫଆͰHTTP/1.1Λ஻ΕΔΑ͏ʹͳΓ·͢ 
 ͭ·ΓɺEnvoy౳ͷ֎෦ϓϩΩγ͕ෆཁʹͳΓ·͢
20. Motivation ͳͥ΍Δͷ͔
21. StationAPIϑϧεΫϥονͷϞνϕʔγϣϯ
    (1/3)  NestJSΛ࢖͍ͬͯ·ͨ͠ 
 NestJSͰGraphQLϞδϡʔϧΛ࢖ͬͯGraphQLͷAPIΛ࣮૷͍ͯ͠·ͨ͠ɻ 
 NestJSࣗମ͸ѱ͘͸ͳ͔ͬͨͰ͢ɻΉ͠Ζਖ਼ࣾһ࣌୅ʹ࢖͍ͬͯͨ 
 Angularͱߏ଄͕ࣅ͍ͯͯɺϊελϧδʔʹਁΕ·ͨ͠ શવؔ܎ͳ͍ ɻ
     N+1໰୊ʹͿͪ౰ͨΔ 
 ΋ͪΖΜɺNestJSͰղܾෆՄೳͳ໰୊Ͱ͸ͳ͍ͷͰ͕͢ɻ 
 ۙࠒTrainLCDΞϓϦͷϢʔβʔ΋૿͖͑ͯͯɺͲ͏ͤൈຊతʹॻ͖׵͑ΔͳΒ 
 NestJSʹ᩾ር͢ΔΑΓ΋͏ͪΐͬͱݎ࿚Ͱߴ଎ͳ"1*Λ࡞Γ͔ͨͬͨͷͰ͢ɻ
22.  ͜͜ͰRustʹനӋͷ໼ཱ͕ͭ 
 աڈʹͪΐͬͱ͚ͩRustͷษڧΛ͍ͯͯ͠ɺݴޠͷઃܭ͕RustͷॳֶϓϩάϥϚʹݫ͍͕͠ɺ 
 ҆৺ͯ͠ಈ͔ͤΔ্ʹNode.jsΑΓߴ଎ɾ௿ϝϞϦϑοτϓϦϯτͳAPIΛ࡞ΕΔͷͰɺ 
 ࠓճͷϑϧεΫϥον͸RustͰߦ͏લఏͱͳΓ·ͨ͠ɻ
     Ͳ͏ͤͳΒgRPC΋ࢼͯ͠ΈΑ͏ 
 gRPCࣗମ͸ҎલΑΓ஌͍ͬͯͯ࠾༻͢Δ͔ܰ͘໎͍·͕ͨ͠ɺैདྷͷGraphQL APIͷ՝୊ͱͯ͠ 
 ʮΞϓϦͷૢ࡞ճͰඞཁͳσʔλ͕ଟͯ͘ΫΤϦ͕ංେԽɺϨεϙϯεσʔλ͕͑͛ͭͳ͍αΠζʹͳΔʯ 
 ͱ͍͏ͷ΋͋Γͦ΋ͦ΋ΞϓϦͷઃܭࣗମ͕ؒҧ͍ͬͯΔؾ΋͠ͳ͘͸ͳ͍Ͱ͕͢ɺ 
 εϚϗ޲͚ΞϓϦͰͷ௨৴༰ྔ͕ଟ͍ͷ͸େ͖ͳ՝୊Ͱͨ͠ɻ StationAPIϑϧεΫϥονͷϞνϕʔγϣϯ
    (2/3)
23.  gRPCͷϖΠϩʔυ͸όΠφϦ 
 όΠφϦͰ΍ΓऔΓ͢ΔͷͰɺઌ΄Ͳઆ໌ͨ͠ʮϨεϙϯεσʔλͷංେԽʯʹ͸ޮՌతͦ͏Ͱ͢ΑͶɻ 
 ChromeͷDevToolsͰ͸όΠφϦͷͨΊ֬ೝ͕͠ΜͲ͔ͬͨΓ͠·͢ɻ
     Protocol Bu ff ersͰλΠϓηʔϑ 
 ͪ͜Β͸REST APIͱͷൺֱͰ͕͢ɺ 
 gRPC APIͱ௨৴͢Δ࣌ʹඞͣProtocol Bu ff ersͷεΩʔϚఆٛΛ࢖༻͢ΔͷͰ 
 ௨৴͢Δલ͔ΒϦΫΤετͱϨεϙϯεͷܕ͕Θ͔Βͳ͍ɺͱ͍͏͜ͱ͸ͳ͘ͳΔ͸ͣͰ͢ɻ 
 ཁ͢ΔʹREST APIͰ͍͏Swagger͕࠷ॳ͔Β࢖͑Δͱ͍ͬͨΠϝʔδͰ͢ɻ StationAPIϑϧεΫϥονͷϞνϕʔγϣϯ
    (3/3)
24. Implement & Run By Example StationAPIͷ஌ݟΛݩʹ࣮૷ͯ͠࢖ͬͯΈΔ
25.  Protocol Bu ff ersͰεΩʔϚఆٛΛߦ͏
     RustͰ࣮૷
     GCPʹσϓϩΠ
     PostmanͰୟ͍ͯΈΔ
     ΞϓϦʹͭͳ͗͜Ή
    લճઆ໌ͨ͠Օॴͱ࿩͕௕͘ͳΔ෦෼͸ඈ͹͠·͢ ͬ͟ͱ΍ͬͨ͜ͱ
26.  Protocol Bu ff ersͰεΩʔϚఆٛΛߦ͏
     RustͰ࣮૷
     GCPʹσϓϩΠ
     PostmanͰୟ͍ͯΈΔ
     ΞϓϦʹͭͳ͗͜Ή
    લճઆ໌ͨ͠Օॴͱ࿩͕௕͘ͳΔ෦෼͸ඈ͹͠·͢ ͬ͟ͱ΍ͬͨ͜ͱ
27. RustΛ࢖ͬͨ։ൃͷ஌ݟ
    σʔλϕʔεฤ  ORM͸ԿΛ࢖ͬͨʁ 
 ਖ਼֬ʹ͸ORMͰ͸ͳ͍Ͱ͕͢ɺsqlxΛ࢖༻͠·ͨ͠ɻ 
 Ϣʔεέʔεతʹ͸SQL͚࣮ͩߦͰ͖Ε͹े෼ͰɺORMͩͱΦʔόʔεϖοΫɻ 
 query!ͷΑ͏ͳϚΫϩΛ࢖͏ͱίϯύΠϧ࣌ʹΫΤϦΛνΣοΫͰ͖·͢ɻ 
 ϚΫϩҎ֎͸ଞݴޠͷORMͱ͔ʹରͯ͠໌Β͔ʹҧ͏ͱ͜Ζ͸ͳ͍ͱࢥ͍·͢ɻ 
 ΄͔ʹ΋ɺRustʹ͸dieselͱ͍͏ORM͕͋Γ·͢ɻ 
 ͜Ε͕σϑΝΫτελϯμʔυʁ
28. RustΛ࢖ͬͨ։ൃͷ஌ݟ
    ύϑΥʔϚϯεฤ  ύϑΥʔϚϯεΛߴΊΔͨΊͷ޻෉͸ʁ 
 ͍͢͝ॳาతͰ͕͢ɺͳΔ΂͘஋ͷΫϩʔϯΛߦΘͳ͍ͱ͔ɺ 
 mokaͱ͍͏crateͰӬଓԽͳ͠ͷ 
 ΠϯϝϞϦΩϟογϡΛ࣮૷͍ͯͨ͠Γ͠·͢ɻ 
 ༨ஊͰ͕͢ɺmokaͰ͸஋ͷऔಘ࣌ʹclone()͕࣮ߦ͞ΕΔͷͰ 
 NPLBͰσʔλΛૠೖ͢Δ࣌Arc(ΞτϛοΫࢀরΧ΢ϯτ)Ͱ 
 ϥοϓ͠ͳ͍ͱߴՁͳdeep copy͕ൃੜ͢ΔՄೳੑ͕͋Γ·͢ 
 େ͖ͳσʔλΛૠೖɾऔಘ͢Δ৔߹͸େมͳ͜ͱʹͳΓ·͢ɻ 
 ૠೖ͢Δࡍ͸ඞͣArcͰϥοϓ͠·͠ΐ͏ɻ
29. gRPC APIΛσϓϩΠ  ελοΫʹ͍ͭͯ 
 StationAPI͸GCPʹશ෦৐͔ͬͬͯ·͢ɻ࢖͍ͬͯΔαʔϏε͸ 
 
 - Cloud Build
 - Cloud Run
 - Cloud SQL
 - Text-to-Speech AI(5SBJO-$%ΞϓϦͷҡ࣋අͷ಺Ͱ͸Ұ൪ߴֹ) 
 
    Firebase
 - Firestore/Storage/Messaging/Authentication/Functions/Remote Con fi g 

    
    
    Կʹ࢖͍ͬͯΔ͔͸͜ͷεϥΠυͷൣғ֎ͳͷͰݸผͰฉ͍͍ͯͩ͘͞ 
 
 ईͷؔ܎Ͱ΄ͱΜͲ঺հͰ͖ͳ͍Ͱ͢🥺
30. Cloud Buildͷ࢖͍ಓ  ͦ΋ͦ΋Cloud Buildͱ͸ʁ 
 ໊લͷ௨ΓCI/CDͷCDΛ୲͏αʔϏεɻ 
 GitHub΁ͷPush౳(PubSubϝοηʔδɺWebhookΠϕϯτ΋Մೳ)Λ 
 τϦΨʔʹͯ͠ࢦఆͨ͠ίϚϯυΛ૸Βͤͯ͘Ε·͢ɻ 
 Docker fi le͔Βͦͷ··σϓϩΠ΋ՄೳͰɺ 
 ΄͔ʹ͸ઐ༻ͷߏ੒ϑΝΠϧ(cloudbuild.yaml)΍ 
 ΠϯϥΠϯͰͷߏ੒͕ՄೳͰ͢ɻ
31. Cloud Buildͷ஌ݟ
    RustͷϏϧυ͸஗͍  RustͷϏϧυ͸஗͍ 
 جຊతʹRustͷϏϧυ͸஗͍Ͱ͢ɻ 
 ͜Ε͸ओ؍Ͱ͸ͳ͘ɺΉ͠ΖRustaceanͳΒ 
 ޱΛἧ͑ͯʮRustͷϏϧυ͸஗͍ʯͱݴ͏Ͱ͠ΐ͏ɻ 
 RustͷϏϧυ͕஗͍ࠜຊతͳݪҼ͸ஔ͍ͱ͍ͯɺ 
 Cloud BuildͷϏϧυ΋݁ߏ͕͔͔࣌ؒͬͯ͠·͍·͢ɻ
32. Cloud Buildͷ஌ݟ
    RustͷϏϧυΛߴ଎Խ͢Δ  KanikoΛ׆༻ͯ͠Ϗϧυ࣌ؒΛ࡟ݮ͢Δ 
 جຊతʹRustͷϏϧυ͸஗͍͜ͱΛઆ໌͠·ͨ͠ 
 ͦ͜ͰɺKanikoΛCloud Buildʹ࢖ͬͯΈ·͠ΐ͏ 
 Kaniko͸Docker DaemonΛ࢖Θͣʹ 
 k8sΫϥελ্ͰϏϧυΛߦ͏͜ͱ͕Ͱ͖·͢ 
 Cloud Buildͱ૊Έ߹ΘͤΔͱͳΜ΍͔Μ΍ͰΩϟογϡ͞Εͯ 
 2ճ໨͔ΒϏϧυ͕ര଎ʹͳΓ·͢ 
 StationAPIͰ͸Ϗϧυ͕࣌ؒ20෼͔Β10෼ͱ൒෼ʹͳΓ·ͨ͠
33. Cloud Runͷ࢖͍ಓ  ͦ΋ͦ΋Cloud Runͱ͸ʁ 
 ϑϧϚωʔδυͷαʔόʔϨεϓϥοτϑΥʔϜ 
 ϏϧυࡁΈͷDockerίϯςφΛσϓϩΠग़དྷΔ 
 ·ͨઃఆΛ׶͑ͯม͑ͳ͚Ε͹ 
 ίʔυ͕࣮ߦ͞Ε͍ͯΔͱ͖ͷྉ͕ۚൃੜ͢Δ 
 
 ࣗಈεέʔϧ͸ߴ଎ͰτϥϑΟοΫʹ߹Θͤͯ 
 θϩ͔Β೚ҙͷن໛ͰࣗಈతʹεέʔϦϯάՄೳ 
 ߋʹΠϯελϯε͋ͨΓ࠷େ ݅ͷಉ࣌ϦΫΤετΛ 
 ॲཧͰ͖ΔͨΊͱͯ΋༨༟͕͋Γ·͢ 
 
 ϑϧϚωʔδυͷͨΊΠϯϑϥͷ؅ཧ͸ෆཁͰɺ 
 σϓϩΠͨ͠ޙ͸Cloud Runʹؙ౤͛Ͱ͖·͢
34. ·ͱΊ  Rust͸͍͍ͧ 
 Rust͸҆શͰߴ଎ͳγεςϜϓϩάϥϛϯάݴޠͰ͢ 
 ࠷ॳͷֶशίετ͸ߴ͍Ͱ͕͢ɺҰ౓Ͱ΋৮ͬͯΈΔՁ஋͸ 
 զʑWebۀքͷਓؒͩͱͯ͠΋͋Γ·͢
     GCP΋͍͍ͧ 
 AWSΑΓγϯϓϧͳ؅ཧUIΛ͍ͯͯ͠ຊ࣭తʹඞཁͳ࡞ۀʹ஫ྗͰ͖·͢ɻ 
 AWSͱ؅ཧUI͚ͩͰ༏ྼΛ͚ͭΔ͜ͱ͸Ͱ͖ͳ͍ͱࢥ͍·͕͢ɺ 
 ݸਓతʹ͸GCPਪ͠Ͱ͢
     TrainLCDΞϓϦΛ͝᩾ርʹ 
 ൱ఆతͳઌೖ؍Λ͍࣋ͬͯͨਓͰ΋ɺ࢖ͬͯΈΕ͹ 
 ʮੜ׆ʹ͔ܽͤͳ͍ʯ໘ന͍ΞϓϦͱධՁͯ͠΋Β͍͑ͯ·͢
35. ͝ਗ਼ௌ͋Γ͕ͱ͏͍͟͝·ͨ͠ʂ
    Thank you for listening! Gunma.web #50 ςʔϚϑϦʔ 2023.09.10 @ Takasaki Met., Empire of Gunma Tsubasa SEKIGUCHI