Share
Embed
JIT ロードマップ / Ruby 3 さみっと
Takashi Kokubun
April 16, 2020
Transcript
55 slides
-
Ruby 3 ͞Έͬͱ / k0kubun JIT ϩʔυϚοϓ Caveat: The slides
and the talk are in Japanese. I'll publish its English version with updates when Ruby 3 is released. -
୭ • GitHub, Twitter: k0kubun • RubyͷJITͷ։ൃΛ3͘Β͍͍ͬͯΔ • 2017/4 ~
7: LLVMͰRubyͷJIT (LLRB) Λ։ൃ • 2017/9 ~ 10: RTL / MJIT [Feature #12589] ͷJITϑϨʔϜϫʔΫͱLLRBͷ YARV JITίϯύΠϥΛϚʔδͨ͠YARV-MJITΛ։ൃ [Feature #14235] • 2018/2: YARV-MJITΛCRubyຊମͷJITͱͯ͠Ϛʔδ • 2018 ~ 2020: CRubyͷJITͷੑೳվળ -
ࠓ͢͜ͱ • Ruby 3ʹ͓͚ΔJITͷΰʔϧ • ੑೳܭଌํ๏ͷྨ • ϕϯνϚʔΫඪ • ඪୡͷͨΊͷઓུ
• جຊํ • ϩʔυϚοϓ • ਐḿใࠂ • ࠷ۙͷ׆ಈ • ϩʔυϚοϓͷঢ়گ -
Ruby 3ʹ͓͚ΔJITͷΰʔϧ • Ruby 3x3: Ruby 3 Ruby 2.0
ͷ3ഒߴԽ • ͲͷΑ͏ͳܭଌํ๏ͱϕϯνͰඪΛઃఆ͢Δ͔? -
ੑೳܭଌํ๏ͷྨ • Level 1: ίϯύΠϧޙܭଌ / JITϫʔΧʔఀࢭ / Ұ෦ͷΈίϯύΠϧର •
ܭଌର: Ұ෦ͷϝιουͷJITʹΑΔੑೳมԽ • Level 2: ίϯύΠϧޙܭଌ / JITϫʔΧʔఀࢭ • ܭଌର: ~100 ϝιουͷJITʹΑΔੑೳมԽ • Level 3: ίϯύΠϧޙܭଌ / JITϫʔΧʔ༗ޮ • ܭଌର: ~100 ϝιουͷJITʹΑΔੑೳมԽ, ίϯύΠϧର͕҆ఆ͠ͳ͍߹ͷෛՙ • Level 4: ίϯύΠϧதܭଌ / JITϫʔΧʔ༗ޮ • ܭଌର: ϕϯνϚʔΫதʹJITͰౕ͖ͨͷੑೳมԽ, CίϯύΠϥ͕Δෛՙ, JITίϯύΠϧதͷGCϩοΫ • Level 5: ίϯύΠϧதܭଌ / JITϫʔΧʔ༗ޮ (ϚϧνεϨου / Ϛϧνϓϩηε) • ܭଌର: ϕϯνϚʔΫதʹJITͰౕ͖ͨͷੑೳมԽ, CίϯύΠϥ͕Δෛՙ, JITίϯύΠϧதͷGCϩοΫ, εϨουϓϩηε -
ੑೳܭଌํ๏ͷྨ • Level 1: ίϯύΠϧޙܭଌ / JITϫʔΧʔఀࢭ / Ұ෦ͷΈίϯύΠϧର •
͜ΕશʹΠϯνΩͰɺௐࠪઐ༻ɻͰҰ൪؆୯ͳ͜Ε͕͘Ͱ͖ͳ͍ͳΒઈର͘ͳΒͳ͍ • Level 2: ίϯύΠϧޙܭଌ / JITϫʔΧʔఀࢭ • ੜίʔυͷ७ਮͳੑೳ͕ݟΕΔɻJITϫʔΧʔʹΑΔϊΠζΛഉআͯ͠VMͱJITੜίʔυͷੑೳࠩΛ७ਮʹൺֱ͢ΔͨΊʹ͏ • Level 3: ίϯύΠϧޙܭଌ / JITϫʔΧʔ༗ޮ • ظ࣮ߦ࣌ͷݱ࣮తͳੑೳௐࠪʹ͏ɻHotͳάϧʔϓ͕҆ఆ͢Δ߹ɺཧ্Level 2ͱಉ݁͡ՌʹͳΔ • Level 4: ίϯύΠϧதܭଌ / JITϫʔΧʔ༗ޮ • ىಈ࣌ͷؚ͞Ίͨݱ࣮తͳੑೳௐࠪʹ͏ɻ • Level 5: ίϯύΠϧதܭଌ / JITϫʔΧʔ༗ޮ (ϚϧνεϨου / Ϛϧνϓϩηε) • αʔόʔ༻్Ͱͷݱ࣮తͳੑೳௐࠪʹΘΕ͍ͯΔɻͪΖΜ࠷ޙ͜Ε͕ܭଌ͞ΕΔ͖͕ͩɺJITͷੑೳݕূʹશવؔͳ ͍ϊΠζ͕ଟΊɻ -
RubyॲཧܥͷϚΫϩͳϕϯνϚʔΫ • mame/optcarrot - RubyͷϕϯνϚʔΫ༻ʹ࡞ΒΕͨNESΤϛϡϨʔλ • benchmark-driver/sinatra - SinatraͰݻఆͷจࣈྻϨεϙϯεΛฦ͢ •
k0kubun/railsbench - Railsͷ #show ΞΫγϣϯͷscaffold࣮ • noahgibbs/rsb - DiscourseΑΓγϯϓϧͱ͞Ε͍ͯΔRailsͷϕϯν • discourse/discourse - ϕϯνΛ࣋ͭ ϦΞϧϫʔϧυRailsΞϓϦέʔγϣϯ -
RubyॲཧܥͷϚΫϩͳϕϯνϚʔΫ • ଟ͘ͷϕϯνͰݱࡏվળରʹ͍ͯ͠Δείʔϓ: Level 1~2 • RailsSinatraͷϕϯνͰLevel 1Ͱݱঢ়͋·Γ͕ࠩग़͍ͤͯͳ͍ • ੜίʔυͷੑೳͱແؔʹɺJITίϯύΠϧࡁΈϝιου͕૿͑Δ΄ͲͲ͏ͯ͠
͘ͳΔ(ޙड़)͕͋ΓɺLevel 2Ҏ্શͯͦΕͷ͍ͤͰ͍ (Α͏ʹݟ͑Δ) • OptcarrotϕϯνͰͷܭଌํ๏: Level 4 • ϑΣΞʹଞ࣮ͱൺֱΛߦͳ͏ʹݩͷϨΪϡϨʔγϣϯʹԊ͏Ҏ֎ͳ͍ͷͰ͜͏ͳΔ • Level 4ͰेվળͰ͖͍ͯΔ͕ɺܧଓతͳੑೳվળͷνΣοΫʹຊLevel 2~3 ΛݟΔ͖ -
ϕϯνϚʔΫඪ Railsbench (Level 2 or 3) 5~10%+ Optcarrot 3.0x RSB
or Discourse 5~10%+ Sinatra (Level 2 or 3) 5~10%+ Optcarrot 2.5x -
ϕϯνϚʔΫඪ Railsbench (Level 2 or 3) 5~10%+ Optcarrot 3.0x RSB
or Discourse 5~10%+ Sinatra (Level 2 or 3) 5~10%+ Optcarrot 2.5x ✅ -
1: JITੜίʔυݺͼग़͠ͷεέʔϥϏϦςΟ • nilΛฦ͚ͩ͢ͷϝιουΛ100ݸ࡞ͬͯॱ൪ʹݺͼग़͍ͯ͘͠ͱɺ1ݸΛಉ͡ճݺͿͷʹൺͯJITࡁΈͷ߹ͱͯ͘ͳΔ • nilΛฦ࣮͢ͱ͔͘͠Α͏͕ͳ͍ • ΞηϯϒϥΛோΊɺRuby 3 Ͱ༨ܭͳ໋ྩΛશͯͬͨ
(ޙड़) ͕ɺผʹ͜ΕΒͳ͍ • ϩʔυํ๏ʹΑΔΠϯύΫτ͕͋ͬͨɺ͜ΕՄೳͳݶΓվળͨ͠ • શ෦ίϯύΠϧ͠ऴΘͬͨΒશϝιουΛҰͭͷsoϑΝΠϧʹ·ͱΊͯશϦϩʔυ͍ͯ͠Δ • shinh͞Μ͕ॻ͍ͨobjϑΝΠϧϩʔμͱ΄΅ಉ͡ੑೳ͕ग़͍ͯΔͷͰɺଟ͜͜Ͱͳ͍ • ͰԿ͕͍ͷ͔? • ͓ͦΒ͘: όΠτίʔυΛ๊͑ΔߏମΛಡΉͷ͕ແବʹ2Օॴ͋Δ + ੜίʔυͦͷͷͷϩʔυ͕Ωϟογϡ͔ΒᷓΕΔ • ͨͩ͠໌֬ͳࠜڌ͕ݟ͚ͭΒΕ͓ͯΒͣɺͲ͜ΛͲ͏͖͔͢ͷ֬ূ͕ಘΒΕ͍ͯͳ͍ (ຊʹ͜Ε͕ϘτϧωοΫͳͷ ͔͢Β໌֬Ͱͳ͍) -
1ͷΞϓϩʔν • ·ͣ͜Ε͕Ͳͷఔʹͳ͍ͬͯΔ͔Λ໌֬ʹѲ͢Δ: • શମͰͷӨڹ֬ೝʹޙड़ͷperf-profileΛࢼ͢ • खݩͷϚγϯͰϝϞϦCPUͷΩϟογϡͷΞΫηεʹԿns͔͔Δ͔֬ೝ͠ɺͦΕ͕ͲͷՕॴͰԿճى͖͍ͯΔ͔Λperfͷevent ͰݟͯΈΔ • όΠτίʔυΛ๊͑ΔߏମΛಡΉͷ͕ແବʹ2Օॴ͋Δ:
• ଟͲ͏ʹ͔Ͱ͖Δ (͕ɺຊʹ͜Ε͕ϘτϧωοΫʹͳΔ͔?) • Ruby 2.7ͷ࣌ʹॻ͍ͨύον͋Δ͕ɺͦΕVMͷํʹΠϯύΫτ͕͋Δͷ͕ཁमਖ਼ • ੜίʔυͦͷͷͷϩʔυ͕Ωϟογϡ͔ΒᷓΕΔ: • ؔϙΠϯλΛܦ༝ͨ͠ݺͼग़͠ͷΛ2͔ͭΒ1ͭʹ·ͱΊΔ͜ͱՄೳ • Ruby 2.7ͷ࣌ͦΕΛ࣮ݧ͕ͨ͠ɺSinatra / RailsͷϕϯνʹޮՌ͕ͳ͘ɺղܾํ๏ͷਖ਼͠͞ʹ֬ূ͕ͳ͍ (ͳͷͰͷৄࡉௐࠪʹ ϒϩοΫ͞ΕΔ) • ؔઅݺͼग़͠Λ1͔Β0·ͰݮΒ͢ʹɺΠϯϥΠϯԽ͕͑Δ͔ -
2: ΠϯϥΠϯԽՄೳͳൣғ͕ݶΒΕ͍ͯΔ • Rubyͷϝιουݺͼग़͠ͷΠϯϥΠϯԽRuby 2.7Ͱೖͬͨ • ͨͩ͠ΠϯϥΠϯԽ͢ΔͱOptcarrotͷfps͕མͪΔʹ͋Γ(ίϯύΠϧ࣌ؒͷӨڹ͔ɺίʔυαΠζ ͷ͔)ɺ΄ͱΜͲΘΕͳ͍ঢ়ଶʹͯ͋͠Δ • ͦΕ͔ΒɺϑϨʔϜͷpush/popΔΠϯϥΠϯԽ͕Ͱ͖Δ݅·͔ͩͳΓݶΓ͕͋Δ
(ϩʔΧϧมʹ ·ͩରԠͯ͠ͳ͍ɺͳͲ) • ࠶ؼ͢Δ߹ʹࣗͷωΠςΟϒؔΛݺͼग़ౕ͢લೖΕ͍͕ͯͨɺόάͬͯrevert • Rubyͷϝιουͷsuperyield·ͨผͷέΞ͕ඞཁ • CͷϝιουͷΠϯϥΠϯԽ·ͩೖ͍ͬͯͳ͍ • ͜Εͷ४උʹඞཁͳΈΛ͍ΕΔͱOptcarrotͷfps͕མͪΔ͕͋ͬͨ • attr_readerͷΠϯϥΠϯԽΛ͔ͳΓલʹೖΕ͍͕ͯͨɺόάͬͯrevert -
2ͷΞϓϩʔν • ࣮ຊ࣭తʹ͘͠ͳ͍ • όάͰSEGVΛ1ͭੜΉ͝ͱʹҰ൩͔Βফ໓͢Δͱ͍͏͋Δ • ΠϯϥΠϯԽ͢Δʹ࣮͠͠Λॏෳͤ͞Δඞཁ͕͋Δ͕: • ՄೳͳݶΓVMͱ࣮Λڞ༗Ͱ͖ΔΑ͏ؔʹڞ௨෦ΛΓग़͢ •
ͦͦΠϯϥΠϯԽ͠ͳ͍ͱ͍͚ͳ͍είʔϓΛ࠷ॳ͔ΒॖΊͯ͠·͏ͨΊʹɺ"fastpath" ͱ͍͏ ػߏΛ͏ • fastpath: ϝιουσΟεύονؔϙΠϯλΛܦ༝ͯ͠ߦͳΘΕΔ͕ɺ࠷దԽՄೳͳ࣌ʹؔϙ Πϯλͱͯ͠ηοτ͞ΕΔΑΓγϯϓϧͳύε͕fastpath • JITͰͷΈ࣮είʔϓΛڱΊΔͱಉ͡ڍಈ͕ςετ͞ΕΔػձ͕গͳ͘όάΓ͘͢ͳΔ͠ɺ͍ͭ ͷ·ʹ͔VMͱ࣮͕ဃ͍͢͠ -
ޮՌ͕ߴ͍ͱࢥΘΕΔ࠷దԽ • ࣮ߦ࣌ใΛͬͨΠϯϥΠϯԽͱɺ࣮ͷ୯७ԽΛ܁Γฦ͢ • Constant folding • Dead code elimination
• Loop-invariant code motion • ϝϞϦΞΫηεͷ࠷దԽ • ώʔϓ > ελοΫ > Ϩδελ > ଈ -
RubyͷJITͷΈͰͦΕΒΛ࣮Ͱ͖Δ͔? • ίϯύΠϥج൫ (LLVMͳͲ) Λ͏͖͔? • ʮ࣮ߦ࣌ใΛͬͨΠϯϥΠϯԽʯRuby VMಛ༗ͷͰ͋ΓɺίϯύΠϥج൫Λ͏Ըܙগͳ͍ • ΠϯϥΠϯԽʹݶΒͣɺݱঢ়͜ͷੈքͰղܾ͠ͳ͍ͱ͍͚ͳ͍͕େଟ
• ΠϯϥΠϯԽͨ͠ޙͷ࠷దԽCίϯύΠϥͰ (ΠϯϥΠϯԽରίʔυʹΛՃ͑Δ͜ͱͰ͋Δఔ) Մೳͩ͠ɺྫ͑LLVM PassύΠϓϥΠϯΛಠࣗʹ͍͔ͬͨ͡Βͱ͍ͬͯClangΑΓՌΛग़͢ͷͦ͠͏ • ༨ܭͳPassΛͬͯίϯύΠϧ࣌ؒΛ͘͢Δͱ͔Ͱ͖Δ͔͠Εͳ͍͚Ͳɺظ࣮ߦϓϩάϥϜͰॏ ཁ͕͍ • CͰɺ͘͝ݶΒΕͨॏཁͳͱ͜ΖͰΠϯϥΠϯΞηϯϒϥΛ͏ͱ͍͏બࢶ͋Δ (Ҡ২ίετʹҙ) -
ϩʔυϚοϓ: ݺͼग़͠ੑೳ perf-profile ISeq/ؔΛಡΉʹ ؔ͢ΔΠϕϯτͷௐࠪ objͷ ϩʔυ࣮ݧ ඞͣ௨Δcall site ͳΔ͘ΠϯϥΠϯԽ
so·ͱΊͯ Ϧϩʔυ perf-profile inline ूܭ ݺͼग़͕͘͠ ͳΔཧ༝ͷཧղ VM -> JIT callͰͷ Frame omission JITઐ༻fastpath JITઐ༻send໋ྩ -
ϩʔυϚοϓ: ΠϯϥΠϯԽ JIT: invokesuper Inline fastpath builtin method invokesuper inline
cache JIT: Reconsider Inlining decision C method better fastpath JIT: C method Inline fastpath JIT: Inline getconstant JIT: C method Inline code JIT: Ruby method Frame omission JIT: C method Inline invoker JIT: C method Frame omission JIT: Inline attr_reader JIT: Inline attr_writer Better long-jump detection JIT: Pass args w/o VM stack JIT: ex-ivar inline invokesuper fastpath JIT: Ruby method Inline fastpath JIT: Unwrap vm_exec JIT: Ruby method Inline code JIT: ivar inline ex-ivar fastpath JIT: Support locals w/ frame omission leafify insns builtin attribute JIT: Inline from C method -
ϩʔυϚοϓ: ίʔυ࠷దԽ JIT: (very limited) Stack allocation JIT: Ruby locals
-> C local var JIT: Reduce sp/pc access JIT: No-branch deoptimization JIT: Specialize opt_ for a type (very limited) Escase analysis JIT: Profile type in opt_ insns JIT -> VM On-Stack Replacement leafify insns Deoptimize on binding -
ϩʔυϚοϓ: ࠷దԽ • Inline invokesuper (patch) • header asetͷɺsinatraͷϓϩϑΝΠϦϯάग़͢ •
Inline Cʹ݁ہϒϩοΫ͞ΕΔ • Inline C method (committed) • downcaseͱ͔ͷɺ͋ͱsettingsͷself.class (sinatraͷϓϩϑΝΠϦϯά·ͨग़͢) • invoker inlining • C definition inlining (ͱΓ͋͑ͣ .c Λ vm.c ʹ͚ͬͭͪ͘Ό͏) • builtin attribute? (ϩʔυϚοϓʹ͍ΕΔ) => ΑΓଟ͘ΠϯϥΠϯԽରԠ • ࣮ݧͷޙɺ࣮Λݕ౼͍ͯ͠Δ࠷దԽ: • getconstant • attr reader inline • stack allocation • RubyϩʔΧϧมͷCϩʔΧϧมམͱ͠ • On-Stack replacement • Δͧͱ͍͏ؾ͕࣋ͪ͋Δ (ͱΓ͋͑ͣopt plus͋ͬͨΒinvalidateɺͱ͔) • ΠϯϥΠϯԽߦ͔Βnative pcͷਪఆͱVM pcͷ෮ݩ…·͋ઌͷͰ͍͍ͷͰ • શ෦࣮ݧʹΑΔΠϯύΫτௐࠪ࣍ୈͰprioritize • JITࡁΈίʔυ͕ଟ͘ͳΔͱ͍ͷௐࠪ -
ϩʔυϚοϓ: ࠷దԽ • leafԽ • inlineԽ४උ → ΠϯϥΠϯԽ (C, super,
attr reader) → getconstantΠϯϥΠϯԽ -> ؆қΤεέʔϓ ղੳ → ؆қstack allocation • inlining over loop • ࠷ޙ: GCC࠷దԽϑϨϯυϦͳؔʹมߋ => ͦͷઌ: LLVM͔ɺಠࣗIRίϯύΠϥ on Ractor • ผҹ͕ͩӈଆʹدͤͯ: on stack replacement • ಠཱ - ϝϞϦΞΫηε: single so ϩʔμ / JIT compaction → ͍ཧ༝ͷཧղͱରԠ → σΟεύον ߴԽ • Ruby 2.7ͰσΟεύονΛ༏ઌ͕ͯͨ͠ɺ͜ͷઢఘΊͯͨ => Ͱղ͚ΕϒϨʔΫεϧʔ -
ݱࡏͷঢ়گ: master 356e203a3a rb_funcall -> cd 88135845f1 (debug assertion) 9d3ffcfbfc
(revert assertion) 7814b6c657 kwarg checks 46acd0075d builtin fb6a489af2 revert .: b9007b6c54 disposable cc 9511b4c8fa optimize cc ref 9e6e39c351 split ruby.h -
SEGVमਖ਼2: ੜίʔυGC࣌ͷRoot FiberͷελοΫͷϚʔΫ࿙Ε • Fiber͔ΒσϑΥϧτεϨουʹΔͨΊʹσϑΥϧτͷεϨουFiber૬ ͷߏΛ͍࣋ͬͯΔ͕ɺ͔ͦ͜ΒผͷFiberʹελοΫ͕ΓସΘ͍ͬͯΔ ࣌ɺݱࡏ༗ޮͰͳ͍σϑΥϧτεϨουͷελοΫͰΘΕ͍ͯΔίʔυͷ ϚʔΫ͕࿙Ε͍ͯͨ • 2020/2/28:
https://github.com/ruby/ruby/commit/ adcf0316d1ecedae2a9157ad941550e0c0fb510b -
Disposable call-cache ͷมߋΛड͚ͨJITଆͷରԠ • Ractor (چGuild) ͚ʹϝιουΩϟογϡ͕immutableԽ [Feature #16614] ͞Εͨ
࣌ɺJITͷੜίʔυͰͷcacheͷࢀরʹؒࢀর͕ೖͬͨ • 2020/3/10: GC.compactରԠͷͨΊͷذΛɺJIT͕ݟ͍ͯΔcall-cache͕move͠ͳ ͍Α͏ʹͯ͠ରԠ https://github.com/ruby/ruby/commit/ 9511b4c8facf583073ed8ecfd3d84710565572a6 • GC࣌ʹJITͷੜίʔυ͕ࢀর͢Δcall-cacheΛదʹϚʔΫ͢Δඞཁ͕͋ͬͨ • 2020/3/10: ݩͷ࣮ͷΈతͳόάͷमਖ਼ͱɺϝϞϦʔϦʔΫରԠ https:// github.com/ruby/ruby/commit/4bcd5981e80d3e1852c8723741a0069779464128 (ͳ͓͜ͷύονreallocͷ͍ํ͕ؒҧ͍ͬͯΔ͕ɺOpenBSDͷ͓͔͛Ͱؾ͍ͨ) -
super ͷ inline cache / fastpath • ݱࡏͷJITͷΠϯϥΠϯԽVMͷinline cacheͰinvalidateΛߦͳ͏ͷͰɺsuper͕VMͷinline cacheʹରԠͯ͠ͳ͍ͱJITͷΠϯ
ϥΠϯԽ͕Ͱ͖ͳ͍ • 2019/4/3: ॳରԠ (fastpath༗ޮԽ) https://github.com/ruby/ruby/commit/d147ad6231aebb1d478162fb8e109e0c6a696169 • VMͰςετ௨͚ͬͯͨͲ (ຊ4ͭόά͕͋Δ)ɺJIT͕SEGV͢ΔͷͰҰ୴Ϧόʔτ • 2020/2/12: ௐ͕ࠪߤͨ͠··์ஔ͍ͯͨ͠Βɺಉ͡มߋ͕ೖ͍ͬͯͨ https://github.com/ruby/ruby/pull/2869 • 2020/2/12: 4ͭͷόάͷ͏ͪ1ͭΛͩ͞͞͞Μ͕मਖ਼ • 2020/2/21: Disposable call-cache ͕ೖͬͨɻsuperͷinline cache͕ͬͨfastpath͕͏͔ͬΓফ͑ͨ • fastpathʹΑΔ3ͭͷόάͱɺڪΒͦ͘Ε͕ݪҼͱࢥΘΕΔJITͷSEGVফ͑ͨ • 2020/4/11: fastpathΛ࠶ಋೖɻrefinements͚ͷόάରԠ͍ͯͨ͠ͷͰɺ3ͭͷ͏ͪ2ͭόά͕෮׆ • 2020/4/14: RailsͷCI͕མͪͨͱ͍͏yahonda͞ΜͷใࠂͰattr_writerͷsuper࣌ͷόάʹؾ͖ɺattr_readerͷํमਖ਼ͨ͠ • Ruby 3Ͱ (VMͰ) super͕͘ͳ͍ͬͯΔͣ! -
CͷϝιουͷΑΓਂ͍fastpath • ͋Δߦʹsplat argskeyword args͕ͳ͍͜ͱίϯύΠϧ࣌ʹΘ͔Δ͕ɺ͜Ε·ͰͷfastpathͰ ݺͼग़࣌͠ʹຖճνΣοΫ͞Ε͍ͯͨ • Ruby 2.7ͷ࣌ʹΩʔϫʔυҾͷͨΊʹগ͘͠ͳͬͨͱฉ͍͕ͨɺ͜͜ͷذ͕૿͑Δ ͱΩʔϫʔυҾͷ͋Γͳ͠ʹؔΘΒͣશCϝιουݺͼग़͠ʹӨڹ͕͋ΔͷͰɺؔ͜͜
͍͔ͯͨ͠ • 2020/4/13: CͷϝιουͷΠϯϥΠϯԽʹ͚ɺJITͰfastpathͷΠϯϥΠϯԽΛ։࢝ • 2020/4/13: JITͷΠϯϥΠϯԽίʔυʹ͜ΕΛؚΊͨ͘ͳ͔ͬͨͷͰɺ͜ͷνΣοΫΛεΩοϓ͢ ΔfastpathΛ༻ҙͯ͠ɺͦΕΛΠϯϥΠϯԽ͢ΔΑ͏ʹͨ͠ • CͰఆٛ͞Ε͍ͯͨΩʔϫʔυҾ͖ͭϝιουɺ࠷ۙbuiltinͱ͍͏ΈΛͬͯRubyͰ࠶ ఆٛ͞ΕΔʹ͋ΔͷͰɺ͜ͷfastpathΛ௨Βͳ͍ϝιουݮ͍ͬͯͦ͏ -
DeoptimizationΛͬͨJITͷleafԽ • VM໋ྩʹleaf (ҙͷϝιουΛݺͳ͍) ͳͷͱͦ͏Ͱͳ͍ͷ͕͋Γɺओʹ returnʹ૬͢Δleave໋ྩׂΓࠐΈ͕ೖΔͱҙϝιουΛݺͿͨΊleafͰͳ͍ • leafͷ͔࣌͠VMͷpcspͷҠಈΛεΩοϓͰ͖ͳ͍ͷͰɺ୯ʹ return nil
͢Δ͚ͩ ͷϝιουͰ (΄ͱΜͲͷ߹) ༨ܭͳϝϞϦΞΫηε͕͋ͬͨ • 2020/3/31: ׂΓࠐΈ͕͋Δ࣌VM࣮ߦʹϑΥʔϧόοΫ (Deoptimization) ͢Δ͜ ͱͰleafͱݟͳ͠ɺleave໋ྩʹ͓͚ΔpcͱspͷҠಈΛΊͨ • ͜ΕʹΑΓ return nil ͢Δ͚ͩͷϝιουͷωΠςΟϒίʔυɺׂΓࠐΈͷ νΣοΫͱnilΛฦ͢Ҏ֎ͷ༨ܭͳ໋ྩ͕શ͘ͳ͘ͳͬͨ -
Ex-ivar ͷ inline cache ରԠ • ;ͭ͏ͷΫϥεΫϥεͷߏମͷதʹΠϯελϯεมͷຒΊࠐΈ͔ࢀরΛ͓࣋ͬͯΓɺΩϟογϡ͕ ώοτͨ͠߹ͷࢀর༻ίʔυͱcache invalidationͷίʔυ͚ͩJITͰੜ͠ɺinvalidate͞ΕͨΒΩϟ ϯηϧ͢ΔΑ͏ʹͳ͍ͬͯͨ
• ͱ͜Ζ͕ɺHashΈ͍ͨͳҰ෦ͷΫϥεͰɺΠϯελϯεมΘͳ͍Μ͡Όͳ͍͔ͱ͍͏Ծఆ͔Β͔Ϋ ϥεͷߏମʹͦΕ͕ͳ͘ɺάϩʔόϧͳϋογϡςʔϒϧ͔ΒΫϥε୯ҐͰࢀর͕อ࣋͞Ε͍ͯΔͨ ΊɺΠϯελϯεมͷࢀরํ๏͕ҟͳΔ (exivar) • RailsʹHashͷαϒΫϥε͕ແݶʹ͋Δ͠ɺͦ͜ͰΠϯελϯεม͍ͬͯΔ • ͜Ε·Ͱ௨ৗͷivarʹಛԽͨ͠ίʔυΛੜ͍ͯͨ͠ͷͰɺexivarͷࢀর͕ൃੜͨ࣌͠JITΛΩϟϯη ϧ͍ͯͨ͠ • ͱΓ͋͑ͣivar͚ʹίϯύΠϧ͠ɺΩϟϯηϧ͞ΕͨΒexivar͚ʹ࠶ίϯύΠϧ͢Δײ͡ʹͨ͠ (ͦΕ Ωϟϯηϧ͞ΕͨΒVMͱಉ࣮͡ʹͯ͠࠶ίϯύΠϧ) -
perf-profile • perf annotateCͷιʔεͷͲͷߦ͕͍͔ݟΑ͏ͱ͢Δͱɺasm͕ࠞͬͯ͟ෆ ศ • perf record --call-graph=dwarf ͔ΒಘΒΕΔtraceͱɺ࣮ࡍͷόΠφϦͷdwarf͔
ΒಘΒΕΔใΛaggregate͠ɺCͷιʔεϕʔεͰϓϩϑΝΠϧ݁ՌΛදࣔ͢Δ • ͦͦಉ༷ͷػೳ͕OProfileʹ͋Δͷ͕ͩɺRubyͷJIT͕ಈతʹCͷίʔυΛ ు͍ͯϏϧυͯ͠ϩʔυ͢ΔΈ͍ͨͳෆࢥٞͳ͜ͱΛ͍ͬͯΔ͔Β͔JITੜC ίʔυ͕͏·͘ಡΊͳ͔ͬͨͷͱɺperfͷํ͕৴༻ͯ͠Δ͍͠׳ΕͯΔͷͰ perfϕʔεͰΓ͔ͨͬͨ -
ϩʔυϚοϓ: ݺͼग़͠ੑೳ perf-profile ISeq/ؔΛಡΉʹ ؔ͢ΔΠϕϯτͷௐࠪ objͷ ϩʔυ࣮ݧ ඞͣ௨Δcall site ͳΔ͘ΠϯϥΠϯԽ
so·ͱΊͯ Ϧϩʔυ perf-profile inline ूܭ ݺͼग़͕͘͠ ͳΔཧ༝ͷཧղ VM -> JIT callͰͷ Frame omission JITઐ༻fastpath JITઐ༻send໋ྩ -
ϩʔυϚοϓ: ݺͼग़͠ੑೳ perf-profile ISeq/ؔΛಡΉʹ ؔ͢ΔΠϕϯτͷௐࠪ objͷ ϩʔυ࣮ݧ ඞͣ௨Δcall site ͳΔ͘ΠϯϥΠϯԽ
so·ͱΊͯ Ϧϩʔυ perf-profile inline ूܭ ݺͼग़͕͘͠ ͳΔཧ༝ͷཧղ VM -> JIT callͰͷ Frame omission JITઐ༻fastpath JITઐ༻send໋ྩ ✅ ✅ ✅ -
ϩʔυϚοϓ: ΠϯϥΠϯԽ JIT: invokesuper Inline fastpath builtin method invokesuper inline
cache JIT: Reconsider Inlining decision C method better fastpath JIT: C method Inline fastpath JIT: Inline getconstant JIT: C method Inline code JIT: Ruby method Frame omission JIT: C method Inline invoker JIT: C method Frame omission JIT: Inline attr_reader JIT: Inline attr_writer Better long-jump detection JIT: Pass args w/o VM stack JIT: ex-ivar inline invokesuper fastpath JIT: Ruby method Inline fastpath JIT: Unwrap vm_exec JIT: Ruby method Inline code JIT: ivar inline ex-ivar fastpath JIT: Support locals w/ frame omission leafify insns builtin attribute JIT: Inline from C method -
ϩʔυϚοϓ: ΠϯϥΠϯԽ JIT: invokesuper Inline fastpath builtin method invokesuper inline
cache JIT: Reconsider Inlining decision C method better fastpath JIT: C method Inline fastpath JIT: Inline getconstant JIT: C method Inline code JIT: Ruby method Frame omission JIT: C method Inline invoker JIT: C method Frame omission JIT: Inline attr_reader JIT: Inline attr_writer Better long-jump detection JIT: Pass args w/o VM stack JIT: ex-ivar inline invokesuper fastpath JIT: Ruby method Inline fastpath JIT: Unwrap vm_exec JIT: Ruby method Inline code JIT: ivar inline ex-ivar fastpath JIT: Support locals w/ frame omission leafify insns builtin attribute JIT: Inline from C method ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ⚠ ✅ ✅ ✅ ⚠ -
ϩʔυϚοϓ: ίʔυ࠷దԽ JIT: (very limited) Stack allocation JIT: Ruby locals
-> C local var JIT: Reduce sp/pc access JIT: No-branch deoptimization JIT: Specialize opt_ for a type (very limited) Escase analysis JIT: Profile type in opt_ insns JIT -> VM On-Stack Replacement leafify insns Deoptimize on binding -
ϩʔυϚοϓ: ίʔυ࠷దԽ JIT: (very limited) Stack allocation JIT: Ruby locals
-> C local var JIT: Reduce sp/pc access JIT: No-branch deoptimization JIT: Specialize opt_ for a type (very limited) Escase analysis JIT: Profile type in opt_ insns JIT -> VM On-Stack Replacement leafify insns Deoptimize on binding ✅ ✅ -
·ͱΊ • ओʹίϯύΠϧྃޙͷ Sinatra / Rails ͷੑೳվળʹࠓूத͍ͯ͠Δ • ͘ͳΔͷௐࠪ͑͞͏·͍͚͘ɺ࣮༻తʹͳΔՄೳੑߴ͍ •
ߏ͍ͯͨ͠࠷దԽʹඞཁͳ४උΛணʑͱਐΊ͓ͯΓɺ࣮ݧͰޮՌ͕֬ೝͰ ͖ͨͷ͔Β Ruby 3 ʹՃ༧ఆ