Profiling Go Application

Transcript

1. Profiling Go Application Go Conference 2018 Autumn #gocon #gocon_a @orisano
2. ࣗݾ঺հ • @orisano • ۦ͚ग़͠ΞϓϦέʔγϣϯΤϯδχΞ • ޮ཰తͳdocker buildΛ໨ࢦ͍ͯ͠Δ • ύϑΥʔϚϯεʹڵຯ͕͋Δ
3. ࠓ೔࿩͢͜ͱ • ߴ଎Խ΍, ϓϩϑΝΠϦϯάΛߦ͖࣮ͬͯͨྫ • Ͳ͏͍͏վળΛ͢Δͷ͔ • Ͳ͏͍͏ϓϩηεͳͷ͔
4. ը૾ม׵αʔόͷ࿩ kubeletͷ࿩ go-swaggerͷ࿩
5. ը૾ม׵αʔόͷ࿩ kubeletͷ࿩ go-swaggerͷ࿩
6. ৄղ γεςϜɾύϑΥʔϚϯε ྠಡձ
7. ୊ࡐͱͯ͠؆୯ͳ ը૾ม׵αʔόΛѻͬͨ
8. ෛՙΛ͔͚Δͱ ΞϓϦέʔγϣϯ͕མͪͨ
9. topΛΈͨ
10. མͪͨݪҼ͸ ϝϞϦͷ࢖༻ྔ
11. ϝϞϦϦʔΫʁ
12. pprofΛ࢖͏ GODEBUG=allocfreetrace=1 ͢Δ
13. runtimeʹखΛೖΕΔ
14. GC͍ͯ͠Δͱ͖ʹ ࢀরgraphΛdump͢ΔΑ͏ ʹͨ͠
16. ͪΌΜͱpprofͷmemory goroutineͷ਺ΛݟΔ
17. ಉ࣌ม׵਺ʹ੍ݶΛ͚ͭΔ
18. ແࣄ໰୊͸ղܾͨ͠
19. ͋ͱ͸ߴ଎Խ
20. disintegration/imaging
21. Boundary Check Elimination
22. Go͸جຊఴࣈΞΫηε͢Δͱ ൣғνΣοΫ͕ೖΔ
23. ίϯύΠϥ͕҆શͩͱ ൑அ͢Δͱফ͑Δ
24. ͜ΕΛ Boundary Check Elimination (BCE)ͱ͍͏
25. ͜ΕΛ Boundary Check Elimination (BCE)ͱ͍͏ ref: https://go101.org/article/bounds-check-elimination.html
26. goͷඪ४ϥΠϒϥϦͰ ͦͦ͜͜ݟΔ
27. ը૾ͷಡΈࠐΈ, ม׵ͳͲ heavyʹఴࣈΞΫηε͢Δ ৔߹ͩͱޮՌ͕େ͖͍
28. https://github.com/ disintegration/imaging/ pull/81
29. https://github.com/ disintegration/imaging/ pull/81
31. pprofͳͲͰ ݪҼΛಛఆͨ͠Β
32. ·ͣ BenchmarkΛॻ͜͏ *testing.B
33. Benchmarkͷ݁ՌΛ ͪΌΜͱݟΔ
34. golang.org/x/tools/cmd/ benchcmp golang.org/x/perf/cmd/ benchstat
35. https://github.com/ disintegration/imaging/ pull/81
36. ը૾ม׵αʔόͷ࿩ kubeletͷ࿩ go-swaggerͷ࿩
37. kubeletͷCPU͕ෛՙ͕ߴ͍ ͱ૬ஊΛड͚ͨ
38. Datadog͕ୟ͍ͯΔ Metrics༻ͷEndpoint͕ ݪҼͳͷͰ͸ͱ͍͏࿩ͩͬͨ
39. kubelet͸net/http/pprofΛ import͍ͯ͠Δ
40. ໰୊͕ى͖͍ͯΔ؀ڥͷ ৘ใ͕औͬͯ͜ΕΔ
42. prometheus/common google/cadvisor ͷҰ෦͕ॏ͍
44. ౰֘Օॴ https://github.com/prometheus/ common/pull/148 ൃ֮ͷ1िؒલ͘Β͍ʹ allocation freeʹͳͬͯ 2ഒ͘Β͍ૣ͘ͳ͍ͬͯͨ
46. ͳΜ͔չ͔ͬͨ͠ͷͰ https://github.com/prometheus/ common/pull/150 ߋʹͦΕΛ2ഒ͘Β͍ૣ͘͠·ͨ͠
48. ७ਮʹWrite͕ଟ͔ͬͨ
49. strings.Replacerʹ͸ WriteString͕͋Γ·͢
50. ஔ׵ର৅ՕॴҎ֎͸ ·ͱΊͯWriteͯ͘͠ΕΔ
51. allocation΋ى͜Βͳ͍ͷͰ࠷ߴ
52. ࣍ʹ
53. google/cadvisorͷ ListContainers͕ॏ͍
55. google/cadvisorͷ ListContainers͕ॏ͍ https://github.com/google/cadvisor/blob/8faf19092784b75fce10ce190d37e66f89de3612/container/common/helpers.go
56. ioutil.ReadDirͱsyscall ͕ॏ͍ʁ
57. ioutil.ReadDirͷத਎ΛݟͯΈΔ
58. ref: https://golang.org/src/io/ioutil/ioutil.go
59. ref: https://golang.org/src/os/dir_unix.go
60. ͳΜ͔ҎԼʹ͋ΔϑΝΠϧશ෦ʹ lstatൃߦ͍ͯ͠Δ
61. ref: https://golang.org/src/os/dir_unix.go
62. readdirentͬͯ΍͕ͭ͋Δ
63. Ͳ͏΍Β͜Ε͸ entryͷtypeΛฦͯ͘͠ΕΔΒ͍͠
64. google/cadvisorͷ ListContainers͕ॏ͍ https://github.com/google/cadvisor/blob/8faf19092784b75fce10ce190d37e66f89de3612/container/common/helpers.go
65. readdirentΛ͏·͘࢖͑Ε͹ syscallͷճ਺ΛݮΒͤΔ
66. ͔͠͠ golangඪ४ͷreaddirent͸ typeΛऔಘͰ͖ͳ͍
67. ͔͠΋ ࣮૷ʹඞཁͳॾʑ͕ privateʹͳ͍ͬͯΔ
68. ඪ४͔Βͦ͜Λίϐϖ͢Δͱ cadvisorͷ LICENSE Checkʹ௨Βͳ͍
69. ࣮͸͜ͷํ๏ ͍ΖΜͳϥΠϒϥϦͰ࢖ΘΕ͍ͯΔ goimports/internal/fastwalk ֎෦͔Βར༻Ͱ͖ͳ͍
70. ѹ౗తʹ֎෦͔Βར༻Ͱ͖ͳ͍
71. github.com/karrick/godirwalk Α͏΍͘ݟ͚ͭͨ
72. https://github.com/google/ cadvisor/pull/2085
74. Memoryܥͷऔಘ͚ͩ΍ͨΒ஗͍
75. https://lkml.org/lkml/ 2018/7/3/101 cgroups v1ܥͷ໰୊Β͍͠ kernelͷversionΛ͋͛Α͏
76. ը૾ม׵αʔόͷ࿩ kubeletͷ࿩ go-swaggerͷ࿩
77. ࣗಈੜ੒Λ݁ߏ࢖͍ͬͯΔͷͰ͕͢
78. go-swagger͕஗͍
79. ૣ͘͠Α͏
80. cliܥͷϓϩϑΝΠϦϯάʹ͸ pkg/profile͕ศར
82. https://github.com/go-openapi/ swag/pull/25
84. ಺෦Ͱຖճ MustCompileͯͨ͠
86. https://github.com/go-openapi/ loads/pull/19
88. ஗͍json.UnmarshalΛ deepcopyͷͨΊʹ2ճͯͨ͠
89. json.Unmarshal 1ճ {de,en}coding/gob Ͱ͓஡Λ୙ͨ͠
91. ·ͱΊ
92. ීஈ࢖͍ͬͯΔ΋ͷͰ΋ ΧϦΧϦʹνϡʔχϯά ͞Ε͍ͯΔΘ͚Ͱ͸ͳ͍
93. ࣗ෼͕஗͍ͱײͨ͡Β ܭଌͯ͠ΈΔ վળͯ͠ΈΔ
94. cliͳΒpkg/profileΛ࢓ࠐΜͰݟΔ
95. serverͳΒnet/http/pprofΛ࢖͏
96. ݪҼͷಛఆͷखॿ͚ͷͨΊʹ svgʹͨ͠Γ uber/go-torchΛ࢖ͬͯ flamegraphʹͨ͠Γ flamescopeΛ࢖ͬͨΓ
97. ݪҼΛಛఆͨ͠Β BenchmarkΛॻ͘
98. -count=10ͳͲΛ࢖ͬͨ͋ͱʹ benchcmp or benchstat ͯ͠ޮՌ͕ग़͍ͯΔ͜ͱΛ֬ೝ
99. ͋ͱ͸PRΛ౤͛Δ
100. ͜Μͳʹ ύϑΥʔϚϯενϡʔχϯά ͠΍͍͢ݴޠଞʹͳ͍
101. ΍͍ͬͯ͜͏
102. ඞཁΛײ͡Δ·Ͱ͸ νϡʔχϯά͠ͳ͍
103. Ͱ΋ ܭଌ͕Ͱ͖Δ؀ڥ͸༻ҙ͢΂͖