Upgrade to Pro — share decks privately, control downloads, hide ads and more …
Sign up for free

AWS で実現した Mackerel 時系列データ1分粒度長期保存の裏側 / Mackerel...

Avatar for astj astj PRO
February 05, 2018
Technology
31k
6

AWS で実現した Mackerel 時系列データ1分粒度長期保存の裏側 / Mackerel Meetup #11 Tokyo

2018/02/05 https://mackerelio.connpass.com/event/76678/

Avatar for astj

astj PRO

February 05, 2018

More Decks by astj

See All by astj
ISUCON14公式反省会LT: 社内ISUCONの話
Avatar for astj astj
PRO
0
610
Mackerel の時系列データベースにおける Redis Cluster の利用と Amazon ElastiCache への移行について / AWS Purpose-Built Databases Week
Avatar for astj astj
PRO
3
6.2k
Mackerel のコンテナ監視の近況 / Mackerel Meetup #13
Avatar for astj astj
PRO
1
2.7k
Observability: Mackerel による観測と Mackerel の観測 / NoOps Meetup Tokyo #8
Avatar for astj astj
PRO
2
2.4k
サービス開発と健全なプロダクトメンテナンスを開発チームで持続的に取り組む / Developers Boost KANSAI
Avatar for astj astj
PRO
1
1.6k
Mackerel and Stripe / Qiita x Stripe Meetup
Avatar for astj astj
PRO
0
5.8k
Mackerel をオンプレミスから AWS に移してからの1年半を振り返る / Hatena Engineer Seminar #11
Avatar for astj astj
PRO
0
1.3k
稼働中の Web サービスの perl のバージョンを上げていく
Avatar for astj astj
PRO
0
7.6k
Perl 6 で Web Application Framework をつくる
Avatar for astj astj
PRO
0
4.9k

Other Decks in Technology

See All in Technology
(swiftc) NonCopyableとライフタイム修飾子
Avatar for Himeshi teamhimeh
0
160
攻撃 3 時間 vs 復旧 10 時間。アクセスキー流出の非対称性を体感するために CTF を作った話
Avatar for kazzpapa3 kazzpapa3
1
130
1週間、Opus封印でお願いします
Avatar for KintoTech_Dev kintotechdev
1
430
詳解 never 型 - ボトム型の性質を深掘り
Avatar for Nealle nealle
0
130
AI Search (Foundry IQ) におけるRAGデータの準備と配置
Avatar for Ryoma Nagata ryomaru0825
1
130
クラウドエージェントの先駆け Devin。今も最先端を走る、他との違い
Avatar for kinopee kinopeee
1
540
複雑な業務システムを高速でつくるため、チーム全員をつくれる人へ
Avatar for AyaKurabuchi ayakurabuchi
0
120
なぜ東京にいる私が、新潟の技術コミュニティを運営するのか by 八雲慎之助
Avatar for やくも yakumo
0
210
GitHub、使う？使わない？
Avatar for コロッケそば happysamurai294
0
140
AI時代の開発はウォーターフォールに回帰する？ / development-with-ai-back-to-wf
Avatar for 岡本卓也 okamototakuyasr2
0
170
「作れる」と「リリースできる」の間にあったもの── PdMを外して見えた、PdMがやるべき仕事/Buildable ≠ Shippable: What Removing the PM Taught Me About the PM’s Job
Avatar for Yappli Developers yappli_developers
0
420
Deep Data Security 機能解説
Avatar for oracle4engineer oracle4engineer
PRO
3
990

Featured

See All Featured
SERP Conf. Vienna - Web Accessibility: Optimizing for Inclusivity and SEO
Avatar for Sara Fernández Carmona sarafernandez
2
1.6k
From Legacy to Launchpad: Building Startup-Ready Communities
Avatar for Dug Song dugsong
0
370
Code Review Best Practice
Avatar for Trisha Gee trishagee
74
20k
Evolution of real-time – Irina Nazarova, EuRuKo, 2024
Avatar for Irina Nazarova irinanazarova
9
1.6k
Building Experiences: Design Systems, User Experience, and Full Site Editing
Avatar for Michelle Schulp Hunt marktimemedia
1
650
Introduction to Domain-Driven Design and Collaborative software design
Avatar for Kenny Baas-Schwegler baasie
1
1.1k
Designing for Performance
Avatar for Lara Hogan lara
612
70k
Practical Tips for Bootstrapping Information Extraction Pipelines
Avatar for Matthew Honnibal honnibal
25
2.1k
RailsConf & Balkan Ruby 2019: The Past, Present, and Future of Rails at GitHub
Avatar for Eileen M. Uchitelle eileencodes
141
35k
Un-Boring Meetings
Avatar for Sebastian Deterding codingconduct
0
480
Groundhog Day: Seeking Process in Gaming for Health
Avatar for Sebastian Deterding codingconduct
0
450
A designer walks into a library…
Avatar for Paul Jervis Heath pauljervisheath
211
25k

Transcript

  1. "84Ͱ࣮ݱͨ͠.BDLFSFM ࣌ܥྻσʔλ෼ཻ౓௕ظอଘͷཪଆ  .BDLFSFM.FFUVQ5PLZP JEBTUKʢגࣜձࣾ͸ͯͳʣ

  2. w ͸ͯͳΞϓϦέʔγϣϯΤϯδχΞ w ͸ͯͳϒοΫϚʔΫ͸ͯͳϒϩάFUDʜ w डୗαʔϏε w .BDLFSFM d 

    w αʔόαΠυΤʔδΣϯτத৺ JEBTUK

  3. w NBDLFSFMBHFOUTZTUFNEରԠ w NBDLFSFMQMVHJOBXT ͍͔ͭ͘ w -*/&5XJMJP࿈ܞ w "84Ҡߦ࣌ܥྻσʔλϕʔεͷ࡮৽ w

    ࣌ܥྻσʔλ෼ཻ౓௕ظอଘ w ؂ࢹϧʔϧͷૢ࡞Λ௨஌νϟϯωϧʹ௨஌ w ʜ JEBTUK

  4. ຊ೔ͷ࿩୊

  5. w .BDLFSFM࣌ܥྻ%#ͷ঺հ w ෼ཻ౓௕ظอଘͷٕज़എܠ w αʔόϨεϛυϧ΢ΣΞͷߏஙࣄྫ w %ZOBNP%#4USFBNT -BNCEB w

    ߴεϧʔϓοτ4ॻ͖ࠐΈ

  6. લఏ

  7. ࣌ܥྻσʔλ

  8. ࣌ܥྻσʔλ hatena.mackerel.host1.cpu.user 2018/02/01T21:15:00Z 44.00 2018/02/01T21:16:00Z 6.00 2018/02/05T21:17:00Z 8.00 … …

  9. ࣌ܥྻσʔλϕʔε hatena.mackerel.host1.cpu.user 2018/02/01T21:15:00Z 44.00 2018/02/01T21:16:00Z 6.00 2018/02/05T21:17:00Z 8.00 hatena.mackerel.host1.cpu.user 2018/02/01T21:15:00Z

    44.00 2018/02/01T21:16:00Z 6.00 2018/02/05T21:17:00Z 8.00 hatena.mackerel.host1.cpu.user 2018/02/01T21:15:00Z 44.00 2018/02/01T21:16:00Z 6.00 2018/02/05T21:17:00Z 8.00 hatena.mackerel.host1.cpu.user 2018/02/01T21:15:00Z 44.00 2018/02/01T21:16:00Z 6.00 2018/02/05T21:17:00Z 8.00 … …

  10. http://blog.yuuk.io/entry/the-rebuild-of-tsdb-on-cloud

  11. None

  12. NI NE IE   #FGPSF E

  13. NE NE IE E   "GUFS

  14. None

  15. .BDLFSFMͷ ࣌ܥྻσʔλϕʔε

  16. Ҡߦલ(SBQIJUF IUUQTHSBQIJUFBQQPSH

  17. http://blog.yuuk.io/entry/high-performance-graphite

  18. ҠߦޙEJBNPOE ಺੡ίʔυωʔϜ

  19. IUUQCMPHZVVLJPFOUSZUIFSFCVJMEPGUTECPODMPVE ࣌ܥྻσʔλϕʔεͱ͍͏֓೦ΛΫϥ΢υͷٕͰ࠶ߏங͢Δ

  20. IUUQJUDIZOZIBUFOBCMPHDPNFOUSZ 4FSWFSMFTTDPOG5PLZPͰʰαʔόϨεΞʔΩςΫνϟʹ ΑΔ࣌ܥྻσʔλϕʔεͷߏஙͱ؂ࢹʱͱ͍͏ൃද͖ͯ͠·ͨ͠

  21. http://blog.yuuk.io/entry/the-rebuild-of-tsdb-on-cloud 3FEJT$MVTUFS &$

  22. ίϯηϓτ w εέʔϧ͢ΔΞʔΩςΫνϟ w ϚωʔδυαʔϏεʹΑΔӡ༻লྗԽ w ΞΫηεಛੑʹԠͨ͡֊૚ܕσʔλετΞ w 3FEJT %ZOBNP%#

    4

  23. ετϨʔδ *0ίετ ϨΠςϯγ ༰ྔίετ 3FEJT ˕ ˕ ˚ %ZOBNP%# ˓

    ˓ ˓ 4 ˚ ˚ ˕ σʔλετϨʔδ

  24. %ZOBNP%# w ϑϧϚωʔδυ/P42- w ҆ఆɾߴύϑΥʔϚϯεɾεέʔϥϏϦςΟ w खࠒͳίετ w σʔλ༰ྔɺεϧʔϓοτ w

    ʢͱ͸͍͑අ༻Λແࢹ͸Ͱ͖ͳ͍ʣ

  25. 3FEJT $MVTUFS w ΠϯϝϞϦ,74 w *0ίετ͕ %ZOBNP%#ΑΓ खܰ w σʔλྔΛࡹͨ͘Ί3FEJT$MVTUFS

    w ࠓͷͱ͜Ζ&$

  26. 4 w ,74తʹར༻ w ༰ྔίετ͸ඇৗʹ཈͑ΒΕΔ w ϨΠςϯγɾ*0ίετ͸ྼΔ w ॻ͖ࠐΈճ਺ΛݮΒ͍ͨ͠

  27. w %ZOBNP%# w ϝΠϯ w 3FEJT w ߋ৽ϦΫΤετΛݮΒͨ͢ΊͷόοϑΝ w 4

    w طଘͷอ࣋ظؒͰ͸ ར༻͠ͳ͍ ֊૚ܕσʔλετΞ 

  28. NI NE IE   ֊૚ܕσʔλετΞ  %ZOBNP%# 3FEJT E

  29. ෼ཻ౓ͷ௕ظอଘ

  30. w σʔλྔ͕େ͖͘๲ΒΉ ഒ  w ݹ͍σʔλͷϨΠςϯγཁ݅͸গ͠؇͍ w ৽͍͠σʔλ΄Ͳසൟʹ͸ࢀর͞Εͳ͍ w ݹ͍σʔλͷ্ॻ͖ߋ৽͸ൃੜ͠ͳ͍

  31. w ݹ͍σʔλΛ4ʹ഑ஔ w طଘͷอ࣋ظؒͷύϑΥʔϚϯεΛҡ࣋ w ॻ͖ࠐΈճ਺ΛݮΒ͢ ֊૚ܕσʔλετΞ 

  32. NE NE IE   ֊૚ܕσʔλετΞ  %ZOBNP%# 3FEJT 4

    E
  33. None

  34. 55-&YQJSF %ZOBNP%# %%#4USFBN -BNCEB 4 1VU0CKFDU

  35. %ZOBNP%#55-

  36. %ZOBNP%#ͷΞΠςϜ͝ͱʹ༗ޮظݶ 55- Λࢦఆͯ͠ɺࣗಈతʹ࡟আͤ͞Δ

  37. %ZOBNP%# hatena.mackerel.host1.cpu.user 2018/02/03 00:00~03:59 ExpireAt: 2018/02/04 05:00 2018/02/02 16:00~19:59 ExpireAt:

    2018/02/03 21:00 hatena.mackerel.host1.cpu.user 2018/02/03 04:00~07:59 ExpireAt: 2018/02/04 09:00 hatena.mackerel.host1.cpu.user hatena.mackerel.host1.cpu.user 2018/02/02 20:00~23:59 ExpireAt: 2018/02/04 01:00

  38. %ZOBNP%# hatena.mackerel.host1.cpu.user 2018/02/03 00:00~03:59 ExpireAt: 2018/02/04 05:00 hatena.mackerel.host1.cpu.user 2018/02/03 04:00~07:59

    ExpireAt: 2018/02/04 09:00 hatena.mackerel.host1.cpu.user hatena.mackerel.host1.cpu.user 2018/02/02 20:00~23:59 ExpireAt: 2018/02/04 01:00

  39. %ZOBNP%# hatena.mackerel.host1.cpu.user 2018/02/03 00:00~03:59 ExpireAt: 2018/02/04 05:00 hatena.mackerel.host1.cpu.user 2018/02/03 04:00~07:59

    ExpireAt: 2018/02/04 09:00 hatena.mackerel.host1.cpu.user

  40. hatena.mackerel.host1.cpu.user 2018/02/03 04:00~07:59 ExpireAt: 2018/02/04 09:00 hatena.mackerel.host1.cpu.user %ZOBNP%#

  41. %ZOBNP%# hatena.mackerel.host1.cpu.user

  42. %ZOBNP%#

  43. ೳಈతͳૢ࡞ͳ͘%ZOBNP%#্ͷ ϨίʔυΛ࡟আͰ͖Δ

  44. %ZOBNP%#4USFBNT

  45. w %ZOBNP%#্ͷΞΠςϜߋ৽͕
 Πϕϯτͱͯ͠ྲྀΕΔετϦʔϜ w ςʔϒϧͷσʔλมߋΛτϦΨʹ
 -BNCEBؔ਺ΛىಈͰ͖Δ w ϖΠϩʔυʹมߋલޙͷΞΠςϜ಺༰Λ
 ؚΊΔ͜ͱ͕Ͱ͖Δ

  46. %ZOBNP%# 4USFBN -BNCEB ৽نΞΠςϜ௥Ճ طଘΞΠςϜߋ৽ ΞΠςϜ࡟আ

  47. EJBNPOEFYQPSUFS %ZOBNP%#55-  %ZOBNP%#4USFBNT

  48. w 55-ʹ౸ୡͨ͠ΞΠςϜͷ࡟আ࣌ʹ
 ΞΠςϜͷ಺༰Λ౉ͯ͠-BNCEBؔ਺Λ ىಈ w -BNCEBؔ਺Ͱ4ʹॻ͖ग़͠

  49. ͜ͷΞΠςϜ͕55-ʹ౸ୡͯ͠
 ࡟আ͞Ε·ͨ͠ hatena.mackerel.host1.cpu.user 2018/02/01T21:15:00Z 44.00 2018/02/01T21:16:00Z 6.00 2018/02/05T21:17:00Z 8.00 …

    … hatena.mackerel.host1.cpu.user 2018/02/01T21:15:00Z 44.00 2018/02/01T21:16:00Z 6.00 2018/02/05T21:17:00Z 8.00 … …

  50. hatena.mackerel.host1.cpu.user 2018/02/01T21:15:00Z 44.00 2018/02/01T21:16:00Z 6.00 2018/02/05T21:17:00Z 8.00 … …

  51. 55-&YQJSF %ZOBNP%# %%#4USFBN -BNCEB 4 1VU0CKFDU

  52. 55-&YQJSF %ZOBNP%# %%#4USFBN -BNCEB 4 1VU0CKFDU w ϝτϦοΫ͝ͱO࣌ؒ͝ͱʹΞΠςϜ w %ZOBNP%#ͷΞΠςϜʹ55-Λઃఆ

    w 55-ܦաʹΑΓΞΠςϜ࡟আ w ΞΠςϜ࡟আΠϕϯτ͕4USFBNʹ௨஌ w 4USFBN͔Β-BNCEBؔ਺ىಈ w -BNCEBؔ਺͕ΞΠςϜΛ4ʹॻࠐ

  53. 55-&YQJSF %ZOBNP%# %%#4USFBN -BNCEB 4 1VU0CKFDU w 55-෇༩Ҏ֎ͷ ೳಈతͳૢ࡞͕ෆཁ w

    -BNCEBͷࣦഊ࣌ϦτϥΠ΋ࣗಈ w 4USFBNҎ֎ʹঢ়ଶΛ࣋ͨͳ͍ w %ZOBNP%#ΞΠςϜ4Φϒ δΣΫτ

  54. 4 EJBNPOE"11 NBDLFSFM"11 (FU0CKFDU )551 )551

  55. γϯϓϧ

  56. "84ͷΞοϓσʔτʹΑ࣮ͬͯݱ

  57. ೥ͷ%ZOBNP%#Ξοϓσʔτ w 55-d w "VUP4DBMF %"9d w 71$&OEQPJOUd w (MPCBM5BCMFT

    ΦϯσϚϯυόοΫΞοϓd

  58. 4΁ͷߴස౓ॻ͖ࠐΈ

  59. w 4΁ͷߴස౓ॻ͖ࠐΈΛߦ͏৔߹͸ରԠ͕ඞཁ w ಺෦γϟʔσΟϯάରԠͷͨΊͷQSFpY෇༩ w ٸܹͳ૿Ճͷ৔߹͸ "84αϙʔτܦ༝Ͱͷ
 ࣄલରԠґཔ

  60. Amazon S3 όέοτͷϫʔΫϩʔυ͕ຖඵ 100 ճͷ PUT/LIST/DELETE ϦΫΤετ·ͨ͸ຖඵ 300 ճͷ GET

    ϦΫΤετΛසൟʹ௒͑Δ৔߹ ͸ɺ࠷ߴͷύϑΥʔϚϯεͱεέʔϥϏϦςΟ Λ֬อ͢ΔͨΊɺ͜ͷτϐοΫͷΨΠυϥΠϯ ʹै͍ͬͯͩ͘͞ɻ ϦΫΤετ཰͓ΑͼϦΫΤετύϑΥʔϚϯεʹؔ͢Δཹҙࣄ߲ https://docs.aws.amazon.com/ja_jp/AmazonS3/latest/dev/request- rate-perf-considerations.html

  61. EJBNPOEͰ4΁ͷॻ͖ࠐΈ͸ίϯελϯτʹൃੜ SQT͸༏ʹ௒͑Δ

  62. 55-&YQJSF %ZOBNP%# %%#4USFBN -BNCEB 4 1VU0CKFDU w ϝτϦοΫ͝ͱO࣌ؒ͝ͱʹΞΠςϜ w %ZOBNP%#ͷΞΠςϜʹ55-Λઃఆ

    w 55-ܦաʹΑΓΞΠςϜ࡟আ w ΞΠςϜ࡟আΠϕϯτ͕4USFBNʹ௨஌ w 4USFBN͔Β-BNCEBؔ਺ىಈ w -BNCEBؔ਺͕ΞΠςϜΛ4ʹॻࠐ ࠶ܝ

  63. 55-&YQJSF %ZOBNP%# %%#4USFBN -BNCEB 4 1VU0CKFDU w 55-෇༩Ҏ֎ͷ ೳಈతͳૢ࡞͕ෆཁ w

    -BNCEBͷࣦഊ࣌ϦτϥΠ΋ࣗಈ w %ZOBNP%#ͷΞΠςϜ4Φϒ δΣΫτ ࠶ܝ

  64. ϦΫΤετ཰͓ΑͼϦΫΤετύϑΥʔϚϯεʹؔ͢Δཹҙࣄ߲ https://docs.aws.amazon.com/ja_jp/AmazonS3/latest/dev/request- rate-perf-considerations.html

  65. w ΦϒδΣΫτ໊ઌ಄ʹ.%ϋογϡͷ෇༩ w ॻ͖ࠐΈ։࢝લʹαϙʔτʹରԠΛґཔ w ਺೔Φʔμʔͷ଴͕ͪ࣌ؒൃੜ͢Δ

  66. ա৒ͳϖʔεͰͷߋ৽͸)551YYΤϥʔ͕ ൃੜ͢ΔʢΒ͍͠ʣ ϞχλϦϯάʂ

  67. "844ͷϞχλϦϯά

  68. w 4ͷඪ४$MPVE8BUDI.FUSJDT͸ݶఆత w όέοτͷ೔࣍ͷετϨʔδϝτϦΫε w ϦΫΤετͷ෼ੳ͸Ͱ͖ͳ͍ w ΦϓγϣϯͰϦΫΤετͷϞχλϦϯά΋Մೳ w 4όέοτͷઃఆͰ༗ޮʹͰ͖Δ

    https://docs.aws.amazon.com/ja_jp/AmazonS3/latest/dev/ cloudwatch-monitoring.html
  69. None

  70. $MPVE8BUDI.BDLFSFM

  71. mackerel-plugin-aws-s3-requests [plugin.metrics.diamond-s3] command = "/path/to/mackerel-plugin-aws-s3-requests --bucket- name=XXX --region=ap-northeast-1 --filter-id YYY"

    ެࣜϓϥάΠϯͱͯ͠ϦϦʔε༧ఆ ͖ͬͱࠓिதʹ͸ʜ
  72. None

  73. w (FU 1VUͦΕͧΕͷϦΫΤετ਺ w ୹ظతͳόʔετɺ௕ظతͳτϨϯυ w YYΤϥʔͷ਺ ؂ࢹϧʔϧ

  74. ͓ΘΓʹ

  75. w ࣌ܥྻσʔλ෼ཻ౓௕ظอଘͷ಺෦࣮૷ w ߴස౓4ॻ͖ࠐΈ w ཹҙࣄ߲ϞχλϦϯά

  76. ༗Γ೉͏͍͟͝·ͨ͠ʂ