Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
Suggested Topicの質問に可能な限り答えてみた
Search
shogomuranushi
August 25, 2020
Technology
0
1.1k
Suggested Topicの質問に可能な限り答えてみた
shogomuranushi
August 25, 2020
Tweet
Share
More Decks by shogomuranushi
See All by shogomuranushi
ノーコード x ChatBotで遊んでたら ReActを実装しそうだった話
shogomuranushi
0
1.2k
ChatGPT関連情報の追い方、個人・業務での使い方、サービスへの組み込み方、 ABEJAでの取り組み4例、ここ2週間のトピックなど行けるところまで
shogomuranushi
5
1.9k
FPが教える iDeCo のすごさ
shogomuranushi
0
140
AWS Control Tower導入してハッピーになりました
shogomuranushi
0
270
EKS を使ってる人から見た App Runner
shogomuranushi
7
2.5k
顧客のアプリケーションコードが動くマルチテナント環境における課題とEKSにたどり着くまで
shogomuranushi
0
1.6k
ちょいテク100本ノック。できるまで帰しません 。今から使えるちょいテク集
shogomuranushi
1
2.8k
after of Infrastructure-as-Code-is-very-tired
shogomuranushi
16
3.4k
what is Cloud Run?
shogomuranushi
2
120
Other Decks in Technology
See All in Technology
EM初心者として半年間マネジャーをやってみて分かったこと
sansantech
PRO
0
140
エンジニアリング 💰Moneyジャー / Engineering Money-ger
kenchan
2
410
プラクティスの名前は言わない方がいい / Not to mention the name of the practice
3l4l5
8
3.3k
Amazon Bedrock GenUハンズオン座学資料 #1 GenU環境で生成AIを体験してみよう
tsukuboshi
0
220
Agent Mode とは?GitHub Copilot の新機能を探る
lescoggi
1
150
心に火を灯すヒントは自分の中にある/The clue to lighting a fire in your heart is within you.
bitkey
1
120
パスキーでのログインを 実装してみよう!
hibiki_cube
0
200
EC-CUBEはサーバレスで動かせるのか?
yukishimada
1
140
AIが変えるソフトウェア開発__未来のアジャイルチームとは__.pdf
buchirei
0
180
単一の深層学習モデルによる不確実性の定量化の紹介 ~その予測結果正しいですか?~
ftakahashi
PRO
3
430
非エンジニアにも伝えるメールセキュリティ / Email security for non-engineers
ykanoh
5
470
ドメインイベントを活用したPHPコードのリファクタリング
kajitack
0
570
Featured
See All Featured
Imperfection Machines: The Place of Print at Facebook
scottboms
267
13k
Fight the Zombie Pattern Library - RWD Summit 2016
marcelosomers
233
17k
Chrome DevTools: State of the Union 2024 - Debugging React & Beyond
addyosmani
4
420
What’s in a name? Adding method to the madness
productmarketing
PRO
22
3.4k
How to Think Like a Performance Engineer
csswizardry
22
1.4k
Six Lessons from altMBA
skipperchong
27
3.7k
Product Roadmaps are Hard
iamctodd
PRO
51
11k
Rails Girls Zürich Keynote
gr2m
94
13k
CSS Pre-Processors: Stylus, Less & Sass
bermonpainter
356
29k
A Philosophy of Restraint
colly
203
16k
Design and Strategy: How to Deal with People Who Don’t "Get" Design
morganepeng
129
19k
GraphQLとの向き合い方2022年版
quramy
44
14k
Transcript
Japan Datadog User Group Meetup#1 ABEJA, Inc. Shogo Muranushi Suggested
Topicͷ࣭ʹՄೳͳݶΓ͑ͯΈͨ
@rwle1212 2
@rwle1212 3 ໊લ ɿ ଜओ ޛʢΉΒ͵͠ ͠ΐ͏͝ʣ ձࣾ ɿ ABEJA,
Inc. ۀ ɿΠϯϑϥΤϯδχΞ -> ϓϩμΫτΦʔφʔ -> SRE
@rwle1212 4 Datadogྐྵ 2΄ͲɻInfra ͱ Logs ͷར༻͕ϝΠϯɻ Datadogࡉ͔͍ػೳ͕ଟ͘ɺͿͬͪΌ͚Α͔ͬͯ͘ͳ͍ɻ ࠓ͢͜ͱ͋͘·Ͱฐࣾͷ͍ํͳͷͰਖ਼ղͰͳ͍ɻ ৭ʑΓ͍ͨͷͰΈΜͳͰใ࣋ͪدΓͨ͘ɺ
·ͣొஃͯ͠Έͨɻ
@rwle1212 5
@rwle1212 6
@rwle1212 7 Datadogར༻نײ docker.containers.running Datadog Logs by weekly
@rwle1212 8 ຊʹೖΓ·͢
@rwle1212 9 ͍ͬͯΔػೳͦͷλΠϛϯά (ʮৼΓฦΓͰ͜ΜͳμογϡϘʔυΛ͍ͬͯΔʯͳͲ) • Α͘͞ΘΔػೳLogsͱNotebooks • ཧ༝λΠϛϯάޙड़
@rwle1212 10 μογϡϘʔυͲ͏ͬͯઃܭͯ͠·͔͢ʁ ΅͘ͷ͔Μ͕͍͖͑ͨ͞ΐ͏ͷμογϡϘʔυ ͲΜͳDashboardͰӡ༻͍ͯ͠Δ͔ɻ εϚʔτͳμογϡϘʔυͷ࡞Γํ μογϡϘʔυ͑ͯͬͯ·ͤΜɻ ཧ༝ʮ΅͘ͷ͔Μ͕͍͖͑ͨ͞ΐ͏ͷμογϡϘʔυʯʹͳͬͯ͠·͏͔ΒͰ͢ɻ
@rwle1212 11 ࣦഊྫ1: ݁ہCloudWatchΛݟ͍ͯͨ ALB -> Container -> EC2 ->
RDSͱ͍͏ϦΫΤετͷྲྀΕͰμογϡϘʔυΛ࡞ͬ ͯΈͨɻ μογϡϘʔυͷେ͖ܾ͞·͍ͬͯΔɺͭάϥϑ͕ଟ͗ͯ͢ෳࡶʹͳΔͷ ͰɺεϚʔτʹগͳΊʹάϥϑΛஔͨ͠ɻ ͔͠͠ো࣌ʹใ͕Γͳ͍ͷͰɺ݁ہCloudWatchΛோΊ͍ͯͨ͜ͱʹؾ͍ ͨɻ ͔ͦ͜ΒඞཁͳάϥϑΛ͍ͯ͘͠ͱͲΜͲΜෳࡶʹͳΓɺଞͷϝϯόʔʮԿΛ Ͳ͏ݟͨΒྑ͍ͷ͔Θ͔Βͳ͍ʯঢ়ଶʹͳͬͨɻ ݁ہCloudWatchΛோΊ͍ͯͨ͜ͱʹؾ͍ͨɻ
@rwle1212 12 ࣦഊྫ2: μογϡϘʔυͷछྨ͕૿͑ΔͱΑ͘Θ͔Βͳ͘ͳΔ
@rwle1212 13 ղܾྫ NotebookΛͬͯΈͨ • ো࣌ɺௐࠪ࣌ʹඞཁͳಛఆͷάϥϑ ͕ஔ͞Ε͍ͯΔෛՙ֬ೝ༻ͷ NotebookΛ࡞ • ܦա؍ΛݟΔͨΊͷάϥϑ͕ஔ͞
Ε͍ͯΔNotebookΛ࡞ ͳͲ
@rwle1212 14 ղܾྫ NotebookΛͬͯΈͨ • Jupyter Notebook Likeͳ͍ํ͕Ͱ͖ ͯɺίϝϯτͱάϥϑΛॻ͚Δ •
ಛఆͷোʹରͯ͠ௐͨ͜ͱɺਪଌ ͳͲͷίϝϯτΛॻ͖ͳ͕Βه͕ ͤΔ • ϩάͷάϥϑԽ༰қ • Issueʹը૾ΛషΓ͚ΔΑΓεϜʔ ζʹ·ͱΊΒΕΔͷͰڞ༗ָ͕͘͢͝
@rwle1212 15 ղܾྫ NotebookΛͬͯΈͨ • ͭ·Γ൚༻తͳμογϡϘʔυ࡞ͤͣʹɺCloudWatchͳͲͷશମΛ၆ᛌͰ ͖ΔϝτϦΫεΛݟͭͭɺϩάΛάϥϑԽͨ͠Γͯ͠ɺಛఆͷোʹ߹Θͤͯ ඞཁͳάϥϑΛஔͨ͠NotebookͰௐࠪܦա؍Λߦ͍ͬͯΔ
@rwle1212 16 ͦͦΈͳ͞ΜͲͷػೳԡ͠? ͱ͍͏͜ͱͰNotebooksΛਪͯ͠·͢ɻ ͋ͱLogsྑ͍ࢠͰ͢ɻޙड़Ͱ·ͱ·͍ͬͯ·͢ɻ
@rwle1212 17 ϦΫΤετ࣌ͷrateΞϥʔτ੍ํ๏ʹ͍ͭͯ ϦΫΤετͷࢹͯ͠·ͤΜ
@rwle1212 18 terraformҎ֎Ͱͷཧํ๏ ओʹຊ൪༻TerraformɻͱΓ͋͑ͣͷ࣌खͰ࡞Δɻ खͰ࡞ͬͨͷͱTerraformͰ࡞ͬͨͷ͕ࠞࡏ͢Δͱɺຊ൪༻ͳͷ͔ɺΞϥʔτΛ ์ஔͯ͠ྑ͍ͷ͔Α͔͘Βͳ͘ͳΔͷͰʮCreateByTerraformʯTagΛ༩ͯ͠ ผ͍ͯ͠Δ
@rwle1212 19 ՝ۚཧʹؔ͢Δେٕখٕ ಛʹେٕແ͠ɻখωλ͕͋Δͱͨ͠Β • Multi OrgڥBilling͕ू͞Εͯ͠·͏ɻʮLast Month’s UsageʯͰར༻ྔʢྉ ۚͰͳ͍ʣ͕Orgຖʹग़ྗ͞ΕΔͷͰ҈͍ͯ͠ΔɻӦۀ͞Μʹݴ͑Billing
͚ͯ͘ΕΔ͔ʁखؒͳͷͰͦ͜·Ͱͬͯͳ͍ • AWSΠϯςάϨʔγϣϯͰͨ͘͞ΜͷαʔϏεͷϝτϦΫεΛऔΕΔΑ͏ʹ͢Δ ͱɺCloudWatch ͷ GetMetricData API ͕ΊͪΌͪ͘Όݺͼग़͞ΕΔͷͰ՝͕ۚ େ͖͘૿͑Δɻ·ͣඞཁͳαʔϏε͚ͩߜͬͯऔΓࠐΉͷ͕٢ɻ SQSͰࢮͨ͠ܦݧ༗Γ
@rwle1212 20 ՝ۚཧʹؔ͢Δେٕখٕ • LogsʮͲΕ͕Կ݅ʯͱ͔ݟΕΔͷͰɺͨ·ʹෆཁͳϩά͕ແ͍͔֬ೝͯ͠ ʮIndexsʯͰআ֎ϑΟϧλΛ࡞ͯ͠ϩάͷ՝ۚΛ͑ͨΓ͢Δ ʢIndexed Logsͷ՝ۚࢭ·Δ͚ͲɺIngested Logsͷ՝ۚࢭ·Βͳ͍ͷͰҙɻ͍͔҆Βؾʹ͢Δ ΄ͲͰͳ͍͚Ͳʣ
@rwle1212 21 DBϞχλϦϯάͷTips͋Ε͜Ε CloudWatchΛIntegrationͯ͠ΔҐͰͦΕҎ্ͷ͜ͱ͓ͯ͠Γ·ͤΜ
@rwle1212 22 GoogleAnalyticsAPIར༻ͨ͠ݱࡏϢʔβʔͱ͔࠾औͯ͠ ͍Δࣄྫ͕͋Ε GoogleAnalyticsAPI༻͓ͯ͠Γ·ͤΜ
@rwle1212 ࡢͷ12݄ʹҎԼͷهࣄΛॻ͖·ͨ͠ 23 ଞͷࢹSaaSʢ͕ࣗΔൣғͰZabbixɾ PrometheusɾNew RelicɾMackerelʣͱͷൺֱ
@rwle1212 24 ʲཁʳͳͥPrometheusΛࣙΊͯDatadogΛ࠾༻ͨ͠ͷ͔ • Datadog͔ΒPrometheusΓ͑ • ݩʑDatadogΛ͍ͬͯͨɻ$18/host͕ߴ͔ͬͨ͠ɺKubernetesͷࢹͷσϑΝΫ τʹͳΓͭͭ͋ΔPrometheusΛࢼ͢తؚΊ͍ͯ࢝Ίͨɻ • ܦաɻPrometheusࣗମͷো͕νϥϗϥ
• OSSͰใগͳ͍߹ௐࠪʹ͕͔͔࣌ؒΔɻଟ͍࣌िʹ1,2ճ΄Ͳ͕ൃੜ ͠1,2ਓ͕࣌ؒ/ि΄ͲऔΒΕ͍ͯͨ • ελʔτΞοϓਓ͕͍ͳ͍ɻຊۀͷ։ൃʹूத͍ͨ͠ • πʔϧͷ͓कΓʹ͕࣌ؒऔΒΕ͍ͯͨɻPrometheusͷӡ༻Λ֎෦ʹҕୗ͍ͨ͠ɻ ӡ༻Λ֎෦ʹҕୗ͢Δͱ͍͘ΒʹͳΔ͔͔Βͳ͍͚ͲɺࠓͷنΛDatadogʹม ͑Δͱ10ສ/݄͘Β͍ͩͬͨɻɾɾDatadogͰΑ͘Ͷʁͱࢥ͍࢝ΊΔ
@rwle1212 25 ʲཁʳͳͥPrometheusΛࣙΊͯDatadogΛ࠾༻ͨ͠ͷ͔ • ϩάͷऩूͲ͏͢Δ • CloudWatch LogsΛ͍͕ͬͯͨݕࡧੜօແɻʢ࣌ʣPrometheusϩάऩू ͢Δػೳͳ͍ɻσϑΝΫτతʹ ElasticSearch
+ Kibana ͩΖ͏ • ͔͠͠ɺͦͷ࣌Ͱϩάྔ͕5ԯ/݄ɻঃʑʹରͷΞϓϦνʔϜΛ૿ͦ͏ͱࢥ ͏ͱϲ݄Ͱഒʑʹ૿͍͑ͯ͘͜ͱ͕ఆ͞Ε͍ͯͨ • ͦΕΛElasticSearchͰड͚ͳ͕Βӡ༻͢Δ͜ͱΛఆ͢Δͱɺख͕औΒΕͦ͏ײ͕ ͳ͔ͬͨ • DatadogϩάͷαʔϏεΛఏڙ࢝͠Ί͍ͯͨͷͰͬͯΈΔ͜ͱʹ
@rwle1212 26 ʲཁʳͳͥPrometheusΛࣙΊͯDatadogΛ࠾༻ͨ͠ͷ͔ • ϩάͲ͏͢Δ͔ͷ݁ • Facets ͕ڧྗͰɺಋೖָ͕ɺίετίϯτϩʔϧ͘͢͠ɺԿ͔͋Εશϩά Λ͑Δɻͦͷ্Ͱɺϩάऩू͢Δ্ͰΠϯϑϥΛؾʹ͠ͳͯ͘ྑ͍ͷ͕ؾʹೖ ΓɺঃʑʹϩάΛ
Datadog Logs ʹدͤ·ͨ͠ • ͦͯ͠ɺϞχλϦϯά Promethes ͔Β Datadog Ҡߦ • ͳͥPrometheusΛࣙΊͯDatadogΛ࠾༻ͨ͠ͷ͔ɺͷ·ͱΊ • ϩάϞχλϦϯά ͦΕ͕ࣄۀͷίΞͰ͋ΕͪΌΜͱߏங͠ӡ༻͢Δ͜ͱࣗ ମԀΘͳ͍ͷͰ͕͢ɺίΞͰͳ͍ͳΒ࣌ؒΛׂ͖ͨ͘ͳ͍
@rwle1212 ZabbixɺPrometheus ͷ؍͔Β͢ΔͱɺػೳੑͰͳ͘ӡ༻ੑͰஅ͍ͯ͠ΔͷͰOSSܥΑ΄ Ͳಛతͳػೳཁ͕݅ͳ͍ݶΓੵۃతͳ࠾༻ආ͚͍ͨͰ͢ 27 ଞͷࢹSaaSʢ͕ࣗΔൣғͰZabbixɾ PrometheusɾNew RelicɾMackerelʣͱͷൺֱ
@rwle1212 New RelicɺMackerel ྆ํͱݕূ͍ͯ͠ͳ͍ͷͰൺֱʹͳΒͳ͍Ͱ͕͢ɺݕূ͠ͳ͔ͬͨ ཧ༝ͷҰͭͱͯ͠ɺDatadogͰʮMonitoring Modern Infrastructureʯͱ͍͏ه ࣄ͕ެ։͞Ε͍ͯ·͢ɻ ͜͜ʹॻ͔Ε͍ͯΔ༰͕ͱͯཧʹ͔ͳ͍ͬͯͨͷͰɺ͜ͷΑ͏ͳࢥʹ ΑͬͯαʔϏε͕ઃܭ͞ΕࠓޙαʔϏεΛՃ͍ͯ͘͠ΜͩΖ͏ͳͱࢥ͍ɺ
࠾༻ͨ͠എܠ͋Γ·͢ɻ 28 ଞͷࢹSaaSʢ͕ࣗΔൣғͰZabbixɾ PrometheusɾNew RelicɾMackerelʣͱͷൺֱ
@rwle1212 29 SLOؔ࿈ͷϞχλʔ࡞ݕ౼Ͱࠔͬͨ͜ͱɾͨ͜͠ͱ ͋·Γ͍͠ػೳͰͳ͍ͷͰಛʹͳ͠ʁ ڧ͍ͯ͋͛ΔͳΒʮԿΛSLOͱͯ͠ܭଌ͢Δ͔ʯͷɺͦͦͷSLOͷఆ͕͍ٛ͠ ͘Β͍Ͱ͢ɻ
@rwle1212 30 Datadogͷڭ׆ಈ ʢͲͷׂͷΤϯδχΞ·Ͱ͍ͬͯΔ͔ʁʣ • ޮՌ͋ͬͨ͜ͱ • Dev/Stg/ProdͷશΞϓϦͷϩάΛશ෦ूͨ͠ɻ1ͭͷWebαΠτΛݟʹ ͍͘͜ͱͰશ෦ͷϩά͕ݟΕΔঢ়ଶʹͨ͠ɻࠓ·ͰڥຖʹݟΔॴ͕ ͔ΕͯͨΓɺग़ͯͨΓग़ͯͳ͔ͬͨΓ
• ͔ͦ͜ΒঃʑʹDatadogͷ͍ํΛೝࣝ͠ɺMonitorsNotebooksɺAPM ʹϝϯόʔͷڵຯ͕͕ͬͯߦͬͨ
@rwle1212 31 Datadogͷڭ׆ಈ ʢͲͷׂͷΤϯδχΞ·Ͱ͍ͬͯΔ͔ʁʣ • ޮՌ͋·Γͳ͔ͬͨ͜ͱ • Datadogͷ͍ํษڧձɻʮʔɻ͜Μͳ͜ͱͰ͖ΔΜͩʯͱ͍͏͚ͩͰखΛ ಈ͔͞ͳ͍ͷͰฉ͍ͯΕΔ •
ϩάɺϝτϦΫεΛՄೳͳݶΓूͯ͠ɺඞཁʹۦΒΕͯࣗͰௐͯ ͯ͠Β͏ํ͕͕֮͑ྑͦ͞͏ͳؾ͕ͨ͠ɻݴ͏ͯ͘͠ͳ͍ͷͰ • ͋Δఔͨ͠Βʮ͓Εͷ͔Μ͕͍͖͑ͨ͞ΐ͏ͷDatadogڞ༗ձʯΛ֤ϝ ϯόʔͰখωλతʹΔͷѱ͘ͳ͔ͬͨ
@rwle1212 32 Datadogͷڭ׆ಈ ʢͲͷׂͷΤϯδχΞ·Ͱ͍ͬͯΔ͔ʁʣ • ͲͷׂͷΤϯδχΞ·Ͱ͍ͬͯΔ͔ • ͍ͬͯΔͷΠϯϑϥɺόοΫΤϯυ • ϑϩϯτΤϯυͷE2Eࢹܥগ͠ߴ͍ͷͰ͍ͬͯͳ͍
• Real User MonitoringɺSynthetic Monitoring (Browser)
@rwle1212 33 ΠϯςάϨʔγϣϯͰ͍ͯ͠Δ͜ͱʢSlack / JIRAͱ Έ߹ΘͤͯɺΠϯγσϯτཧɾཧʹར༻ͳͲʣ WarningʮSlack௨ʯ AlertʮSlack௨ʯ+ʮPagerDutyͰిʯ+ʮGitHub Issue࡞(Zapierܦ༝)ʯ
@rwle1212 34 Ξϥʔτͷ௨Ϩϕϧཧ ʢฐࣾwarn / error / fatal ͳͲʣ •
WarnͱErrorͷΈ • ʮαʔϏεʹӨڹ͕Ͱ͍ͯΔϞϊɺͰ͍ͯΔՄೳੑ͕͋ΔϞϊʯΛΞϥʔτ ͱͯ͠ઃఆ͍ͯ͠Δ • ྫʣCPUϝϞϦͷ༻Λࢹͱ͔͍ͯ͠ͳ͍ɻͦΕΒͷӨڹʹΑͬ ͯALBͰ5xx͕සൃ͢ΕΞϥʔτ͕ඈͿΑ͏ʹ͍ͯ͠ΔɻDynamoDBͷ εϩοτϦϯάͱ͔
@rwle1212 35 datadog logsʹ͍ͭͯ༻ײࣄྫ
@rwle1212 36 facets • JSONͰૹΕউखʹύʔεͯ͘͠ΕΔ • ύʔε͞ΕͨΛfacets(index)Ͱ͖ΔͷͰɺϩ άͷQueryGroup ByͳͲʹར༻Ͱ͖Δ
@rwle1212 37 facets • Կ͕ѱ͍ͷ͔Θ͔Βͳ͍͚ͲɺindexͰ͖ͳ͍ ͕࣌͋Δɻ୭͔ղܾํ๏Λڭ͑ͯཉ͍͠ • ͜ͷέʔεͷ߹Ҏ֎ͷจࣈྻ͕ೖͬ ͪΌͬͯΔͷ͔ͳɾɾʁͬ͟ͱோΊͨײͦ͡Μ ͳ͜ͱͳ͍͚ͲɺͦΕΛ؆୯ʹݟΔʹͲ͏͠
ͨΒྑ͍ΜͩΖ͏ɾɾ
@rwle1212 38 Graph by Logs • ϩάΛάϥϑԽͰ͖Δ • facetsʹొͨ͠ΛGroup Byʹࢦఆͨ͠Γɺ
CountʹೖΕΔ͜ͱͰ͖Δ • ࠨਤͷྫͰɺOrganization NameຖͷϦΫΤ ετฏۉԠ࣌ؒͳͲΛදࣔɻίϯςφID ຖʹݟͯภΓ͕ແ͍͔ݟͨΓͯ͠Δ • γεςϜܥ͚ͩͰͳ͘ΞϓϦͷར༻ঢ়گੳ ʹ༻ՄೳͳͷͰɺΞϓϦଆͰ͖ͳΛग़ ͤ৭ʑͳ؍ͰੳͰ͖Δ • ᮢΛઃ͚ͯΞϥʔτൃ๒Ͱ͖ΔͷͰ1ͭͷγ εςϜͰϝτϦΫεɾϩάͷࢹΛཧͰ͖Δ
@rwle1212 39 Graph by Logs • େ͖͍มߋΛͨ࣌͠εςʔλείʔυͷׂ߹ Λ֬ೝ • ઃఆํ๏
• Group By: @http.status_code • Display: Areas • Stacked as: % of overall count: *
@rwle1212 40 Pipelines • JSON͡Όͳ͍ϩάΛύʔεͨ͠ΓɺDatadog ্Ͱʮ͜ͷϑΟʔϧυεςʔλεѻ͍͢Δʯ ͱ͍͏Α͏ͳϚοϐϯάΛߦ͏ • NginxRedisͳͲҰൠతͳϛυϧΣΞͷϩά IntegrationΛೖΕΕউखʹύʔεͯ͘͠Ε
ΔͷͰࣗͰgrokॻ͘ඞཁ͕ͳ͘ศར • ԼਤͷΑ͏ʹܭࢉࣜΛೖΕͨΓɺผ໊ʹม͑ͨ Γ͢Δ͜ͱͰ͖Δ
@rwle1212 41 Indexes • ϩάऩूͷআ֎ϑΟϧλ͕ॻ͚ΔɻIndexed LogsͰ՝ۚ͞Εͳ͘ͳΔ • 10%͚ͩऔಘ͢Δͱ͍͏͜ͱՄೳɻΫΤϦͰ ͔ͳΓߜΓࠐΉ͜ͱ͕Ͱ͖Δ •
ϩάΛૹ৴͢ΔAgent/ClientଆͰίϯτϩʔϧ ͢Δ͜ͱՄೳ͕ͩɺઃఆϑΝΠϧͷ͕ ໘ͳͷͰ͍ͬͨΜશ෦Datadogʹ͛ͯɺ IndexsͰϩάΛམͱ͢ͱ͍͏͍ํ͕Φεε ϝɻʢ҆Ձ͚ͩͲIngested Logsͷ՝ۚൃੜ͢ ΔͷͰҙʣ
@rwle1212 42 Archives • Datadogͷϩάܖظؒʢ7ͱ͔15ͱ ͔ʣ͔͠ݟΕͳ͍ • աڈϩάظؒอଘ͍ͨ͠߹ArchivesͰ S3GCSʹஷΊΔ͜ͱ͕Ͱ͖ΔͷͰɺAthena BigQueryͰݟΔ͜ͱͰ͖Δ
• Fluentdͱ͔ͰS3ʹૹΔ͜ͱͰ͖Δ͚Ͳɺ Datadogͷ߹ͱΓ͋͑ͣऩू͢ΔઃఆϑΝ ΠϧΛૹ৴͢Δ͚ͩͰྑ͍ͷͰɺઃఆϑΝΠϧ ͷΒ·͖ߋ৽͕ͳָ͍
@rwle1212 43 Archives • Rehydrate From Archivesͱ͍͏ػೳΛ͑ ArchivesʹೖͬͯΔσʔλΛDatadog Logsʹ ͢͜ͱ͕Ͱ͖ΔΈ͍ͨʁ͚ͩͲͬͨ͜ͱͳ͍
ͷͰҙ͕Θ͔ͬͯͳ͍ɻ୭͔ڭ͑ͯ
@rwle1212 44 datadog logsʹ͍ͭͯ༻ײࣄྫ ΞϓϦͷϩάΛDatadog LogsʹೖΕ͍ͯΔͷͰɺ΄΅ຖ౷ܭతʹݟͯҟৗ͕ແ͞ ͦ͏͔βοͱݟ͍ͯΔɻ ඞཁ͋ΒਂງΓ͢ΔͨΊʹ Graph Ͱ৭ʑͳ؍Ͱੳͨ͠Γɺه࣌͢ɺܦ
ա؍͢ΔNotebooksΛ࡞ͬͯܧଓతʹ༷ࢠΛݟͨΓ͍ͯ͠Δɻ
@rwle1212 45 ΠϕϯτใʹσϓϩΠΠϕϯτͳͲɺͲΜͳͷΛૹͬ ͍ͯΔ͔ɻ ࿈ܞͤ͞ΔπʔϧΛ૿͢ͷ͕ݏͳͷͰ࿈ܞ͍ͤͯ͞·ͤΜ
@rwle1212 46 APMؔ࿈ɺAnomalyϞχλʔͷ༗༻ͳ͍ํ APMɺAnomaly͍͜ͳ͓ͤͯΓ·ͤΜ
@rwle1212 47 LogsઃఆͷϕετϓϥΫςΟε • ͱΓ͋͑ͣ • શ෦ͷϩάΛ1Օॴʹू͢Δɻѹతޮ্͕Δ • Pipeline •
ύʔεͰ͖Δ͚ͲɺͰ͖ΔݶΓJSONͰૹ৴ͯࣗ͠ಈతʹύʔεͯ͠Β͏ • εςʔλεͱ͔Ϛοϐϯάͯ͠ɺϏϡʔϫʔͷ੨ɾԫɾ৭දࣔͰҰྎવʹ͢Δ • Indexes • ίετݮ͢ΔͨΊʹݟͳ͍ϩάআ֎͢Δ • Archives • ೦ͷͨΊաڈϩάS3/GCSʹอଘ͢Δ • S3/GCSଆͰҰఆظؒޙʹࣗಈআ͢ΔΑ͏ʹϥΠϑαΠΫϧΛೖΕΔ
48 ͝੩ௌ͋Γ͕ͱ͏͍͟͝·ͨ͠