$30 off During Our Annual Pro Sale. View Details »
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
Suggested Topicの質問に可能な限り答えてみた
Search
shogomuranushi
August 25, 2020
Technology
0
1.1k
Suggested Topicの質問に可能な限り答えてみた
shogomuranushi
August 25, 2020
Tweet
Share
More Decks by shogomuranushi
See All by shogomuranushi
ノーコード x ChatBotで遊んでたら ReActを実装しそうだった話
shogomuranushi
0
1.2k
ChatGPT関連情報の追い方、個人・業務での使い方、サービスへの組み込み方、 ABEJAでの取り組み4例、ここ2週間のトピックなど行けるところまで
shogomuranushi
5
1.9k
FPが教える iDeCo のすごさ
shogomuranushi
0
130
AWS Control Tower導入してハッピーになりました
shogomuranushi
0
240
EKS を使ってる人から見た App Runner
shogomuranushi
7
2.4k
顧客のアプリケーションコードが動くマルチテナント環境における課題とEKSにたどり着くまで
shogomuranushi
0
1.6k
ちょいテク100本ノック。できるまで帰しません 。今から使えるちょいテク集
shogomuranushi
1
2.7k
after of Infrastructure-as-Code-is-very-tired
shogomuranushi
16
3.4k
what is Cloud Run?
shogomuranushi
2
110
Other Decks in Technology
See All in Technology
深層学習のリペア技術の最新動向と実際 / DNN Repair Techniques for AI Performance Alignment for Safety Requirements
ishikawafyu
0
490
ファインディの4年にわたる技術的負債の返済 / Repaying 4 Years of Technical Debt at Findy
ma3tk
7
3.8k
Classmethod_regrowth_2024_tokyo_security_identity_governance_summary
hiashisan
0
530
「品質とスピードはトレード・オンできる」に向き合い続けた2年半を振り返る / Quality and speed can be traded on.
mii3king
0
670
pmconf2024_UPSIDER
upsider_tech
0
7.4k
AWS認定試験の長文問題を早く解くコツ
keke1234ke
0
170
LangChainとSupabaseを活用して、RAGを実装してみた
atsushii
0
160
検証と資産化を形にするプロダクト組織へ/tapple_pmconf2024
corin8823
1
9.4k
【AWS re:Invent 2024】Amazon Bedrock アップデート総まとめ
minorun365
PRO
7
590
PR TIMESにおけるNext.jsとcacheの付き合い方
apple_yagi
2
200
職能を超えたモブプログラミングが品質に与えた良い影響
tonionagauzzi
1
180
ARRが3年で10倍になったプロダクト開発とAI活用の軌跡
akiroom
0
240
Featured
See All Featured
Done Done
chrislema
181
16k
Bootstrapping a Software Product
garrettdimon
PRO
305
110k
Navigating Team Friction
lara
183
15k
Practical Tips for Bootstrapping Information Extraction Pipelines
honnibal
PRO
10
780
Designing on Purpose - Digital PM Summit 2013
jponch
116
7k
How to Create Impact in a Changing Tech Landscape [PerfNow 2023]
tammyeverts
48
2.2k
Save Time (by Creating Custom Rails Generators)
garrettdimon
PRO
27
890
How STYLIGHT went responsive
nonsquared
95
5.2k
Raft: Consensus for Rubyists
vanstee
136
6.7k
Bash Introduction
62gerente
608
210k
Embracing the Ebb and Flow
colly
84
4.5k
GraphQLとの向き合い方2022年版
quramy
44
13k
Transcript
Japan Datadog User Group Meetup#1 ABEJA, Inc. Shogo Muranushi Suggested
Topicͷ࣭ʹՄೳͳݶΓ͑ͯΈͨ
@rwle1212 2
@rwle1212 3 ໊લ ɿ ଜओ ޛʢΉΒ͵͠ ͠ΐ͏͝ʣ ձࣾ ɿ ABEJA,
Inc. ۀ ɿΠϯϑϥΤϯδχΞ -> ϓϩμΫτΦʔφʔ -> SRE
@rwle1212 4 Datadogྐྵ 2΄ͲɻInfra ͱ Logs ͷར༻͕ϝΠϯɻ Datadogࡉ͔͍ػೳ͕ଟ͘ɺͿͬͪΌ͚Α͔ͬͯ͘ͳ͍ɻ ࠓ͢͜ͱ͋͘·Ͱฐࣾͷ͍ํͳͷͰਖ਼ղͰͳ͍ɻ ৭ʑΓ͍ͨͷͰΈΜͳͰใ࣋ͪدΓͨ͘ɺ
·ͣొஃͯ͠Έͨɻ
@rwle1212 5
@rwle1212 6
@rwle1212 7 Datadogར༻نײ docker.containers.running Datadog Logs by weekly
@rwle1212 8 ຊʹೖΓ·͢
@rwle1212 9 ͍ͬͯΔػೳͦͷλΠϛϯά (ʮৼΓฦΓͰ͜ΜͳμογϡϘʔυΛ͍ͬͯΔʯͳͲ) • Α͘͞ΘΔػೳLogsͱNotebooks • ཧ༝λΠϛϯάޙड़
@rwle1212 10 μογϡϘʔυͲ͏ͬͯઃܭͯ͠·͔͢ʁ ΅͘ͷ͔Μ͕͍͖͑ͨ͞ΐ͏ͷμογϡϘʔυ ͲΜͳDashboardͰӡ༻͍ͯ͠Δ͔ɻ εϚʔτͳμογϡϘʔυͷ࡞Γํ μογϡϘʔυ͑ͯͬͯ·ͤΜɻ ཧ༝ʮ΅͘ͷ͔Μ͕͍͖͑ͨ͞ΐ͏ͷμογϡϘʔυʯʹͳͬͯ͠·͏͔ΒͰ͢ɻ
@rwle1212 11 ࣦഊྫ1: ݁ہCloudWatchΛݟ͍ͯͨ ALB -> Container -> EC2 ->
RDSͱ͍͏ϦΫΤετͷྲྀΕͰμογϡϘʔυΛ࡞ͬ ͯΈͨɻ μογϡϘʔυͷେ͖ܾ͞·͍ͬͯΔɺͭάϥϑ͕ଟ͗ͯ͢ෳࡶʹͳΔͷ ͰɺεϚʔτʹগͳΊʹάϥϑΛஔͨ͠ɻ ͔͠͠ো࣌ʹใ͕Γͳ͍ͷͰɺ݁ہCloudWatchΛோΊ͍ͯͨ͜ͱʹؾ͍ ͨɻ ͔ͦ͜ΒඞཁͳάϥϑΛ͍ͯ͘͠ͱͲΜͲΜෳࡶʹͳΓɺଞͷϝϯόʔʮԿΛ Ͳ͏ݟͨΒྑ͍ͷ͔Θ͔Βͳ͍ʯঢ়ଶʹͳͬͨɻ ݁ہCloudWatchΛோΊ͍ͯͨ͜ͱʹؾ͍ͨɻ
@rwle1212 12 ࣦഊྫ2: μογϡϘʔυͷछྨ͕૿͑ΔͱΑ͘Θ͔Βͳ͘ͳΔ
@rwle1212 13 ղܾྫ NotebookΛͬͯΈͨ • ো࣌ɺௐࠪ࣌ʹඞཁͳಛఆͷάϥϑ ͕ஔ͞Ε͍ͯΔෛՙ֬ೝ༻ͷ NotebookΛ࡞ • ܦա؍ΛݟΔͨΊͷάϥϑ͕ஔ͞
Ε͍ͯΔNotebookΛ࡞ ͳͲ
@rwle1212 14 ղܾྫ NotebookΛͬͯΈͨ • Jupyter Notebook Likeͳ͍ํ͕Ͱ͖ ͯɺίϝϯτͱάϥϑΛॻ͚Δ •
ಛఆͷোʹରͯ͠ௐͨ͜ͱɺਪଌ ͳͲͷίϝϯτΛॻ͖ͳ͕Βه͕ ͤΔ • ϩάͷάϥϑԽ༰қ • Issueʹը૾ΛషΓ͚ΔΑΓεϜʔ ζʹ·ͱΊΒΕΔͷͰڞ༗ָ͕͘͢͝
@rwle1212 15 ղܾྫ NotebookΛͬͯΈͨ • ͭ·Γ൚༻తͳμογϡϘʔυ࡞ͤͣʹɺCloudWatchͳͲͷશମΛ၆ᛌͰ ͖ΔϝτϦΫεΛݟͭͭɺϩάΛάϥϑԽͨ͠Γͯ͠ɺಛఆͷোʹ߹Θͤͯ ඞཁͳάϥϑΛஔͨ͠NotebookͰௐࠪܦա؍Λߦ͍ͬͯΔ
@rwle1212 16 ͦͦΈͳ͞ΜͲͷػೳԡ͠? ͱ͍͏͜ͱͰNotebooksΛਪͯ͠·͢ɻ ͋ͱLogsྑ͍ࢠͰ͢ɻޙड़Ͱ·ͱ·͍ͬͯ·͢ɻ
@rwle1212 17 ϦΫΤετ࣌ͷrateΞϥʔτ੍ํ๏ʹ͍ͭͯ ϦΫΤετͷࢹͯ͠·ͤΜ
@rwle1212 18 terraformҎ֎Ͱͷཧํ๏ ओʹຊ൪༻TerraformɻͱΓ͋͑ͣͷ࣌खͰ࡞Δɻ खͰ࡞ͬͨͷͱTerraformͰ࡞ͬͨͷ͕ࠞࡏ͢Δͱɺຊ൪༻ͳͷ͔ɺΞϥʔτΛ ์ஔͯ͠ྑ͍ͷ͔Α͔͘Βͳ͘ͳΔͷͰʮCreateByTerraformʯTagΛ༩ͯ͠ ผ͍ͯ͠Δ
@rwle1212 19 ՝ۚཧʹؔ͢Δେٕখٕ ಛʹେٕແ͠ɻখωλ͕͋Δͱͨ͠Β • Multi OrgڥBilling͕ू͞Εͯ͠·͏ɻʮLast Month’s UsageʯͰར༻ྔʢྉ ۚͰͳ͍ʣ͕Orgຖʹग़ྗ͞ΕΔͷͰ҈͍ͯ͠ΔɻӦۀ͞Μʹݴ͑Billing
͚ͯ͘ΕΔ͔ʁखؒͳͷͰͦ͜·Ͱͬͯͳ͍ • AWSΠϯςάϨʔγϣϯͰͨ͘͞ΜͷαʔϏεͷϝτϦΫεΛऔΕΔΑ͏ʹ͢Δ ͱɺCloudWatch ͷ GetMetricData API ͕ΊͪΌͪ͘Όݺͼग़͞ΕΔͷͰ՝͕ۚ େ͖͘૿͑Δɻ·ͣඞཁͳαʔϏε͚ͩߜͬͯऔΓࠐΉͷ͕٢ɻ SQSͰࢮͨ͠ܦݧ༗Γ
@rwle1212 20 ՝ۚཧʹؔ͢Δେٕখٕ • LogsʮͲΕ͕Կ݅ʯͱ͔ݟΕΔͷͰɺͨ·ʹෆཁͳϩά͕ແ͍͔֬ೝͯ͠ ʮIndexsʯͰআ֎ϑΟϧλΛ࡞ͯ͠ϩάͷ՝ۚΛ͑ͨΓ͢Δ ʢIndexed Logsͷ՝ۚࢭ·Δ͚ͲɺIngested Logsͷ՝ۚࢭ·Βͳ͍ͷͰҙɻ͍͔҆Βؾʹ͢Δ ΄ͲͰͳ͍͚Ͳʣ
@rwle1212 21 DBϞχλϦϯάͷTips͋Ε͜Ε CloudWatchΛIntegrationͯ͠ΔҐͰͦΕҎ্ͷ͜ͱ͓ͯ͠Γ·ͤΜ
@rwle1212 22 GoogleAnalyticsAPIར༻ͨ͠ݱࡏϢʔβʔͱ͔࠾औͯ͠ ͍Δࣄྫ͕͋Ε GoogleAnalyticsAPI༻͓ͯ͠Γ·ͤΜ
@rwle1212 ࡢͷ12݄ʹҎԼͷهࣄΛॻ͖·ͨ͠ 23 ଞͷࢹSaaSʢ͕ࣗΔൣғͰZabbixɾ PrometheusɾNew RelicɾMackerelʣͱͷൺֱ
@rwle1212 24 ʲཁʳͳͥPrometheusΛࣙΊͯDatadogΛ࠾༻ͨ͠ͷ͔ • Datadog͔ΒPrometheusΓ͑ • ݩʑDatadogΛ͍ͬͯͨɻ$18/host͕ߴ͔ͬͨ͠ɺKubernetesͷࢹͷσϑΝΫ τʹͳΓͭͭ͋ΔPrometheusΛࢼ͢తؚΊ͍ͯ࢝Ίͨɻ • ܦաɻPrometheusࣗମͷো͕νϥϗϥ
• OSSͰใগͳ͍߹ௐࠪʹ͕͔͔࣌ؒΔɻଟ͍࣌िʹ1,2ճ΄Ͳ͕ൃੜ ͠1,2ਓ͕࣌ؒ/ि΄ͲऔΒΕ͍ͯͨ • ελʔτΞοϓਓ͕͍ͳ͍ɻຊۀͷ։ൃʹूத͍ͨ͠ • πʔϧͷ͓कΓʹ͕࣌ؒऔΒΕ͍ͯͨɻPrometheusͷӡ༻Λ֎෦ʹҕୗ͍ͨ͠ɻ ӡ༻Λ֎෦ʹҕୗ͢Δͱ͍͘ΒʹͳΔ͔͔Βͳ͍͚ͲɺࠓͷنΛDatadogʹม ͑Δͱ10ສ/݄͘Β͍ͩͬͨɻɾɾDatadogͰΑ͘Ͷʁͱࢥ͍࢝ΊΔ
@rwle1212 25 ʲཁʳͳͥPrometheusΛࣙΊͯDatadogΛ࠾༻ͨ͠ͷ͔ • ϩάͷऩूͲ͏͢Δ • CloudWatch LogsΛ͍͕ͬͯͨݕࡧੜօແɻʢ࣌ʣPrometheusϩάऩू ͢Δػೳͳ͍ɻσϑΝΫτతʹ ElasticSearch
+ Kibana ͩΖ͏ • ͔͠͠ɺͦͷ࣌Ͱϩάྔ͕5ԯ/݄ɻঃʑʹରͷΞϓϦνʔϜΛ૿ͦ͏ͱࢥ ͏ͱϲ݄Ͱഒʑʹ૿͍͑ͯ͘͜ͱ͕ఆ͞Ε͍ͯͨ • ͦΕΛElasticSearchͰड͚ͳ͕Βӡ༻͢Δ͜ͱΛఆ͢Δͱɺख͕औΒΕͦ͏ײ͕ ͳ͔ͬͨ • DatadogϩάͷαʔϏεΛఏڙ࢝͠Ί͍ͯͨͷͰͬͯΈΔ͜ͱʹ
@rwle1212 26 ʲཁʳͳͥPrometheusΛࣙΊͯDatadogΛ࠾༻ͨ͠ͷ͔ • ϩάͲ͏͢Δ͔ͷ݁ • Facets ͕ڧྗͰɺಋೖָ͕ɺίετίϯτϩʔϧ͘͢͠ɺԿ͔͋Εશϩά Λ͑Δɻͦͷ্Ͱɺϩάऩू͢Δ্ͰΠϯϑϥΛؾʹ͠ͳͯ͘ྑ͍ͷ͕ؾʹೖ ΓɺঃʑʹϩάΛ
Datadog Logs ʹدͤ·ͨ͠ • ͦͯ͠ɺϞχλϦϯά Promethes ͔Β Datadog Ҡߦ • ͳͥPrometheusΛࣙΊͯDatadogΛ࠾༻ͨ͠ͷ͔ɺͷ·ͱΊ • ϩάϞχλϦϯά ͦΕ͕ࣄۀͷίΞͰ͋ΕͪΌΜͱߏங͠ӡ༻͢Δ͜ͱࣗ ମԀΘͳ͍ͷͰ͕͢ɺίΞͰͳ͍ͳΒ࣌ؒΛׂ͖ͨ͘ͳ͍
@rwle1212 ZabbixɺPrometheus ͷ؍͔Β͢ΔͱɺػೳੑͰͳ͘ӡ༻ੑͰஅ͍ͯ͠ΔͷͰOSSܥΑ΄ Ͳಛతͳػೳཁ͕݅ͳ͍ݶΓੵۃతͳ࠾༻ආ͚͍ͨͰ͢ 27 ଞͷࢹSaaSʢ͕ࣗΔൣғͰZabbixɾ PrometheusɾNew RelicɾMackerelʣͱͷൺֱ
@rwle1212 New RelicɺMackerel ྆ํͱݕূ͍ͯ͠ͳ͍ͷͰൺֱʹͳΒͳ͍Ͱ͕͢ɺݕূ͠ͳ͔ͬͨ ཧ༝ͷҰͭͱͯ͠ɺDatadogͰʮMonitoring Modern Infrastructureʯͱ͍͏ه ࣄ͕ެ։͞Ε͍ͯ·͢ɻ ͜͜ʹॻ͔Ε͍ͯΔ༰͕ͱͯཧʹ͔ͳ͍ͬͯͨͷͰɺ͜ͷΑ͏ͳࢥʹ ΑͬͯαʔϏε͕ઃܭ͞ΕࠓޙαʔϏεΛՃ͍ͯ͘͠ΜͩΖ͏ͳͱࢥ͍ɺ
࠾༻ͨ͠എܠ͋Γ·͢ɻ 28 ଞͷࢹSaaSʢ͕ࣗΔൣғͰZabbixɾ PrometheusɾNew RelicɾMackerelʣͱͷൺֱ
@rwle1212 29 SLOؔ࿈ͷϞχλʔ࡞ݕ౼Ͱࠔͬͨ͜ͱɾͨ͜͠ͱ ͋·Γ͍͠ػೳͰͳ͍ͷͰಛʹͳ͠ʁ ڧ͍ͯ͋͛ΔͳΒʮԿΛSLOͱͯ͠ܭଌ͢Δ͔ʯͷɺͦͦͷSLOͷఆ͕͍ٛ͠ ͘Β͍Ͱ͢ɻ
@rwle1212 30 Datadogͷڭ׆ಈ ʢͲͷׂͷΤϯδχΞ·Ͱ͍ͬͯΔ͔ʁʣ • ޮՌ͋ͬͨ͜ͱ • Dev/Stg/ProdͷશΞϓϦͷϩάΛશ෦ूͨ͠ɻ1ͭͷWebαΠτΛݟʹ ͍͘͜ͱͰશ෦ͷϩά͕ݟΕΔঢ়ଶʹͨ͠ɻࠓ·ͰڥຖʹݟΔॴ͕ ͔ΕͯͨΓɺग़ͯͨΓग़ͯͳ͔ͬͨΓ
• ͔ͦ͜ΒঃʑʹDatadogͷ͍ํΛೝࣝ͠ɺMonitorsNotebooksɺAPM ʹϝϯόʔͷڵຯ͕͕ͬͯߦͬͨ
@rwle1212 31 Datadogͷڭ׆ಈ ʢͲͷׂͷΤϯδχΞ·Ͱ͍ͬͯΔ͔ʁʣ • ޮՌ͋·Γͳ͔ͬͨ͜ͱ • Datadogͷ͍ํษڧձɻʮʔɻ͜Μͳ͜ͱͰ͖ΔΜͩʯͱ͍͏͚ͩͰखΛ ಈ͔͞ͳ͍ͷͰฉ͍ͯΕΔ •
ϩάɺϝτϦΫεΛՄೳͳݶΓूͯ͠ɺඞཁʹۦΒΕͯࣗͰௐͯ ͯ͠Β͏ํ͕͕֮͑ྑͦ͞͏ͳؾ͕ͨ͠ɻݴ͏ͯ͘͠ͳ͍ͷͰ • ͋Δఔͨ͠Βʮ͓Εͷ͔Μ͕͍͖͑ͨ͞ΐ͏ͷDatadogڞ༗ձʯΛ֤ϝ ϯόʔͰখωλతʹΔͷѱ͘ͳ͔ͬͨ
@rwle1212 32 Datadogͷڭ׆ಈ ʢͲͷׂͷΤϯδχΞ·Ͱ͍ͬͯΔ͔ʁʣ • ͲͷׂͷΤϯδχΞ·Ͱ͍ͬͯΔ͔ • ͍ͬͯΔͷΠϯϑϥɺόοΫΤϯυ • ϑϩϯτΤϯυͷE2Eࢹܥগ͠ߴ͍ͷͰ͍ͬͯͳ͍
• Real User MonitoringɺSynthetic Monitoring (Browser)
@rwle1212 33 ΠϯςάϨʔγϣϯͰ͍ͯ͠Δ͜ͱʢSlack / JIRAͱ Έ߹ΘͤͯɺΠϯγσϯτཧɾཧʹར༻ͳͲʣ WarningʮSlack௨ʯ AlertʮSlack௨ʯ+ʮPagerDutyͰిʯ+ʮGitHub Issue࡞(Zapierܦ༝)ʯ
@rwle1212 34 Ξϥʔτͷ௨Ϩϕϧཧ ʢฐࣾwarn / error / fatal ͳͲʣ •
WarnͱErrorͷΈ • ʮαʔϏεʹӨڹ͕Ͱ͍ͯΔϞϊɺͰ͍ͯΔՄೳੑ͕͋ΔϞϊʯΛΞϥʔτ ͱͯ͠ઃఆ͍ͯ͠Δ • ྫʣCPUϝϞϦͷ༻Λࢹͱ͔͍ͯ͠ͳ͍ɻͦΕΒͷӨڹʹΑͬ ͯALBͰ5xx͕සൃ͢ΕΞϥʔτ͕ඈͿΑ͏ʹ͍ͯ͠ΔɻDynamoDBͷ εϩοτϦϯάͱ͔
@rwle1212 35 datadog logsʹ͍ͭͯ༻ײࣄྫ
@rwle1212 36 facets • JSONͰૹΕউखʹύʔεͯ͘͠ΕΔ • ύʔε͞ΕͨΛfacets(index)Ͱ͖ΔͷͰɺϩ άͷQueryGroup ByͳͲʹར༻Ͱ͖Δ
@rwle1212 37 facets • Կ͕ѱ͍ͷ͔Θ͔Βͳ͍͚ͲɺindexͰ͖ͳ͍ ͕࣌͋Δɻ୭͔ղܾํ๏Λڭ͑ͯཉ͍͠ • ͜ͷέʔεͷ߹Ҏ֎ͷจࣈྻ͕ೖͬ ͪΌͬͯΔͷ͔ͳɾɾʁͬ͟ͱோΊͨײͦ͡Μ ͳ͜ͱͳ͍͚ͲɺͦΕΛ؆୯ʹݟΔʹͲ͏͠
ͨΒྑ͍ΜͩΖ͏ɾɾ
@rwle1212 38 Graph by Logs • ϩάΛάϥϑԽͰ͖Δ • facetsʹొͨ͠ΛGroup Byʹࢦఆͨ͠Γɺ
CountʹೖΕΔ͜ͱͰ͖Δ • ࠨਤͷྫͰɺOrganization NameຖͷϦΫΤ ετฏۉԠ࣌ؒͳͲΛදࣔɻίϯςφID ຖʹݟͯภΓ͕ແ͍͔ݟͨΓͯ͠Δ • γεςϜܥ͚ͩͰͳ͘ΞϓϦͷར༻ঢ়گੳ ʹ༻ՄೳͳͷͰɺΞϓϦଆͰ͖ͳΛग़ ͤ৭ʑͳ؍ͰੳͰ͖Δ • ᮢΛઃ͚ͯΞϥʔτൃ๒Ͱ͖ΔͷͰ1ͭͷγ εςϜͰϝτϦΫεɾϩάͷࢹΛཧͰ͖Δ
@rwle1212 39 Graph by Logs • େ͖͍มߋΛͨ࣌͠εςʔλείʔυͷׂ߹ Λ֬ೝ • ઃఆํ๏
• Group By: @http.status_code • Display: Areas • Stacked as: % of overall count: *
@rwle1212 40 Pipelines • JSON͡Όͳ͍ϩάΛύʔεͨ͠ΓɺDatadog ্Ͱʮ͜ͷϑΟʔϧυεςʔλεѻ͍͢Δʯ ͱ͍͏Α͏ͳϚοϐϯάΛߦ͏ • NginxRedisͳͲҰൠతͳϛυϧΣΞͷϩά IntegrationΛೖΕΕউखʹύʔεͯ͘͠Ε
ΔͷͰࣗͰgrokॻ͘ඞཁ͕ͳ͘ศར • ԼਤͷΑ͏ʹܭࢉࣜΛೖΕͨΓɺผ໊ʹม͑ͨ Γ͢Δ͜ͱͰ͖Δ
@rwle1212 41 Indexes • ϩάऩूͷআ֎ϑΟϧλ͕ॻ͚ΔɻIndexed LogsͰ՝ۚ͞Εͳ͘ͳΔ • 10%͚ͩऔಘ͢Δͱ͍͏͜ͱՄೳɻΫΤϦͰ ͔ͳΓߜΓࠐΉ͜ͱ͕Ͱ͖Δ •
ϩάΛૹ৴͢ΔAgent/ClientଆͰίϯτϩʔϧ ͢Δ͜ͱՄೳ͕ͩɺઃఆϑΝΠϧͷ͕ ໘ͳͷͰ͍ͬͨΜશ෦Datadogʹ͛ͯɺ IndexsͰϩάΛམͱ͢ͱ͍͏͍ํ͕Φεε ϝɻʢ҆Ձ͚ͩͲIngested Logsͷ՝ۚൃੜ͢ ΔͷͰҙʣ
@rwle1212 42 Archives • Datadogͷϩάܖظؒʢ7ͱ͔15ͱ ͔ʣ͔͠ݟΕͳ͍ • աڈϩάظؒอଘ͍ͨ͠߹ArchivesͰ S3GCSʹஷΊΔ͜ͱ͕Ͱ͖ΔͷͰɺAthena BigQueryͰݟΔ͜ͱͰ͖Δ
• Fluentdͱ͔ͰS3ʹૹΔ͜ͱͰ͖Δ͚Ͳɺ Datadogͷ߹ͱΓ͋͑ͣऩू͢ΔઃఆϑΝ ΠϧΛૹ৴͢Δ͚ͩͰྑ͍ͷͰɺઃఆϑΝΠϧ ͷΒ·͖ߋ৽͕ͳָ͍
@rwle1212 43 Archives • Rehydrate From Archivesͱ͍͏ػೳΛ͑ ArchivesʹೖͬͯΔσʔλΛDatadog Logsʹ ͢͜ͱ͕Ͱ͖ΔΈ͍ͨʁ͚ͩͲͬͨ͜ͱͳ͍
ͷͰҙ͕Θ͔ͬͯͳ͍ɻ୭͔ڭ͑ͯ
@rwle1212 44 datadog logsʹ͍ͭͯ༻ײࣄྫ ΞϓϦͷϩάΛDatadog LogsʹೖΕ͍ͯΔͷͰɺ΄΅ຖ౷ܭతʹݟͯҟৗ͕ແ͞ ͦ͏͔βοͱݟ͍ͯΔɻ ඞཁ͋ΒਂງΓ͢ΔͨΊʹ Graph Ͱ৭ʑͳ؍Ͱੳͨ͠Γɺه࣌͢ɺܦ
ա؍͢ΔNotebooksΛ࡞ͬͯܧଓతʹ༷ࢠΛݟͨΓ͍ͯ͠Δɻ
@rwle1212 45 ΠϕϯτใʹσϓϩΠΠϕϯτͳͲɺͲΜͳͷΛૹͬ ͍ͯΔ͔ɻ ࿈ܞͤ͞ΔπʔϧΛ૿͢ͷ͕ݏͳͷͰ࿈ܞ͍ͤͯ͞·ͤΜ
@rwle1212 46 APMؔ࿈ɺAnomalyϞχλʔͷ༗༻ͳ͍ํ APMɺAnomaly͍͜ͳ͓ͤͯΓ·ͤΜ
@rwle1212 47 LogsઃఆͷϕετϓϥΫςΟε • ͱΓ͋͑ͣ • શ෦ͷϩάΛ1Օॴʹू͢Δɻѹతޮ্͕Δ • Pipeline •
ύʔεͰ͖Δ͚ͲɺͰ͖ΔݶΓJSONͰૹ৴ͯࣗ͠ಈతʹύʔεͯ͠Β͏ • εςʔλεͱ͔Ϛοϐϯάͯ͠ɺϏϡʔϫʔͷ੨ɾԫɾ৭දࣔͰҰྎવʹ͢Δ • Indexes • ίετݮ͢ΔͨΊʹݟͳ͍ϩάআ֎͢Δ • Archives • ೦ͷͨΊաڈϩάS3/GCSʹอଘ͢Δ • S3/GCSଆͰҰఆظؒޙʹࣗಈআ͢ΔΑ͏ʹϥΠϑαΠΫϧΛೖΕΔ
48 ͝੩ௌ͋Γ͕ͱ͏͍͟͝·ͨ͠