Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Sign up for free
Menu
Search
Features
All features
Private URLs
Password Protection
Custom URLS
Scheduled publishing
Remove Branding
Restrict embedding
Deck Collections
Notes
Features
All features
Private URLs
Password Protection
Custom URLS
Scheduled publishing
Remove Branding
Restrict embedding
Deck Collections
Notes
Explore
Featured decks
Featured speakers
Programming
Technology
Storyboards
Explore
Featured decks
Featured speakers
Programming
Technology
Storyboards
Pricing
Search
Sign in
Sign up for free
AWSのマネージドサービスを活用したログ可視化
Search
Shinji Fujimoto
February 11, 2017
Technology
3.6k
1
Share
Embed
Copy iframe code
Copy JS code
Copy link
Start on current slide
AWSのマネージドサービスを活用したログ可視化
2017/02/11 合同勉強会 in 福岡
Shinji Fujimoto
February 11, 2017
Transcript
39 slides
AWS ͷ αʔϏεΛ׆༻ͨ͠ ϩάՄࢹԽ ߹ಉษڧձ in Ԭ 2017/02/11 ౻ຊ ਅ࢘
ࣗݾհ • ౻ຊ ਅ࢘ • Work AWS Solutions Architect @Classmethod,
Inc. • Interest Elastic Stack
ձࣾհ
ձࣾհ "84ϞόΠϧɺϏοάσʔλͳͲ ࣾһ૯ग़Ͱ͖ͳΑ͏ʹϒϩάॻ͍͍ͯ·͢
AWSࣄۀ෦հ
AWSࣄۀ෦հ ओʹ"84ʹؔ͢Δϒϩάॻ͍͍ͯ·͢
ຊ͍͑ͨ͜ͱ
ϩάͷՄࢹԽ͕ ؆୯ʹͳΓ·ͨ͠
ΞδΣϯμ • ϩάՄࢹԽͬͯʁ • AWSͷαʔϏεΛ׆༻ͨ͠ϩάՄࢹԽ • Demo
ϩάՄࢹԽͬͯʁ
Έͳ͞Μ ϩάΛ׆༻͍ͯ͠·͔͢ʁ
ϩάͬͯԿ͚ͩͬʁ • ޠݯ • ߤւͷધͷΛଌΔͨΊʹ ؙଠ(log)ʹҰఆִؒͷ͋ΔೄΛׅΓ͚ ͨͷ ʢग़యɿWikipediaʣ
ԿͰϩά͕ඞཁʁ • ࢹɺΞϥʔςΟϯά • োௐࠪ • ύϑΥʔϚϯεղੳ • σʔλੳ
ԿͰϩάͷՄࢹԽ͕ඞཁʁ • มԽͷؾ͖ͮΛಘΔ • োͷ༧ஹɺधཁͷ༧ଌ • આ໌ͷઆಘྗ • จࣈࣈΑΓҰྎવ
ϩάՄࢹԽͷ՝
ϩάՄࢹԽͷ՝ • δϣϒεέδϡʔϦϯά • ETL • ՄࢹԽπʔϧͷબఆ
ϩάՄࢹԽͷ՝ • δϣϒεέδϡʔϥ • ϦΞϧλΠϜͳͷ͔ɺόονͳͷ͔ • ޭɺࣦഊͷఆ • ϦτϥΠॲཧ
ϩάՄࢹԽͷ՝ • Extract • Ͳ͔͜ΒϩάΛऔಘ͢Δ͔ • Transform • ՄࢹԽ͍ͨ͠ใɺܗࣜͷม •
Load • ՄࢹԽπʔϧͷσʔλೖ
ϩάՄࢹԽͷ՝ • ՄࢹԽπʔϧͷબఆ • Kibana • Grafana • re:Dash •
Superset • Google Data Studio • etc.. etc..
AWS ʹ͓͚ΔϩάՄࢹԽ
Amazon Elasticsearch Service
Amazon Elasticsearch Service • Elasticsearch • ݕࡧʗੳΤϯδϯ • Kibana •
ՄࢹԽɺμογϡϘʔυԽ • ४ϦΞϧλΠϜʹՄࢹԽ
Amazon Elasticsearch Service • Elasticsearch + Kibana ͷϚωʔδυαʔϏε • ΫϦοΫͰڥߏங
• ӡ༻ AWS ʹ͓ͤ • ࣍εφοϓγϣοτͷऔಘ • ো࣌ͷ෮چରԠ
Amazon Elasticsearch Service Lambda S3 EC2 Elasticsearch Service
Amazon Elasticsearch Service • 2017/01/31 Ξοϓσʔτ • Elasticsearch / Kibana
5 ܥʹରԠ • εΫϦϓτͷར༻Մ • Ingest Node • Kibana ͷ DevTools Timelion Λར༻Մ
Amazon Athena & Amazon QuickSight
͜ͷαʔϏε͍ͬͯ·͔͢ʁ Amazon Athena Amazon QuickSight
Amazon Athena • AWS re:Invent 2016 ൃදˍϦϦʔε • S3 ͷඇߏԽσʔλʹ
SQL ͰߏԽσʔλ ΛऔΓग़͢
Amazon Athena • αʔόʔϨε • ӡ༻ෆཁɻ͍͍ͨ࣌ʹ͑Δ • ߴͳύϑΥʔϚϯε • 1000ສ݅ͷςΩετͷूܭ͕ඵ
• ίετ • εΩϟϯରαΠζ՝ۚɹ5$ / TB
Amazon QuickSight • AWS re:Invent 2015 ൃදɻ2016/11ϦϦʔε • AWS ۘ
BI πʔϧ
Amazon QuickSight • αʔόʔϨε • SPICE ʹΑΔߴͳՄࢹԽ • ଟ͘ͷ AWS
αʔϏεʹରԠ • ίετͳ BI πʔϧ
Amazon Athena & QuickSight
͍ॲ ʢ˞ϩάՄࢹԽͷ؍ʣ
Ϣʔεέʔε • Elasticsearch Service • χΞϦΞϧλΠϜͳଟ࣍ݩੳ • Athena & QuickSight
• ΞυϗοΫͳੳ
ར༻ίετ • Elasticsearch Service • ElasticsearchΫϥελͷىಈ࣌ؒ • ྫ͑ɺr3.large 50GBσΟεΫ x
3 ౦ژϦʔδϣϯͷ߹ɺ$659 / ݄
ར༻ίετ • Athena & QuickSight • Athena ΫΤϦͨ͠ϑΝΠϧαΠζ • QuickSight
ϢʔβʔˍՃσΟεΫ • ྫ͑ɺ5Ϣʔβʔ 10TB εΩϟϯ $95 / ݄
ͦͷଞίετ • Elasticsearch Service • Elasticsearch ϩάΛೖΕΔͨΊͷΈ ͕ඞཁ • Kibana
ॳݟͰ৮Δʹਏ͍ • Athena & QuickSight • Athena SQL ͕৮ΕΕ͑ͨ • QuickSight ॳݟͰ৮Εͨ
Demo
·ͱΊ • ϩάͬͯຯ͚ͩͲେࣄ • ϩάՄࢹԽͷબࢶ͕Ճ͞Εͨ • ༻్ʹ͋ͬͨՄࢹԽΛબ • ՄࢹԽָ͍ͬͯ͠
More Decks by Shinji Fujimoto
See All by Shinji Fujimoto
AWS のサービスを活用して CI/CD #akibaaws
shinjifujimoto
0
19k
Amazon Elasticsearch Service の使いドコロ in 福岡
shinjifujimoto
1
800
Amazon Elasticsearch Service の使いドコロ
shinjifujimoto
3
55k
Amazon Elasticsearch Serviceを利用したAWSのログ活用 /amazones-aws-integration
shinjifujimoto
3
2.8k
はじめてのIoT
shinjifujimoto
0
5.6k
Beats開発の始め方 #cmdevio
shinjifujimoto
2
2.5k
Other Decks in Technology
See All in Technology
Frontier Teams — Amazon は AI で「開発のやり方」をどう変えたのか
kmotohas
0
300
その修正で本当に速くなったのか? k6とOpenTelemetryで確かめる性能改善 / Performance review with k6 and OpenTelemetry
ymotongpoo
3
250
「個社」ではなく「業界」の課題を解く AI 対話開発 ー 価値を広げる設計と、価値を守るエンジニアリング ー
ivry_presentationmaterials
3
710
SREのためのFinOps入門
muziyoshiz
3
1.6k
Why start a new company, on Rails and AI, today. SF Ruby Conf 2026, Irina Nazarova
irinanazarova
0
150
RAGの改善を速く回すための評価基盤
yosukeyoshida
6
3.3k
Del vibe coding a un Desarrollo (agéntico) fiable
jcabot
0
180
Biohub - Cell Tracking During Development 5th place solution
rist
0
180
高品質と高スピードを支える品質のシフトレフトのアプローチ
goyoki
4
1.7k
統制されたID・権限をどう利用するか : DPoP/FAPIによるAPIセキュリティ強化
oidfj
1
190
農家は秘伝のタレを知らない - NOBODY KNOWS THE HIDDEN SOURCE - Kaggriculture 3rd Place Solution
masspeaks
2
530
小さなエージェントから始めてみよう!実践コンテキストエンジニアリング
iwamot
PRO
0
130
Featured
See All Featured
Principles of Awesome APIs and How to Build Them.
keavy
128
18k
Practical Tips for Bootstrapping Information Extraction Pipelines
honnibal
25
2.2k
Claude Code どこまでも/ Claude Code Everywhere
nwiizo
68
60k
GraphQLとの向き合い方2022年版
quramy
50
15k
Self-Hosted WebAssembly Runtime for Runtime-Neutral Checkpoint/Restore in Edge–Cloud Continuum
chikuwait
0
960
Marketing Yourself as an Engineer | Alaka | Gurzu
gurzu
0
380
Making the Leap to Tech Lead
cromwellryan
135
10k
Improving Core Web Vitals using Speculation Rules API
sergeychernyshev
21
1.7k
A Guide to Academic Writing Using Generative AI - A Workshop
ks91
PRO
1
570
Reality Check: Gamification 10 Years Later
codingconduct
0
2.4k
個人開発の失敗を避けるイケてる考え方 / tips for indie hackers
panda_program
123
22k
Paper Plane
katiecoart
PRO
6
55k