Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
OpenTelemetry at AWS
Search
JBD
May 18, 2021
Programming
1
1.8k
OpenTelemetry at AWS
Register and watch this talk now!
https://o11yfest.org/attend
.
JBD
May 18, 2021
Tweet
Share
More Decks by JBD
See All by JBD
eBPF in Microservices Observability at eBPF Day
rakyll
1
2k
eBPF in Microservices Observability
rakyll
1
1.6k
Debugging Code Generation in Go
rakyll
5
1.5k
Are you ready for production?
rakyll
8
2.6k
Servers are doomed to fail
rakyll
3
1.5k
Serverless Containers
rakyll
1
240
Critical Path Analysis
rakyll
0
500
Monitoring and Debugging Containers
rakyll
2
1.1k
CPDD
rakyll
0
4.1k
Other Decks in Programming
See All in Programming
状態管理ライブラリZustandの導入から運用まで
k1tikurisu
3
470
大公開!iOS開発の悩みトップ5 〜iOSDC Japan 2024〜
ryunakayama
0
190
エンジニア1年目で複雑なコードの改善に取り組んだ話
mtnmr
3
2k
LangChainでWebサイトの内容取得やGitHubソースコード取得
shukob
0
160
Perl 5 OOP機構30年史 - Perl 5's OOP Mechanism over the past 30 years
moznion
0
270
Patched fetch did not work
quramy
4
380
Scala アプリケーションのビルドを改善してデプロイ時間を 1/4 にした話 | How I improved the build of my Scala application and reduced deployment time by 4x
nomadblacky
1
180
AndroidアプリのUIバリエーションをあの手この手で確認する / Check UI variations of Android apps by various means
tkmnzm
1
170
Our Websites Need a Lifestyle Change, Not a Diet
ryantownsend
0
150
Findy - エンジニア向け会社紹介 / Findy Letter for Engineers
findyinc
4
90k
メモリ最適化を究める!iOSアプリ開発における5つの重要なポイント
yhirakawa333
0
420
The Shape of a Service Object
inem
0
520
Featured
See All Featured
How to name files
jennybc
75
98k
Visualizing Your Data: Incorporating Mongo into Loggly Infrastructure
mongodb
38
9.2k
"I'm Feeling Lucky" - Building Great Search Experiences for Today's Users (#IAC19)
danielanewman
225
22k
Building Applications with DynamoDB
mza
90
6k
The Invisible Side of Design
smashingmag
296
50k
Keith and Marios Guide to Fast Websites
keithpitt
408
22k
Creating an realtime collaboration tool: Agile Flush - .NET Oxford
marcduiker
23
1.7k
Teambox: Starting and Learning
jrom
131
8.7k
Code Review Best Practice
trishagee
62
16k
Statistics for Hackers
jakevdp
794
220k
The Language of Interfaces
destraynor
153
23k
From Idea to $5000 a Month in 5 Months
shpigford
379
46k
Transcript
@rakyll OpenTelemetry at AWS Jaana Dogan Principal Engineer, AWS
[email protected]
@rakyll Who? Jaana Dogan, AWS Explicit focus on instrumentation
@rakyll Five AWS stories... Too many agents Too many formats
Too little correlation Too many ways to propagate Too many products to support
@rakyll Too many agents 4-5 agents Friction in installation Operational
burden Friction in configuration delivery Performance penalty
@rakyll Too many formats EMF CloudWatch Prometheus statsd Vendor formats
... X-Ray Zipkin Jaeger Vendor formats ...
@rakyll Too little correlation Tool fatigue Disjoint views Missing metadata
Friction in troubleshooting
@rakyll Too many ways to propagate Lack of end-to-end traces
Missing label propagation No W3C TraceContext or B3 support No runtime propagation standards
@rakyll Too many products to support CloudWatch X-Ray Prometheus Elasticsearch/OpenSearch
New Relic, Datadog, Splunk, Honeycomb, Lightstep and more.
@rakyll What do we use? Specification Context Propagation Semantic Conventions
Data Model Protocol (OTLP) Collector Client Libraries
@rakyll What’s next? collector Managed on EC2, ECS, EKS, Lambda,
etc.
@rakyll What’s next? collector Managed on EC2, ECS, EKS, Lambda,
etc.
@rakyll What’s next? collector Managed on EC2, ECS, EKS, Lambda,
etc. OTLP Prometheus statsd X-Ray Jaeger Zipkin
@rakyll What’s next? collector Managed on EC2, ECS, EKS, Lambda,
etc. OTLP Prometheus statsd X-Ray Jaeger Zipkin CloudWatch Prometheus X-Ray Elastic/OpenSearch Jaeger Zipkin Vendors Raw storage
@rakyll What’s next? collector Managed on EC2, ECS, EKS, Lambda,
etc. OTLP Prometheus statsd X-Ray Jaeger Zipkin CloudWatch Prometheus X-Ray Jaeger Zipkin Vendors Raw storage enrich, transform, ...
@rakyll Container Insights now collected by OpenTelemetry.
@rakyll What do we use? Specification Context Propagation Semantic Conventions
Data Model Protocol (OTLP) Collector Client Libraries
@rakyll What works well? Flexible Composable Lightweight enough Holistic Legacy
protocol friendly Community
@rakyll What challenges us? Stability Custom builds Compatibility (Prometheus &
CloudWatch) Boilerplate in client libraries
@rakyll What are we working on next?
@rakyll Prometheus
@rakyll Prometheus Drop-in replacement for Prometheus Data model changes Remote
write compliance Discovery + scrape config compliance Kubernetes operator
@rakyll Components Container Insights receivers and processors CloudWatch histogram compatibility
CloudWatch Logs exporter S3 exporter
@rakyll Propagation Adopting 128-bit trace IDs in X-Ray Context propagation
in SQL
@rakyll Platforms EC2 ECS EKS Lambda (and control plane components...)
@rakyll Lambda support
@rakyll Others... eBPF Profiles Real time user monitoring Network diagnostics
Database performance
@rakyll One more thing...
@rakyll Exporting to vendors? Vended data streams CloudWatch Metric Streams
support OTLP CW Metrics S3 (in JSON or OTLP) Kinesis (in JSON or OTLP)
@rakyll It’s not a fork. It’s a snapshot for security,
performance, support.
@rakyll Thank you Jaana Dogan Principal Engineer, AWS
[email protected]