Upgrade to Pro — share decks privately, control downloads, hide ads and more …

eBPF in Microservices Observability at eBPF Day

Avatar for JBD JBD
October 11, 2021
Programming
1
2.2k

eBPF in Microservices Observability at eBPF Day

Avatar for JBD

JBD

October 11, 2021
Tweet

More Decks by JBD

See All by JBD
eBPF in Microservices Observability
Avatar for JBD rakyll
1
1.7k
OpenTelemetry at AWS
Avatar for JBD rakyll
1
1.9k
Debugging Code Generation in Go
Avatar for JBD rakyll
5
1.6k
Are you ready for production?
Avatar for JBD rakyll
8
2.9k
Servers are doomed to fail
Avatar for JBD rakyll
3
1.6k
Serverless Containers
Avatar for JBD rakyll
1
270
Critical Path Analysis
Avatar for JBD rakyll
0
670
Monitoring and Debugging Containers
Avatar for JBD rakyll
2
1.1k
CPDD
Avatar for JBD rakyll
0
4.2k

Other Decks in Programming

See All in Programming
副作用をどこに置くか問題：オブジェクト指向で整理する設計判断ツリー
Avatar for Koya Masuda koxya
1
550
DevFest Android in Korea 2025 - 개발자 커뮤니티를 통해 얻는 가치
Avatar for Suhyeon Kim wisemuji
0
190
CSC307 Lecture 07
Avatar for Javier Gonzalez-Sanchez javiergs
PRO
0
520
組織で育むオブザーバビリティ
Avatar for ryotaro kobayashi ryota_hnk
0
150
フロントエンド開発の勘所 -複数事業を経験して見えた判断軸の違い-
Avatar for Yoichiro Kubo heimusu
7
2.7k
MDN Web Docs に日本語翻訳でコントリビュート
Avatar for uutan1108 ohmori_yusuke
0
610
CSC307 Lecture 04
Avatar for Javier Gonzalez-Sanchez javiergs
PRO
0
650
Fragmented Architectures
Avatar for Denys Poltorak denyspoltorak
0
140
Deno Tunnel を使ってみた話
Avatar for すずとも kamekyame
0
350
Fluid Templating in TYPO3 14
Avatar for Simon Praetorius s2b
0
110
LLM Observabilityによる 対話型音声AIアプリケーションの安定運用
Avatar for Hiroyuki Moriya gekko0114
2
400
コントリビューターによるDenoのすゝめ / Deno Recommendations by a Contributor
Avatar for petamoriken / 森建 petamoriken
0
200

Featured

See All Featured
The Success of Rails: Ensuring Growth for the Next 100 Years
Avatar for Eileen M. Uchitelle eileencodes
47
7.9k
Design and Strategy: How to Deal with People Who Don’t "Get" Design
Avatar for Morgane Peng morganepeng
133
19k
Writing Fast Ruby
Avatar for Erik Berlin sferik
630
62k
Neural Spatial Audio Processing for Sound Field Analysis and Control
Avatar for NII S. Koyama's Lab skoyamalab
0
150
Visualization
Avatar for Eitan Lees eitanlees
150
16k
Exploring anti-patterns in Rails
Avatar for Elle Meredith aemeredith
2
230
The Cult of Friendly URLs
Avatar for Andy Hume andyhume
79
6.8k
Darren the Foodie - Storyboard
Avatar for Kevinho.art khoart
PRO
2
2.3k
The browser strikes back
Avatar for Jono Alderson jonoalderson
0
340
How to Grow Your eCommerce with AI & Automation
Avatar for Katarina Dahlin katarinadahlin
PRO
0
97
Game over? The fight for quality and originality in the time of robots
Avatar for Wayne Barker wayneb77
1
89
Reality Check: Gamification 10 Years Later
Avatar for Sebastian Deterding codingconduct
0
2k

Transcript

  1. @rakyll eBPF in Microservices Observability Jaana Dogan Principal Engineer, AWS

    [email protected]

  2. @rakyll About me • Not a Linux developer. • Working

    on monitoring, observability and performance. • Multi-tenancy and microservices focus.

  3. @rakyll

  4. @rakyll How does eBPF work? process JIT compiler Verifier Sockets

    TCP/IP BPF Maps code (accessible from the user space)

  5. @rakyll Where can eBPF hook into? - Kernel and user

    functions - System calls - Network events - Kernel tracepoints

  6. @rakyll Challenges in microservices

  7. @rakyll Challenges in microservices We don’t just monitor VMs or

    processes. We monitor critical paths.

  8. @rakyll What’s next? service service database storage service

  9. @rakyll What’s next? service service database storage service

  10. @rakyll Challenges in microservices Context matters. Downstream stack don’t have

    context.

  11. @rakyll What’s next? process Linux kernel process process M:N Problem

  12. @rakyll What’s next? process Linux kernel process process RPCs M:N

    Problem

  13. @rakyll What’s next? process Linux kernel process process RPCs container

    container M:N Problem

  14. @rakyll What’s next? process Linux kernel process process RPCs container

    container Kubernetes pod, ECS task M:N Problem

  15. @rakyll Challenges in microservices First, we debug the path of

    the request. We debug functions or syscalls secondarily.

  16. @rakyll Challenges in microservices Too much data. Need runtime controls

    to modify the collection.

  17. @rakyll Challenges in microservices Instrumentation is a two-year roadmap. Data

    is not consistent.

  18. @rakyll Recap Out of the box instrumentation is critical. Networking

    observability is essential. Extensibility in runtime is needed. Decoration and enrichment is needed.

  19. @rakyll How does eBPF help?

  20. @rakyll Network Diagnostics TCP, UDP, HTTP, gRPC metrics Inspect protocols

    (MySQL, Postgres, ...)

  21. @rakyll Network Diagnostics TCP, UDP, HTTP, gRPC metrics Inspect protocols

    (MySQL, Postgres, ...)

  22. @rakyll Service Maps

  23. @rakyll Distributed Traces Automatically create trace span if a trace

    header is present. Your job is to generate and propagate the header. GET /users HTTP/1.1 Host: users.service Accept-Encoding: gzip, deflate Connection: Keep-Alive Traceparent: 00-4bf92f3577b34da6a3ce929d0e0e4736-00f067aa0ba902b7-01

  24. @rakyll Continuous Profiling

  25. @rakyll Extensibility

  26. @rakyll Decorating with Context eBPF agent process JIT compiler Verifier

    Sockets TCP/IP BPF Maps API Server

  27. @rakyll Decorating with Context

  28. @rakyll Several projects... - Cillium/Hubble - Pixie - Flowmill -

    Prodfiler - Parca

  29. @rakyll What’s next? - High level language? - More platforms

    supporting eBPF? - Reusable eBPF event processors? - Signed programs?

  30. @rakyll Thank you Jaana Dogan [email protected]

  31. @rakyll After party? Pixie KubeCon Happy Hour hosted by New

    Relic Tomorrow, 8:30 PM PDT RSVP: pixiehh.eventbrite.com

  32. @rakyll Runtime Extensibility eBPF agent process JIT compiler Verifier Sockets

    TCP/IP BPF Maps code