Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
Critical Path Analysis
Search
JBD
February 06, 2019
0
510
Critical Path Analysis
JBD
February 06, 2019
Tweet
Share
More Decks by JBD
See All by JBD
eBPF in Microservices Observability at eBPF Day
rakyll
1
2.1k
eBPF in Microservices Observability
rakyll
1
1.6k
OpenTelemetry at AWS
rakyll
1
1.8k
Debugging Code Generation in Go
rakyll
5
1.5k
Are you ready for production?
rakyll
8
2.7k
Servers are doomed to fail
rakyll
3
1.5k
Serverless Containers
rakyll
1
240
Monitoring and Debugging Containers
rakyll
2
1.1k
CPDD
rakyll
0
4.1k
Featured
See All Featured
Making Projects Easy
brettharned
115
5.9k
The MySQL Ecosystem @ GitHub 2015
samlambert
250
12k
It's Worth the Effort
3n
183
27k
What’s in a name? Adding method to the madness
productmarketing
PRO
22
3.1k
Automating Front-end Workflow
addyosmani
1365
200k
Sharpening the Axe: The Primacy of Toolmaking
bcantrill
37
1.8k
BBQ
matthewcrist
85
9.3k
Git: the NoSQL Database
bkeepers
PRO
425
64k
Facilitating Awesome Meetings
lara
49
6k
How To Stay Up To Date on Web Technology
chriscoyier
788
250k
Fantastic passwords and where to find them - at NoRuKo
philnash
50
2.8k
Stop Working from a Prison Cell
hatefulcrawdad
267
20k
Transcript
@rakyll
@rakyll
@rakyll We use facilities that are not reserved for our
flight but are essential in making it happen.
@rakyll We use facilities that are not reserved for our
flight but are essential in making it happen.
@rakyll
@rakyll Systems? who understands them?
@rakyll Jaana B. Dogan
[email protected]
@rakyll
@rakyll Growing...
@rakyll Tech stack gets fragmented, monoliths are gone...
@rakyll one becomes many failure in isolation escalation in failure?
@rakyll and it may get larger...
@rakyll good guy jeff
@rakyll
@rakyll
@rakyll code search
@rakyll go_library( name = "logs", srcs = ["logs.go"], visibility =
["//visibility:public"], deps = [ …. ], ) References (641 occurrences) - //source/ads/monitoring/BUILD - //source/ads/analysis/BUILD - //source/ads/mobile/BUILD ...
@rakyll frontend server authentication users images memcache blobservice memcache memcache
(metadata) (disks) load balancer
@rakyll frontend server authentication users images memcache blobservice memcache memcache
(metadata) (disks) load balancer critical path
@rakyll frontend server authentication users images memcache blobservice memcache memcache
(metadata) (disks) load balancer critical path
@rakyll frontend server authentication users images memcache blobservice memcache memcache
(metadata) (disks) load balancer critical path
@rakyll CPA (critical path analysis)
@rakyll discover the critical paths make them reliable and fast
make them debuggable
@rakyll How do we get there? (tracing, events, logs)
@rakyll Why? Why? Why? Why? Why?
@rakyll GET /timeline edge-lb sched api-server auth.Auth cache.Get mysql.Query user.Profile
cache.Get mysql.Query images.Filter blobstore.Get
@rakyll bare metal kernel network stack cloud stack libraries frameworks
your code
@rakyll GET /timeline edge-lb sched api-server auth.Auth cache.Get mysql.Query user.Profile
cache.Get mysql.Query images.Filter blobstore.Get not my fault
@rakyll GET /timeline auth.Auth cache.Get mysql.Query user.Profile cache.Get mysql.Query images.Filter
blobstore.Get cache.Get mysql.Query blob.Get where is the source code?
@rakyll GET /timeline auth.Auth cache.Get mysql.Query user.Profile cache.Get mysql.Query images.Filter
blobstore.Get cache.Get mysql.Query blob.Get who to call?
@rakyll GET /timeline auth.Auth cache.Get mysql.Query user.Profile cache.Get mysql.Query images.Filter
blobstore.Get cache.Get mysql.Query blob.Get give me the logs, runtime events, profiles...
@rakyll Challenges...
@rakyll This is an organizational problem. CHALLENGE #1:
@rakyll Engineers don’t know where to start. CHALLENGE #2:
@rakyll Infra is still a blackbox. CHALLENGE #3:
@rakyll Instrumentation is expensive. CHALLENGE #4:
@rakyll Dynamic capabilities are underestimated. CHALLENGE #5:
@rakyll
@rakyll A tool to close knowledge gaps (which we don’t
talk about)
@rakyll Fin
[email protected]