Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
JCConf 2020 Observing in Microservices
Search
Shihyu Ho
November 18, 2020
Programming
0
730
JCConf 2020 Observing in Microservices
Lessons learned observing in Microservices
Shihyu Ho
November 18, 2020
Tweet
Share
More Decks by Shihyu Ho
See All by Shihyu Ho
JCConf 2024 Jib
shihyuho
0
48
JCConf 2022 - Using ArchUnit to test your architecture
shihyuho
0
140
hybrid-cloud-seminar.pdf
shihyuho
0
94
JCConf 2021 Access Kubernetes API in Java
shihyuho
0
120
iThome Kubernetes Summit 2018
shihyuho
0
62
JCConf 2016 zookeeper
shihyuho
0
59
Other Decks in Programming
See All in Programming
❄️ tmux-nixの実装を通して学ぶNixOSモジュール
momeemt
1
100
#QiitaBash TDDでAIに設計イメージを伝える
ryosukedtomita
1
320
事業KPIを基に価値の解像度を上げる
nealle
0
180
プロダクトエンジニアのしごと 〜 受託 × 高難度を乗り越えるOptium開発 〜
algoartis
1
290
医療系ソフトウェアのAI駆動開発
koukimiura
1
160
SpringBootにおけるオブザーバビリティのなにか
irof
1
830
私のRubyKaigi 2025 Kaigi Effect / My RubyKaigi 2025 Kaigi Effect
chobishiba
1
190
推論された型の移植性エラーTS2742に挑む
teamlab
PRO
0
110
Efficiency and Rock 'n’ Roll (Really!)
hollycummins
0
490
iOSアプリ開発もLLMで自動運転する
hiragram
5
1.8k
鯛変だったRubyKaigi 2025 ── それでも楽しかった!
pndcat
0
120
Proxmoxをまとめて管理できるコンソール作ってみました
karugamo
1
370
Featured
See All Featured
Making Projects Easy
brettharned
116
6.2k
Adopting Sorbet at Scale
ufuk
76
9.4k
How To Stay Up To Date on Web Technology
chriscoyier
790
250k
KATA
mclloyd
29
14k
For a Future-Friendly Web
brad_frost
178
9.7k
Fontdeck: Realign not Redesign
paulrobertlloyd
84
5.5k
Refactoring Trust on Your Teams (GOTO; Chicago 2020)
rmw
34
3k
Fireside Chat
paigeccino
37
3.5k
Optimizing for Happiness
mojombo
378
70k
How to Create Impact in a Changing Tech Landscape [PerfNow 2023]
tammyeverts
52
2.7k
Rebuilding a faster, lazier Slack
samanthasiow
81
9k
The Illustrated Children's Guide to Kubernetes
chrisshort
48
50k
Transcript
Lessons learned observing in Microservices Matt Ho
SoftLeader RD Matt Ho https://github.com/shihyuho
Microservices!
Move from Spring Cloud to Kubernetes native!
好多 App, 平常沒事, But...
Infrastructure 0
Tracing App App App container platform
Monitoring App App App container platform cpu/memory/VM heap … cpu/memory/VM
heap …
Loggin g App App App container platform
Kubernetes on-premises
原⽣的, ⼀裝好什麼都沒有!
不能客製呦!
不是在做比較
Tracing 1
Using OpenTracing #
github.com/opentracing-contrib/ java-spring-cloud
Put tracing in response #
App filter response request api add trace info
Add tracing in logger MDC #
App A log MDC
None
None
None
None
None
Create your Spans #
time Span A Span B Span C Span D 外部呼叫
trace
None
Propagating messages #
None
App A App B App C App D Queue Baggage
App A App B App C App D REST gRPC
Queue Enqueue Dequeue Baggage
None
Monitoring 2
Prometheus & exporters #
- node-exporter - Hardware/OS metric s - cAdvisor - Container
metric s - kube-state-metrics - Kubernetes Object metrics 環境類 exporters
github.com/prometheus-operator/ kube-prometheus
None
None
None
- blackbox - Probing over HTTP, HTTPS, DNS … -
micrometer.io - Java app metrics 服務類 exporters
None
None
https://grafana.com/grafana/ dashboards
Logging 3
Define logging format #
JSON logging format
github.com/logstash/ logstash-logback-encoder
Append app information #
app_name, app_version…
None
None
ES index strategy #
By namespace and date
None
Forwarding logs from { … } #
Fluentd Forward Log format OCP DockerSwarm Forward Other Cluster
App App App App App App
好多 App, 平常沒事, But...
Thanks