Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
Don't let your log go away
Search
Olivier Dolbeau
March 24, 2015
Programming
1
430
Don't let your log go away
Talk given at Paris Tech Talk MeetUp
Olivier Dolbeau
March 24, 2015
Tweet
Share
More Decks by Olivier Dolbeau
See All by Olivier Dolbeau
Jane & Webby
odolbeau
0
310
Translating a monolingual application
odolbeau
2
450
DX: Developer eXperience
odolbeau
0
54
DX: Developer eXperience
odolbeau
0
440
EasyAdminBundle introduction
odolbeau
0
150
REX API Platform
odolbeau
0
1.1k
Features flags at BlaBlaCar
odolbeau
4
900
25+ million members in 22 countries, how to scale with Symfony2
odolbeau
1
420
Be gentle with your prod!
odolbeau
1
650
Other Decks in Programming
See All in Programming
オートマトン学習しろ / Do automata learning
makenowjust
3
130
Architecture Decision Record (ADR)
nearme_tech
PRO
1
690
Patched fetch did not work
quramy
4
390
Hono・Prisma・AWSでGeoなAPI開発
nokonoko1203
5
680
watsonx.ai Dojo #2 生成AIを使ったアプリ開発入門編
oniak3ibm
PRO
0
220
Prolog入門
qnighy
4
1k
はじめてみよう量子プログラミング
itokoichi01
0
210
Developer Joy == Developer Productivity (really!)
hollycummins
1
220
Android開発以外のAndroid開発経験の活かしどころ
konifar
2
1k
Why Prism?
kddnewton
4
1.7k
KSPの導入・移行を前向きに検討しよう!
shxun6934
PRO
0
280
GoのIteratorに詳しくなってしまう
inatonix
1
200
Featured
See All Featured
Designing Dashboards & Data Visualisations in Web Apps
destraynor
227
52k
KATA
mclloyd
27
13k
The World Runs on Bad Software
bkeepers
PRO
64
11k
Build The Right Thing And Hit Your Dates
maggiecrowley
30
2.3k
A Modern Web Designer's Workflow
chriscoyier
691
190k
Keith and Marios Guide to Fast Websites
keithpitt
408
22k
Thoughts on Productivity
jonyablonski
66
4.2k
個人開発の失敗を避けるイケてる考え方 / tips for indie hackers
panda_program
89
16k
How GitHub Uses GitHub to Build GitHub
holman
472
290k
Building a Scalable Design System with Sketch
lauravandoore
459
32k
Typedesign – Prime Four
hannesfritz
39
2.3k
How GitHub (no longer) Works
holman
310
140k
Transcript
DON’T LET YOUR LOG GO AWAY @odolbeau 1
WHO AM I? Olivier Dolbeau @odolbeau Work at BlaBlaCar 2
Log 3
Which logs are we talking about? 4
access logs 5
syslog syslog 6
application logs 7
Access 8
SSH 9
Analyze 10
tail grep cat 11
This is specific to its access logs My roommate uses
this to colorise his access logs… 12
13
14
15
16
17
Inputs Filters Outputs 41 inputs • syslog • udp •
varnishlog • gelf • … 50 filters • date • geoip • i18n • urldecode • … 55 outputs • elasticsearch • redis • email • graphite • … And there are also some codecs 18
Kibana 19
20
ELK 21
22
syslog syslog 23
24
*.* @127.0.0.1:514;RSYSLOG_ForwardFormat 25
input { udp { port => 514 type => syslog
} } Logstash - Input 26
filter { if [type] == "syslog" { grok { match
=> [ "message", "<%{POSINT:syslog_pri}>% {TIMESTAMP_ISO8601:syslog_timestamp} %{SYSLOGHOST:syslog_hostname} % {DATA:syslog_program}(?:\[%{POSINT:syslog_pid}\])?: % {GREEDYDATA:syslog_message}" ] add_field => [ "received_at", "%{@timestamp}" ] add_field => [ "received_from", "%{host}" ] add_tag => [ "rsyslog" ] } } } Logstash - Filter 27
output { elasticsearch_http { host => “my_es.blablacar.com” port => 9200
index => "logstashv1-%{+YYYY.MM.dd}" manage_template => false } } Logstash - Output 28
29
syslog 30
31
32
None