Mapion Log/Monitoring

2017.03.24 WOVN x Mapion 勉強会

Transcript

1. Mapion Log/Monitoring ByɹSuto Mapion Infrastructure Group Hironori Suto.
2. Logs. (Access log.)
3. Mapion Log. ֤γεςϜͷཁٻʹԠͯ͡ෳ਺ύλʔϯ ݹ͘ͳΓ͍͗ͯ͢Δ෦෼΋͋ΔͷͰ௚͍͖͍ͯͨ͠ ͱ͜Ζ΋͋Γ·͢ɻ
4. ELB+S3+Redshift ELB EC2 Access Logs S3 Redshift Other data
5. ELB+S3+Redshift Pros - Less changes. - Sql like search. Cons - Cost.
6. ELB+S3+Athena ELB EC2 Access Logs S3 Athena
7. ELB+S3+Athena Pros - Less changes. - Sql like search. - Low cost. Cons - Only Access Logs.
8. ELB+S3+Athena+ re-dash ELB EC2 Access Logs S3 Athena Other data
9. Re-dash Visualizing tool for any data sources. MySQL,PostgreSQL,Elastic search mongoDB, Athena and so on.
10. Re-dash
11. EC2(or nova) + fluentd+kibana ELB EC2 Access Proxy Server Fluentd(td-agent) EC2 Elastic search + Elastic search service
12. Pros - Search. - Any logs. - Realtime Watch. Cons - Cost. EC2(or nova) + fluentd+kibana
13. Legacy… Maintenance cost… SCP + awstats.
14. Monitoring
15. Monitoring - Zabbix (Helion & AWS) 1 Zabbix Instance → AWS(vpc) ≒100 instance 1 Zabbix Instance → Helion ≒100 instance 3 Zabbix Instance → AWS(classic) ≒80 instance
16. Monitoring - Cloudwatch for AWS system (ELB etc)
17. AutoScale + Zabbix Zabbix Zabbix API Chef +Script New Server
18. AutoScale + Zabbix  Zabbix Zabbix API Script Delete Server
19. AutoScale + Zabbix Zabbix Alert Log.
20. Service Check(Nagios) ELB AWS Public cloud Nagios