Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Mapion Log/Monitoring

One compath
March 24, 2017
Technology
0
240

Mapion Log/Monitoring

2017.03.24 WOVN x Mapion 勉強会

One compath

March 24, 2017
Tweet

More Decks by One compath

See All by One compath
社内の制度を使って新規事業を⽴ち上げてみた話 OCEM#3
mapion
0
130
新規事業のアプリ、Flutterで作ってます〜U-ROUTEのポイ活対応編〜 OCEM#3
mapion
0
140
ウォーキングアプリ「aruku&」ってどうやって作ってるの？ OCEM#3
mapion
0
160
ONE COMPATH／ワンコンパス Company Deck For Engineer（会社紹介資料）
mapion
0
5k
ONE COMPATHの地図の開発技術～入門編～ OCEM #2
mapion
0
200
脱レガシー! Aurora PostgreSQLに移行してみた OCEM #2
mapion
1
730
エンジニアなので「技術」で仕事を効率化してみた ～Slack連携でチームの生産性が向上～　OCEM#2
mapion
0
180
20221112_FOSS4G2022Online.pdf
mapion
0
1.5k
ONE COMPATH／ワンコンパス　Company Deck（会社資料）
mapion
0
310

Other Decks in Technology

See All in Technology
IVRyにおけるNLP活用と NLP2025の関連論文紹介
keisukeosone
0
180
Classmethod AI Talks(CATs) #20 司会進行スライド(2025.04.10) / classmethod-ai-talks-aka-cats_moderator-slides_vol20_2025-04-10
shinyaa31
0
130
20250413_湘南kaggler会_音声認識で使うのってメルス・・・なんだっけ？
sugupoko
1
390
似たような課題が何度も蘇ってくるゾンビふりかえりを撲滅するため、ふりかえりのテーマをフォーカスしてもらった話 / focusing on the theme
naitosatoshi
0
390
“パスワードレス認証への道" ユーザー認証の変遷とパスキーの関係
ritou
1
440
低レイヤを知りたいPHPerのためのCコンパイラ作成入門 / Building a C Compiler for PHPers Who Want to Dive into Low-Level Programming
tomzoh
0
210
ソフトウェア開発現代史: "LeanとDevOpsの科学"の「科学」とは何か？ - DORA Report 10年の変遷を追って - #DevOpsDaysTokyo
takabow
0
200
クォータ監視、AWS Organizations環境でも楽勝です✌️
iwamot
PRO
1
240
アセスメントで紐解く、10Xのデータマネジメントの軌跡
10xinc
1
360
AI AgentOps LT大会(2025/04/16) Algomatic伊藤発表資料
kosukeito
0
120
Would you THINK such a demonstration interesting ?
shumpei3
1
160
Ops-JAWS_Organizations小ネタ3選.pdf
chunkof
2
120

Featured

See All Featured
GraphQLとの向き合い方2022年版
quramy
46
14k
JavaScript: Past, Present, and Future - NDC Porto 2020
reverentgeek
47
5.3k
Facilitating Awesome Meetings
lara
54
6.3k
What's in a price? How to price your products and services
michaelherold
245
12k
Performance Is Good for Brains [We Love Speed 2024]
tammyeverts
9
740
The Language of Interfaces
destraynor
157
24k
jQuery: Nuts, Bolts and Bling
dougneiner
63
7.7k
Reflections from 52 weeks, 52 projects
jeffersonlam
349
20k
The Web Performance Landscape in 2024 [PerfNow 2024]
tammyeverts
5
520
Raft: Consensus for Rubyists
vanstee
137
6.9k
Building Adaptive Systems
keathley
41
2.5k
Design and Strategy: How to Deal with People Who Don’t "Get" Design
morganepeng
129
19k

Transcript

  1. Mapion Log/Monitoring ByɹSuto Mapion Infrastructure Group Hironori Suto.

  2. Logs. (Access log.)

  3. Mapion Log. ֤γεςϜͷཁٻʹԠͯ͡ෳ਺ύλʔϯ ݹ͘ͳΓ͍͗ͯ͢Δ෦෼΋͋ΔͷͰ௚͍͖͍ͯͨ͠ ͱ͜Ζ΋͋Γ·͢ɻ

  4. ELB+S3+Redshift ELB EC2 Access Logs S3 Redshift Other data

  5. ELB+S3+Redshift Pros - Less changes. - Sql like search. Cons

    - Cost.

  6. ELB+S3+Athena ELB EC2 Access Logs S3 Athena

  7. ELB+S3+Athena Pros - Less changes. - Sql like search. -

    Low cost. Cons - Only Access Logs.

  8. ELB+S3+Athena+ re-dash ELB EC2 Access Logs S3 Athena Other data

  9. Re-dash Visualizing tool for any data sources. MySQL,PostgreSQL,Elastic search mongoDB,

    Athena and so on.

  10. Re-dash

  11. EC2(or nova) + fluentd+kibana ELB EC2 Access Proxy Server Fluentd(td-agent)

    EC2 Elastic search + Elastic search service

  12. Pros - Search. - Any logs. - Realtime Watch. Cons

    - Cost. EC2(or nova) + fluentd+kibana

  13. Legacy… Maintenance cost… SCP + awstats.

  14. Monitoring

  15. Monitoring - Zabbix (Helion & AWS) 1 Zabbix Instance →

    AWS(vpc) ≒100 instance 1 Zabbix Instance → Helion ≒100 instance 3 Zabbix Instance → AWS(classic) ≒80 instance

  16. Monitoring - Cloudwatch for AWS system (ELB etc)

  17. AutoScale + Zabbix Zabbix Zabbix API Chef +Script New Server

  18. AutoScale + Zabbix  Zabbix Zabbix API Script Delete Server

  19. AutoScale + Zabbix Zabbix Alert Log.

  20. Service Check(Nagios) ELB AWS Public cloud Nagios