Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Mapion Log/Monitoring

Sponsored · Ship Features Fearlessly Turn features on and off without deploys. Used by thousands of Ruby developers. →
Avatar for One compath One compath
March 24, 2017
Technology
250
0

Mapion Log/Monitoring

2017.03.24 WOVN x Mapion 勉強会

Avatar for One compath

One compath

March 24, 2017

More Decks by One compath

See All by One compath
社内の制度を使って新規事業を⽴ち上げてみた話 OCEM#3
Avatar for One compath mapion
0
200
新規事業のアプリ、Flutterで作ってます〜U-ROUTEのポイ活対応編〜 OCEM#3
Avatar for One compath mapion
0
230
ウォーキングアプリ「aruku&」ってどうやって作ってるの？ OCEM#3
Avatar for One compath mapion
0
220
ONE COMPATH／ワンコンパス Company Deck For Engineer（会社紹介資料）
Avatar for One compath mapion
0
8.2k
ONE COMPATHの地図の開発技術～入門編～ OCEM #2
Avatar for One compath mapion
0
230
脱レガシー! Aurora PostgreSQLに移行してみた OCEM #2
Avatar for One compath mapion
1
980
エンジニアなので「技術」で仕事を効率化してみた ～Slack連携でチームの生産性が向上～　OCEM#2
Avatar for One compath mapion
0
220
20221112_FOSS4G2022Online.pdf
Avatar for One compath mapion
0
1.8k
ONE COMPATH／ワンコンパス　Company Deck（会社資料）
Avatar for One compath mapion
0
380

Other Decks in Technology

See All in Technology
Podcast配信で広がったアウトプットの輪～70人と音声発信してきた7年間～/outputconf_01
Avatar for FORTE fortegp05
0
190
Bill One 開発エンジニア 紹介資料
Avatar for Sansan, Inc. sansan33
PRO
5
18k
やさしいとこから始めるGitHubリポジトリのセキュリティ
Avatar for Yuta Matsumura tsubakimoto_s
3
2.1k
Zephyr(RTOS)でOpenPLCを実装してみた
Avatar for misoji engineer iotengineer22
0
180
マルチモーダル非構造データとの闘い
Avatar for shibuiwilliam shibuiwilliam
1
140
MIX AUDIO EN BROADCAST
Avatar for Erick Ralph Kionga ralpherick
0
140
互換性のある（らしい）DBへの移行など考えるにあたってたいへんざっくり
Avatar for Takanori Sejima sejima
PRO
0
520
JEDAI認定プログラム JEDAI Order 2026 受賞者一覧 / JEDAI Order 2026 Winners
Avatar for Databricks Japan databricksjapan
0
480
遊びで始めたNew Relic MCP、​気づいたらChatOpsな​オブザーバビリティボットができてました/From New Relic MCP to a ChatOps Observability Bot
Avatar for AEON aeonpeople
1
150
GitHub Advanced Security × Defender for Cloudで開発とSecOpsのサイロを超える: コードとクラウドをつなぐ、開発プラットフォームのセキュリティ
Avatar for yuriemori yuriemori
1
120
OpenClawでPM業務を自動化
Avatar for 西岡 賢一郎 (Kenichiro Nishioka) knishioka
2
370
脳が溶けた話 / Melted Brain
Avatar for Keisuke69 keisuke69
1
1.2k

Featured

See All Featured
Fireside Chat
Avatar for paigeccino paigeccino
42
3.9k
Abbi's Birthday
Avatar for Violet Bock coloredviolet
2
6.2k
Rails Girls Zürich Keynote
Avatar for Gregor Martynus gr2m
96
14k
The Web Performance Landscape in 2024 [PerfNow 2024]
Avatar for Tammy Everts tammyeverts
12
1.1k
Lightning Talk: Beautiful Slides for Beginners
Avatar for Ines Montani inesmontani
PRO
1
500
Helping Users Find Their Own Way: Creating Modern Search Experiences
Avatar for Dan Newman danielanewman
31
3.1k
SEO Brein meetup: CTRL+C is not how to scale international SEO
Avatar for Linda Hogenes lindahogenes
1
2.5k
Noah Learner - AI + Me: how we built a GSC Bulk Export data pipeline
Avatar for Tech SEO Connect techseoconnect
PRO
0
150
The innovator’s Mindset - 
Leading Through an Era of Exponential Change - McGill University 2025
Avatar for Jean-Marc De Jonghe jdejongh
PRO
1
140
The Hidden Cost of Media on the Web [PixelPalooza 2025]
Avatar for Tammy Everts tammyeverts
2
260
The browser strikes back
Avatar for Jono Alderson jonoalderson
0
870
Fashionably flexible responsive web design (full day workshop)
Avatar for Andy Clarke malarkey
408
66k

Transcript

  1. Mapion Log/Monitoring ByɹSuto Mapion Infrastructure Group Hironori Suto.

  2. Logs. (Access log.)

  3. Mapion Log. ֤γεςϜͷཁٻʹԠͯ͡ෳ਺ύλʔϯ ݹ͘ͳΓ͍͗ͯ͢Δ෦෼΋͋ΔͷͰ௚͍͖͍ͯͨ͠ ͱ͜Ζ΋͋Γ·͢ɻ

  4. ELB+S3+Redshift ELB EC2 Access Logs S3 Redshift Other data

  5. ELB+S3+Redshift Pros - Less changes. - Sql like search. Cons

    - Cost.

  6. ELB+S3+Athena ELB EC2 Access Logs S3 Athena

  7. ELB+S3+Athena Pros - Less changes. - Sql like search. -

    Low cost. Cons - Only Access Logs.

  8. ELB+S3+Athena+ re-dash ELB EC2 Access Logs S3 Athena Other data

  9. Re-dash Visualizing tool for any data sources. MySQL,PostgreSQL,Elastic search mongoDB,

    Athena and so on.

  10. Re-dash

  11. EC2(or nova) + fluentd+kibana ELB EC2 Access Proxy Server Fluentd(td-agent)

    EC2 Elastic search + Elastic search service

  12. Pros - Search. - Any logs. - Realtime Watch. Cons

    - Cost. EC2(or nova) + fluentd+kibana

  13. Legacy… Maintenance cost… SCP + awstats.

  14. Monitoring

  15. Monitoring - Zabbix (Helion & AWS) 1 Zabbix Instance →

    AWS(vpc) ≒100 instance 1 Zabbix Instance → Helion ≒100 instance 3 Zabbix Instance → AWS(classic) ≒80 instance

  16. Monitoring - Cloudwatch for AWS system (ELB etc)

  17. AutoScale + Zabbix Zabbix Zabbix API Chef +Script New Server

  18. AutoScale + Zabbix  Zabbix Zabbix API Script Delete Server

  19. AutoScale + Zabbix Zabbix Alert Log.

  20. Service Check(Nagios) ELB AWS Public cloud Nagios