This talk discusses the monitoring architecture, the challenges encountered in operating and scaling a pipeline to handle billions of events and presents how users benefit from a central monitoring service for processing and analysis of monitoring data.
Diogo is a Software Engineer with experience in designing and operating complex data pipelines. He earned his Masters in Computer Science at Instituto Superior Técnico with focus on intelligent decision systems. While yet studying he had the chance to explore several startups where he helped building from recommender systems to marketing newsletters. He joined the CERN IT Department to work on the evolution of monitoring infrastructure towards modern and scalable pipelines for data ingestion and stream processing. In his spare time, as a true millennial, he enjoys travelling and finding new places to eat as much as watching Netflix.