Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Elastic for Time Series Data and Predictive Ana...

Avatar for Elasticsearch Inc Elasticsearch Inc
January 12, 2016
3.1k

Elastic for Time Series Data and Predictive Analytics

Avatar for Elasticsearch Inc

Elasticsearch Inc

January 12, 2016
Tweet

Transcript

  1. 3 Viral Adoption Mar’15 Oct’12 Apr’13 Apr’14 Oct’13 20. Millions

    of Downloads 10. 40+ Million Downloads Cumulative across Elastic products to date Nov’15 40. Sept’14
  2. 4 What is Elastic? Platformaround a distributed data store By

    developers for developers Massive amounts of structured and unstructured data Real-time at scale
  3. 5 Elastic stack Logstash Collect, parse and enrich data Elasticsearch

    Store, search, analyze Hadoop Ecosystem Hadoop connector Beats Tap into your wire data Shield Security Watcher Scheduler Marvel - Monitoring Found Scale in the cloud Kibana Visualize and explore data Training Professional Services Support Subscriptions BUILT FOR TODAY’S SCALABLE, DISTRIBUTED SYSTEMS
  4. 6 What is Time Series Data? Has a timestamp Older

    and newer data Older data is less important Very old data will be deleted Random variation Trends and predictions
  5. 7 Time Series Architecture Filebeat Log files Packetbeat Packet sniffing

    Topbeat Server metrics Execbeat Arbitrary commands logstash-input-* JDBC, Twitter, *MQ, etc. Roll your own! Java, .NET, Python, etc. Logstash ES ES ES Kibana Timelion Custom
  6. 9 New in Elasticsearch2.0 Pipeline Aggregations “Aggregations on top of

    other aggregations” Derivatives Moving average Holt-Winters (prediction / anomaly detection) Custom
  7. 21 { model: holt_winters window: 360 predict: 120 settings: {

    type: mult period: 120 } } Holt-Winters triple exponential weighted moving average Prediction
  8. 23 MADRID, Spain January 19 - 21 BERLIN,Germany January 25

    - 28 COPENHAGEN, Denmark January 26 - 29 PARIS, France February 1 - 4 LONDON, United Kingdom February 3 - 5 AMSTERDAM, Netherlands February 8 - 11 training.elastic.co
  9. 24