Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Graphite and Friends at Leeds DevOps

Graphite and Friends at Leeds DevOps

Avatar for Mark Crossfield

Mark Crossfield

November 13, 2014
Tweet

More Decks by Mark Crossfield

Other Decks in Technology

Transcript

  1. Structure ☑ Context ☐ Monitoring ☐ Graphite ☐ Front Ends

    ☐ Feeding ☐ Graphite Tips ☐ Managing / Scaling
  2. http://blog.tagman.com/2012/03/just-one-second-delay-in-page-load-can-cause-7-loss-in-customer-conversions/ One Second Delay In Page-Load Can Cause 
 7%

    Loss In Customer Conversions “ ” 47% of consumers expect a page to load in 2 seconds or less “
  3. aggregation precision reduces over time One year : daily One

    month: hourly One week: 5min One day: min
  4. Bucky, Collectl, Diamond, Ganglia, Graphite PowerShell Functions, HoardD, Host sFlow,

    jmxtrans, Logster, metrics-sampler, Sensu, SqlToGraphite, SSC Serv, Backstop, Evenflow, Graphite-Newrelic, Graphite-relay, Graphios, Grockets, Ledbetter, pipe-to-graphite, statsd, Charcoal, Descartes, Dusk, Firefly, Gdash, Giraffe, Grafana, graphitus, Graph-Explorer, Graph-Index, Graphene, Graphite- Observer, Graphite-Tattle, Graphiti, Graphitoid, Graphsky, Hubot, Leonardo, Orion, Pencil, Seyren, Tasseo, Tessera, TimeseriesWidget, Cabot, graphite-beacon, rearview, Rocksteady, Shinken, Therry Plenty of adoption
  5. grafana is awesome & free as in beer and speech

    http://play.grafana.org/#/dashboard/db/grafana-play-home
  6. label your axes, before it is too late talk about

    units, frequencies, and include in the metric name
  7. timeShift(series, duration) e.g. show yesterday’s metric against today’s timeShift(“apache.http.requests”, “-1day”)

    http://graphite.readthedocs.org/en/0.9.12/functions.html#graphite.render.functions.timeShift
  8. groupByNode(series, node, aggregate) e.g. aggregate many series using one node

    groupByNode(“collectd.*.cpu.*.value”, “2”, “maxSeries”) http://graphite.readthedocs.org/en/0.9.12/functions.html#graphite.render.functions.groupByNode
  9. cumulative(seriesList) show how a rate (e.g. per sec) adds up

    over the day http://graphite.readthedocs.org/en/0.9.12/functions.html#graphite.render.functions.cumulative
  10. teatime is 4pm Graphite understands the UNIX At time specification

    e.g. noon yesterday, now-2weeks http://oss.oetiker.ch/rrdtool/doc/rrdfetch.en.html#IAT_STYLE_TIME_SPECIFICATION
  11. monitor carbon carbon records it’s own metrics per minute to

    graphite http://obfuscurity.com/2012/06/Watching-the-Carbon-Feed
  12. events(*tags) number of events matching tags at this point in

    time use to annotate your charts e.g. events(“deploy”, “change”) http://graphite.readthedocs.org/en/0.9.12/functions.html#graphite.render.functions.events
  13. Summary •Good tool for long term trending of time series

    data •Use Grafana and perhaps Dashing as a front end •Feed your data in through statsd, collectd & metrics •Lever the functions •You may experience scaling pain