Playing Analytics on GrimoireLab Data

Slides for the "Playing Analytics on GrimoireLab Data" hands-on workshop at #CHAOSSCon EU 2018.

Transcript

1. chaoss.community Playing Analytics on GrimoireLab Data Python scripts to mine GrimoireLab data about software development
2. chaoss.community Querying GrimoireLab enriched indexes Chapter “Python Scripting” from the GrimoireLab Tutorial grimoirelab.gitbooks.io/tutorial
3. chaoss.community What do you need (1) A GrimoireLab index For example (for this seminar): https://fosdem.biterg.io (Kibiter) https://fosdem.biterg.io/data (Elasticsearch)
4. chaoss.community What do you need (2) A Python virtual environment with the Python module for Elasticsearch $ python3 -m venv /tmp/es $ source /tmp/es/bin/activate (es) $ pip install elasticsearch-dsl (es) $ pip install pandas
5. chaoss.community Elasticsearch survival (quick) guide $ curl http://localhost:9200/_cat/indices?v $ curl -XPOST 'localhost:9200/_aliases?pretty' \ -H 'Content-Type: application/json' -d \ '{"actions" : [{ "add" : { "index" : "git_grimoirelab", "alias" : "git_enriched" } } ] }' $ curl -XGET 'localhost:9200/git/_search?size=1&pretty'
6. chaoss.community What to run (1) (es) $ wget https://raw.githubusercontent.com/chaoss/grimoirelab-tutorial/ master/python/scripts/enriched_elasticsearch_1.py (es) $ python enriched_elasticsearch_1.py
7. chaoss.community What to run (2) (es) $ wget https://raw.githubusercontent.com/chaoss/grimoirelab-tutorial/ master/python/scripts/pandas_1.py (es) $ python pandas_1.py