The quantitative state of OPNFV

Presentation at the OPNFV Design Summit in Berlin, on June 20th 2016.

Transcript

1. The Quantitative State of OPNFV Jesus M. Gonzalez-Barahona jgb@bitergia.com @jgbarah Bitergia / URJC This slidedeck: http://speakerdeck.com/jgbarah OPNFV Design Summit Berlin (Germany), June 20th 2016 Jesus Gonzalez-Barahona (Bitergia) The Quantitative State of OPNFV June 2016 1 / 53
2. Open Jesus Gonzalez-Barahona (Bitergia) The Quantitative State of OPNFV June 2016 2 / 53
3. Software development http://xkcd.com/844/ Jesus Gonzalez-Barahona (Bitergia) The Quantitative State of OPNFV June 2016 3 / 53
4. Analytics https://en.wikipedia.org/wiki/Charles_Joseph_Minard Jesus Gonzalez-Barahona (Bitergia) The Quantitative State of OPNFV June 2016 4 / 53
5. OPNFV Jesus Gonzalez-Barahona (Bitergia) The Quantitative State of OPNFV June 2016 5 / 53
6. Open Development Analytics for OPNFV Slidedeck: http://speakerdeck.com/jgbarah Jesus Gonzalez-Barahona (Bitergia) The Quantitative State of OPNFV June 2016 6 / 53
7. Structure of the presentation 1 A bit of context 2 Data, data, data, and some analysis 3 Activity: what are you doing? 4 Performance is key! 5 Diversity (persons, organizations) 6 Comparisons are odious 7 Bonus track 8 Summary Jesus Gonzalez-Barahona (Bitergia) The Quantitative State of OPNFV June 2016 7 / 53
8. A bit of context Jesus Gonzalez-Barahona (Bitergia) The Quantitative State of OPNFV June 2016 8 / 53
9. Me and my two hats Uni Rey Juan Carlos: LibreSoft research team Understanding free, open source software Data analytics approach Bitergia: From research to the real world Understanding software development Data analytics approach http://gsyc.es/~jgb Jesus Gonzalez-Barahona (Bitergia) The Quantitative State of OPNFV June 2016 9 / 53
10. The company The software development analytics company dashboards reports consultancy ... http://bitergia.com Jesus Gonzalez-Barahona (Bitergia) The Quantitative State of OPNFV June 2016 10 / 53
11. Data, data, data, and some analysis Jesus Gonzalez-Barahona (Bitergia) The Quantitative State of OPNFV June 2016 11 / 53
12. Open development analytics for OPNFV All the data presented in this talk is available online!!! And much more... Note: data does for late June and Q2 is still missing Jesus Gonzalez-Barahona (Bitergia) The Quantitative State of OPNFV June 2016 12 / 53
13. The OPNFV dashboard http://projects.bitergia.com/opnfv Jesus Gonzalez-Barahona (Bitergia) The Quantitative State of OPNFV June 2016 13 / 53
14. The OPNFV reports https://wiki.opnfv.org/display/DEV/Quarterly+Reports Jesus Gonzalez-Barahona (Bitergia) The Quantitative State of OPNFV June 2016 14 / 53
15. The Bitergia Analytics dashboard (WIP) https://dashboard.bitergia.com/opnfv Jesus Gonzalez-Barahona (Bitergia) The Quantitative State of OPNFV June 2016 15 / 53
16. Transparency analysis Data sources available: Source code management (git) Code review (Gerrit) Issue tracking (Jira) Mailing lists Instant messaging (IRC) Questions & answers (Askbot) Automated testing (Jenkins) Visualizations, data, and analytics available from the project Jesus Gonzalez-Barahona (Bitergia) The Quantitative State of OPNFV June 2016 16 / 53
17. Activity: what are you doing? Jesus Gonzalez-Barahona (Bitergia) The Quantitative State of OPNFV June 2016 17 / 53
18. Git: commits over time Jesus Gonzalez-Barahona (Bitergia) The Quantitative State of OPNFV June 2016 18 / 53
19. Git: active authors over time Jesus Gonzalez-Barahona (Bitergia) The Quantitative State of OPNFV June 2016 19 / 53
20. Git: active authors over time (by participation) Jesus Gonzalez-Barahona (Bitergia) The Quantitative State of OPNFV June 2016 20 / 53
21. Code review (top: changesets, bottom: submitters) Jesus Gonzalez-Barahona (Bitergia) The Quantitative State of OPNFV June 2016 21 / 53
22. Tickets (closed / opened) Jesus Gonzalez-Barahona (Bitergia) The Quantitative State of OPNFV June 2016 22 / 53
23. Mailing lists (top: messages, bottom: senders) Jesus Gonzalez-Barahona (Bitergia) The Quantitative State of OPNFV June 2016 23 / 53
24. IRC (top: messages, bottom: identities) Jesus Gonzalez-Barahona (Bitergia) The Quantitative State of OPNFV June 2016 24 / 53
25. Performance is key! Jesus Gonzalez-Barahona (Bitergia) The Quantitative State of OPNFV June 2016 25 / 53
26. Review: Changesets per status Jesus Gonzalez-Barahona (Bitergia) The Quantitative State of OPNFV June 2016 26 / 53
27. Review: pending changesets / actors Jesus Gonzalez-Barahona (Bitergia) The Quantitative State of OPNFV June 2016 27 / 53
28. Review: Patchsets per changeset Jesus Gonzalez-Barahona (Bitergia) The Quantitative State of OPNFV June 2016 28 / 53
29. Review: Time to merge, days Jesus Gonzalez-Barahona (Bitergia) The Quantitative State of OPNFV June 2016 29 / 53
30. Review: Time open, days (top: 50%, bottom: 85%) Time open for May 2016: 0.21 (50%), 5.04 (85%) Jesus Gonzalez-Barahona (Bitergia) The Quantitative State of OPNFV June 2016 30 / 53
31. Review: Time waiting for reviewer, days Jesus Gonzalez-Barahona (Bitergia) The Quantitative State of OPNFV June 2016 31 / 53
32. Review: Time waiting for submitter, days Jesus Gonzalez-Barahona (Bitergia) The Quantitative State of OPNFV June 2016 32 / 53
33. Review: current active backlog by month, week Jesus Gonzalez-Barahona (Bitergia) The Quantitative State of OPNFV June 2016 33 / 53
34. Review: changesets (efficiency) Efficiency: fraction of changesets abandoned or merged with respect to those opened Jesus Gonzalez-Barahona (Bitergia) The Quantitative State of OPNFV June 2016 34 / 53
35. Tickets (efficiency) Efficiency: fraction of tickets closed with respect to those opened Jesus Gonzalez-Barahona (Bitergia) The Quantitative State of OPNFV June 2016 35 / 53
36. Diversity (persons, organizations) Jesus Gonzalez-Barahona (Bitergia) The Quantitative State of OPNFV June 2016 36 / 53
37. Developers (pony factor) 15 developers, 50% commits Jesus Gonzalez-Barahona (Bitergia) The Quantitative State of OPNFV June 2016 37 / 53
38. Organizations (elephant factor) Jesus Gonzalez-Barahona (Bitergia) The Quantitative State of OPNFV June 2016 38 / 53
39. Organizations (elephant factor) 3 organizations, 50% commits Jesus Gonzalez-Barahona (Bitergia) The Quantitative State of OPNFV June 2016 39 / 53
40. Comparisons are odious Jesus Gonzalez-Barahona (Bitergia) The Quantitative State of OPNFV June 2016 40 / 53
41. OpenStack vs OPNFV (first years) OpenStack Launched by Rackspace, NASA on July 19th, 2010 21 months: 2010-07 – 2012-03 http://www.openstack.org/blog/ 2010/07/introducing-openstack/ OPNFV Launched by Linux Foundation on September 30th, 2014 21 months: 2014-10 – 2016-06 https://www.opnfv.org/news-faq/ press-release/2014/09/ telecom-industry-and-vendors-unite-bu Jesus Gonzalez-Barahona (Bitergia) The Quantitative State of OPNFV June 2016 41 / 53
42. Some parameters, 21th month OPNFV OpenStack Commits 8,814 23,293 Commits/mo(a) 700 1,500 Commits/mo (12mo)(b) 250 → 700 (x2.8) 1,200 → 1,500 (x1.25) Authors 203 452 Authors/mo(a) 80 150 Pony factor(c) 15 26 Elephant factor(d) 3 1 (a) Approximate (b) Approximate three-month average year over year (c) Pony factor: min. number authors with 50% commits (d) Elephant factor: min. number organizations with 50% commits Jesus Gonzalez-Barahona (Bitergia) The Quantitative State of OPNFV June 2016 42 / 53
43. Commits, 21th month (top: OPNFV, bottom: OpenStack) Jesus Gonzalez-Barahona (Bitergia) The Quantitative State of OPNFV June 2016 43 / 53
44. Authors, 21th month (top: OPNFV, bottom: OpenStack) Jesus Gonzalez-Barahona (Bitergia) The Quantitative State of OPNFV June 2016 44 / 53
45. Organizations, 21th month (left: OPNFV, : right: OpenStack) Jesus Gonzalez-Barahona (Bitergia) The Quantitative State of OPNFV June 2016 45 / 53
46. Some parameters, processes OPNFV OpenStack (2016-Q2) (2015-Q4) Time-to-merge (median, days) 0.30 2.38 Time-to-merge (mean, days) 3.40 11.83 Patchsets per changeset (median, days) 1.0 2.0 Patchsets per changeset (mean, days) 1.79 3.86 Efficiency (changesets) 0.94 0.78 Efficiency (tickets) 0.57 0.44 Jesus Gonzalez-Barahona (Bitergia) The Quantitative State of OPNFV June 2016 46 / 53
47. Bonus track Jesus Gonzalez-Barahona (Bitergia) The Quantitative State of OPNFV June 2016 47 / 53
48. Testing: Jenkins data (preview) Jesus Gonzalez-Barahona (Bitergia) The Quantitative State of OPNFV June 2016 48 / 53
49. Summary Jesus Gonzalez-Barahona (Bitergia) The Quantitative State of OPNFV June 2016 49 / 53
50. Summarizing... OPNFV provides open development analytics: You don’t need others to provide conclusions You can do that yourself! Slidedeck: http://speakerdeck.com/jgbarah Jesus Gonzalez-Barahona (Bitergia) The Quantitative State of OPNFV June 2016 50 / 53
51. License c 2016 Bitergia Some rights reserved. This presentation is distributed under the “Attribution-ShareAlike 3.0” license, by Creative Commons, available at http://creativecommons.org/licenses/by-sa/3.0/ Jesus Gonzalez-Barahona (Bitergia) The Quantitative State of OPNFV June 2016 51 / 53
52. Credits (1) “Man With Two Hats” Statue by Henk Visch, located in Otawa, Canada Picture by Lezumbalaberenjena in Wikimedia Commons License: Public domain https://commons.wikimedia.org/wiki/File: Man_With_Two_Hats_Ottawa_Statue_by_lezumbalaberenjena.jpg “Napoleon’s Russian campaign of 1812” Original by Charles Minard License: Public domain https://en.wikipedia.org/wiki/Charles_Joseph_Minard#/media/File: Minard.png Jesus Gonzalez-Barahona (Bitergia) The Quantitative State of OPNFV June 2016 52 / 53
53. Credits (2) “Aged Come In We’re Open” Picture by Czarina Alegre in Flickr License: Creative Commons Attribution 2.0 https://flic.kr/p/fjGamh “Good code” Comic by Randall Munroe, XKCD 844 License: Creative Commons Attribution-NonCommercial 2.5 http://xkcd.com/844/ Charts and tables are derived from Bitergia dashboards and reports for OPNFV Jesus Gonzalez-Barahona (Bitergia) The Quantitative State of OPNFV June 2016 53 / 53