Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Sign up for free
Menu
Search
Features
All features
Private URLs
Password Protection
Custom URLS
Scheduled publishing
Remove Branding
Restrict embedding
Deck Collections
Notes
Features
All features
Private URLs
Password Protection
Custom URLS
Scheduled publishing
Remove Branding
Restrict embedding
Deck Collections
Notes
Explore
Featured decks
Featured speakers
Programming
Technology
Storyboards
Explore
Featured decks
Featured speakers
Programming
Technology
Storyboards
Pricing
Search
Sign in
Sign up for free
GitHub Insights: Understanding Open Source
Search
Georgios Gousios
May 19, 2016
Technology
480
0
Share
Embed
Copy iframe code
Copy JS code
Copy link
Start on current slide
GitHub Insights: Understanding Open Source
Talk given at OSCON 2016
Georgios Gousios
May 19, 2016
Transcript
29 slides
GitHub Insights Understanding Open Source @jeffmcaffer–Microsoft Georgios Gousios –Delft University
of Technology (TU Delft) Kevin Lewis – Microsoft
Snapshot overview
Inspire confidence
How open is a project? http://ghtorrent.org/pullreq-perf/
Commits (core vs community)
Commits (origin)
Comments (core vs community)
PR lifelines
Are we using git in a distributed way?
How may devs are there per country?
Insights
Business insights
Research insights
Cross-domain insights
Operational insights
Approach Data for the masses
GitHub by the numbers (Mid 2016)
Approach http://ghtorrent.org
How does it work? http://api.github.com/events
Example event (condensed) https://api.github.com/users/Cephei https://api.github.com/repos/PowerDMS/Owin.Scim https://api.github.com/repos/PowerDMS/Owin.Scim/commits/c751014f634d73e0b72f78a53c8cf137888b3 https://api.github.com/orgs/PowerDMS
Entities
GHTorrent architecture Github API Event Retrieval Commits Queue Project Events
Queue Events Data Retrieval Projects Commits evt.commit evt.watch evt.fork Data Retrieval Data Retrieval Data Retrieval Mirroring Cluster
GHTorrent by the numbers
Using the data You can do it too!
Using the data: Hosted http://ghtorrent.org
Using the data: Download
Using the data: Self-service https://github.com/ghtorrent/ghtorrent-webhook
Using the data: Azure Data Lake
Resources http://ghtorrent.org https://github.com/Microsoft/ghinsights @gousiosg @jeffmcaffer @kelewis
More Decks by Georgios Gousios
See All by Georgios Gousios
NLP + SE = ❤️
gousiosg
0
420
The troubles of modern dependency management and what to do about them
gousiosg
0
780
Mining Repositories with Apache Spark
gousiosg
0
790
My adventures with open everything
gousiosg
0
390
Structure and Evolution of Package Dependency Networks
gousiosg
0
980
Mining Github for fun and profit
gousiosg
9
63k
Work Practices and Challenges in Pull-Based Development: The Contributor’s Perspective
gousiosg
0
1k
Big Data in Software Engineering panel and Privacy: Should we care?
gousiosg
0
370
The #issue32 incident
gousiosg
2
16k
Other Decks in Technology
See All in Technology
NutanixへのSSHアクセスの今後について
shadowhat
0
170
AWS Client VPNの設定でハマったポイントとその過程での気づき
amarelo_n24
1
440
セキュリティチームは どのコンテナイメージの脆弱性対応を優先すべきか 〜CISA新指針とSCCで作る脆弱性トリアージ〜
swdtkuy
0
330
クラウドでも使えるNetApp -現場目線での設計とクラウドバックアップの活用
ryutakondo
1
330
HTTP通信に使おうとすると実はめんどくさいfile_get_contents
maguroalternative
0
260
こんなに変わった! AWSネットワークの常識
shotashiratori
16
11k
そのイメージ、どのCIが作った? Artifact Attestationsで来歴を固定する / Which CI system created that image? Pinning provenance with Artifact Attestations
chmikata
0
270
Re:ゼロから始めるシェアハウスのペットな鯖
silmin_
0
270
データから見る AI時代のエンジニア転職と採用
junya_okura
4
1.3k
Web Performance Is a Journey [PerfNow 2026]
tammyeverts
2
150
メルカリの小規模チーム「Pod」で、 エンジニアがデータアナリストなしで、 AIを使ってデータ分析の自走を目指す取り組み
jackojacko_
1
350
20261119_AgentCore
takuyay0ne
2
280
Featured
See All Featured
ラッコキーワード サービス紹介資料
rakko
5
6M
The #1 spot is gone: here's how to win anyway
tamaranovitovic
4
1.2k
Docker and Python
trallard
47
4.3k
Imperfection Machines: The Place of Print at Facebook
scottboms
270
14k
AI in Enterprises - Java and Open Source to the Rescue
ivargrimstad
0
1.6k
The B2B funnel & how to create a winning content strategy
katarinadahlin
PRO
1
620
Keith and Marios Guide to Fast Websites
keithpitt
413
23k
Become a Pro
speakerdeck
PRO
31
6.4k
The MySQL Ecosystem @ GitHub 2015
samlambert
251
13k
svc-hook: hooking system calls on ARM64 by binary rewriting
retrage
2
690
Introduction to Domain-Driven Design and Collaborative software design
baasie
1
1.1k
Embracing the Ebb and Flow
colly
88
5.2k