Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
Grano: A Python tool for investigating influence
Search
Friedrich Lindenberg
September 13, 2014
1
280
Grano: A Python tool for investigating influence
Friedrich Lindenberg
September 13, 2014
Tweet
Share
More Decks by Friedrich Lindenberg
See All by Friedrich Lindenberg
Introducción a OCCRP Data
pudo
0
410
Getting started with OCCRP Data
pudo
0
1.5k
#nr16: Recherche-Tools
pudo
1
98
data.occrp.org
pudo
0
150
Tools for Data Journalism | MediaLab Prado DDJ Workshop
pudo
0
240
Digitial Research Tools for Investigative Reporters
pudo
0
11k
Data doesn't grow in tables
pudo
2
270
Dr. Freezefile
pudo
2
390
Intro presentation for Naivasha
pudo
1
160
Featured
See All Featured
Making the Leap to Tech Lead
cromwellryan
133
9.2k
Dealing with People You Can't Stand - Big Design 2015
cassininazir
367
26k
10 Git Anti Patterns You Should be Aware of
lemiorhan
PRO
656
60k
Evolution of real-time – Irina Nazarova, EuRuKo, 2024
irinanazarova
8
650
Practical Tips for Bootstrapping Information Extraction Pipelines
honnibal
PRO
19
1.1k
Creating an realtime collaboration tool: Agile Flush - .NET Oxford
marcduiker
30
2k
Optimising Largest Contentful Paint
csswizardry
36
3.2k
Into the Great Unknown - MozCon
thekraken
37
1.7k
Raft: Consensus for Rubyists
vanstee
137
6.9k
JavaScript: Past, Present, and Future - NDC Porto 2020
reverentgeek
47
5.3k
The Art of Delivering Value - GDevCon NA Keynote
reverentgeek
13
1.4k
Java REST API Framework Comparison - PWX 2021
mraible
30
8.5k
Transcript
PYTHON TOOLS FOR Investigating Influence
None
BACKBONE SERVICES for JOURNALISTS and ACTIVISTS Open AFRICA SOURCE AFRICA
AFRI LEAKS AFRICAN SPENDING CONNECTED AFRICA
INVESTIGATIVE JOURNALISTS
WHAT DO THEY DO? HOW DO THEY DO IT?
INVESTIGATIVE ACTIVITIES MINE DOCS AND DATA MAP OUT NETWORKS CONSTRAINTS
LEGALLY ACTIONABLE PROTECT SOURCES
BIOS/FAMILY COMPANY DIRECTORS NGO DIRECTORS COURT CASES PARTY MEMBERSHIP COMMITTEES
FINANCIAL INTERESTS GOV CONTRACTS STRUCTURAL TRANSACTIONAL
JOURNALISTIC QUERIES PERSON COMPANY PUBLIC BODY PERSON
INFLUENCE MAPPING
HTTP://GRANOPROJECT.oRG
Network analysis tool Integrate messy data Full provenance REQUIREMENTS
BACKENDS
DETOUR: LINKED DATA https://github.com/uf6/design/issues
SQL: STILL PRETTY AWESOME
DATA MODEL I’LL BUY A COPY OF OMNIGRAfFLE SOON. PROMISE.
DATA LOADING SCRAPERS CSV FILES SCRAPERS GRANO LOADER GRANO API
PROFIT! GOOGLE DOCS YAML MAPPINGS ALIAS MAPPINGS REFINE SCHEMA
DATA LOADING SCRAPERS CSV FILES SCRAPERS GRANO LOADER GRANO API
PROFIT! GOOGLE DOCS YAML MAPPINGS ALIAS MAPPINGS REFINE SCHEMA
DE-DUPE IS HELL
EXTERNAL INTERFACES (FROZEN) FLASK REST API CLIENTS
ANALYTICAL INTERFACES FIND STORIES MANAGE EVIDENCE
QUERY LANGUAGE GRANO QL = STUPID MQL MQL (FREEBASE/GOOGLE) -
QUERY BY JSON EXAMPLE CYPHER (NEO4J) - SQL FOR GRAPHS SPARQL (RDF/LINKED DATA) - SQL FOR LINKED DATA
QUERY TOOL (WIP!) ANGULAR.JS D3 + DUCT TAPE
Great query tool FEDERATED Data enrichment “Soup (docs) to sense
(relations)” Roll out to other countries THE FUTURE
THANKS
[email protected]
http://granoproject.org LOOKING FOR FRONT-END JS DEVS!