Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Sign up for free
Menu
Search
Features
All features
Private URLs
Password Protection
Custom URLS
Scheduled publishing
Remove Branding
Restrict embedding
Deck Collections
Notes
Features
All features
Private URLs
Password Protection
Custom URLS
Scheduled publishing
Remove Branding
Restrict embedding
Deck Collections
Notes
Explore
Featured decks
Featured speakers
Programming
Technology
Storyboards
Explore
Featured decks
Featured speakers
Programming
Technology
Storyboards
Pricing
Search
Sign in
Sign up for free
Data doesn't grow in tables
Search
Friedrich Lindenberg
July 16, 2014
Technology
310
2
Share
Embed
Copy iframe code
Copy JS code
Copy link
Start on current slide
Data doesn't grow in tables
Friedrich Lindenberg
July 16, 2014
Transcript
19 slides
Data doesn’t grow in tables Dealing with large sets of
documents
–An investigative reporter “We're working with 40 GB of XXX
and would like to search within the documents for certain keywords (like XXX) so we can identify XXX. Ideally we should be able to tag the docs..”
Some lingo • OCR (Optical Character Recognition) • NLP (Natural
Language Processing) • NER (Named Entity Recognition) • Regular Expressions
Cases
Exhibit A
Exhibit B
Exhibit C
Exhibit D
Tools
Tables in disguise http://tabula.nerdpower.org
Docs in a cloud http://documentcloud.org
Clustering, tagging, mining http://overview.ap.org
Let them eat PDF https://github.com/CrowData
All the visuals Jigsaw
Spoken word magic http://sayit.mysociety.org/
Whats missing? Easy-to-use ElasticSearch Commercial-grade OCR Configurable pipelines
Stefan Wehrmeyer, correctiv.org, @stefanwehrmeyer ! ! ! ! ! !
! Friedrich Lindenberg, codeforafrica.org, @pudo
None
None
More Decks by Friedrich Lindenberg
See All by Friedrich Lindenberg
Introducción a OCCRP Data
pudo
0
470
Getting started with OCCRP Data
pudo
0
1.8k
#nr16: Recherche-Tools
pudo
1
150
data.occrp.org
pudo
0
190
Tools for Data Journalism | MediaLab Prado DDJ Workshop
pudo
0
270
Digitial Research Tools for Investigative Reporters
pudo
0
11k
Grano: A Python tool for investigating influence
pudo
1
330
Dr. Freezefile
pudo
2
490
Intro presentation for Naivasha
pudo
1
210
Other Decks in Technology
See All in Technology
ライフワーク「猫でもわかるDirectConnect」
kentapapa
0
330
田んぼの見回りをIoTで減らしたい!水位監視から電池駆動カメラまでの試行錯誤
itosoft
1
190
Bots in Kiro Crew (One point of contact for ongoing work) | Kiro: Zero to Hero 12
inariku
PRO
1
140
生成AI時代のIAMのマニアックな話
takuros
6
3.2k
内製アプリとClaudeスキルのセキュリティチェック、 Backlogの課題で回しています。
ayaka_egaaa
0
190
マネジメントされる側の仕事は「文句」を言うこと
riyaamemiya
4
3.3k
田んぼから始まる挑戦 〜新米農家の1年目〜
miu_crescent
PRO
0
360
プロダクションコードにおける encoding/json から encoding/json/v2 へのスムーズな移行
sansantech
PRO
1
420
マネージャーをエスパーにしない マネジメントされる側から始める、働きやすい現場づくり
comi190327
0
380
ゼロから作るWebアプリの新定番!?Amplify Gen 2 × AWS Blocksで実現する「開発速度とRDBの柔軟性のいいとこ取り」
amixedcolor
1
260
異夢同船〜異なる夢でも同じ船でなんとかする〜
fortegp05
0
230
うちなーぐちが認識できるなら、秋田弁もいけるはず!? Amazon Transcribe方言チューニング検証
ryouto715
1
170
Featured
See All Featured
Ten Tips & Tricks for a 🌱 transition
stuffmc
1
280
DevOps and Value Stream Thinking: Enabling flow, efficiency and business value
helenjbeal
2
450
Leo the Paperboy
mayatellez
11
2.5k
Exploring the Power of Turbo Streams & Action Cable | RailsConf2023
kevinliebholz
37
6.7k
職位にかかわらず全員がリーダーシップを発揮するチーム作り / Building a team where everyone can demonstrate leadership regardless of position
madoxten
70
69k
16th Malabo Montpellier Forum Presentation
akademiya2063
PRO
0
460
AI Search: Where Are We & What Can We Do About It?
aleyda
0
8.2k
Self-Hosted WebAssembly Runtime for Runtime-Neutral Checkpoint/Restore in Edge–Cloud Continuum
chikuwait
0
940
[RailsConf 2023] Rails as a piece of cake
palkan
59
7.1k
How to Get Subject Matter Experts Bought In and Actively Contributing to SEO & PR Initiatives.
livdayseo
1
240
The Success of Rails: Ensuring Growth for the Next 100 Years
eileencodes
47
8.4k
<Decoding/> the Language of Devs - We Love SEO 2024
nikkihalliwell
1
380