Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
A Computer Called "Watson"
Search
James Thomas
September 17, 2012
Technology
1
450
A Computer Called "Watson"
LondonJS talk on the technology behind IBM Watson.
James Thomas
September 17, 2012
Tweet
Share
More Decks by James Thomas
See All by James Thomas
Apache OpenWhisk - Pluggable Event Providers
jthomas
0
420
Confessions of a (nervous) public speaker
jthomas
0
120
Serverless Machine Learning with TensorFlow.js
jthomas
1
760
Serverless: The Missing Manual
jthomas
1
2.3k
Serverless Swift with Apache OpenWhisk
jthomas
0
290
Serverless Backends and APIs using Swift and Apache OpenWhisk
jthomas
0
97
Predicting the impact of serverless computing, lessons from economic history
jthomas
0
120
Taming Serverless Dragons - Multi-Provider Serverless Apps
jthomas
0
3.1k
Microservices Without Servers
jthomas
2
2.8k
Other Decks in Technology
See All in Technology
o11yで育てる、強い内製開発組織
_awache
3
110
BirdCLEF+2025 Noir 5位解法紹介
myso
0
190
20250929_QaaS_vol20
mura_shin
0
110
非エンジニアのあなたもできる&もうやってる!コンテキストエンジニアリング
findy_eventslides
3
900
Oracle Base Database Service 技術詳細
oracle4engineer
PRO
11
77k
Goにおける 生成AIによるコード生成の ベンチマーク評価入門
daisuketakeda
2
100
Goに育てられ開発者向けセキュリティ事業を立ち上げた僕が今向き合う、AI × セキュリティの最前線 / Go Conference 2025
flatt_security
0
350
ユニットテストに対する考え方の変遷 / Everyone should watch his live coding
mdstoy
0
120
M5製品で作るポン置きセルラー対応カメラ
sayacom
0
130
Pythonによる契約プログラミング入門 / PyCon JP 2025
7pairs
5
2.5k
Geospatialの世界最前線を探る [2025年版]
dayjournal
3
490
関係性が駆動するアジャイル──GPTに人格を与えたら、対話を通してふりかえりを習慣化できた話
mhlyc
0
130
Featured
See All Featured
Why Our Code Smells
bkeepers
PRO
339
57k
Exploring the Power of Turbo Streams & Action Cable | RailsConf2023
kevinliebholz
34
6.1k
Java REST API Framework Comparison - PWX 2021
mraible
33
8.8k
Code Review Best Practice
trishagee
72
19k
Thoughts on Productivity
jonyablonski
70
4.9k
Visualizing Your Data: Incorporating Mongo into Loggly Infrastructure
mongodb
48
9.7k
A designer walks into a library…
pauljervisheath
209
24k
The Art of Programming - Codeland 2020
erikaheidi
56
14k
Being A Developer After 40
akosma
91
590k
Producing Creativity
orderedlist
PRO
347
40k
Stop Working from a Prison Cell
hatefulcrawdad
271
21k
Put a Button on it: Removing Barriers to Going Fast.
kastner
60
4k
Transcript
A Computer Called “Watson” James Thomas, IBM Emerging Tech COVER
PHOTO Add cover photo Monday, 17 September 2012
GARY KASPAROV VERSUS “DEEP BLUE” MAY 1997 Monday, 17 September
2012
BLUE GENE DECEMBER 1999 Monday, 17 September 2012
“Fast forward to 2004...” Monday, 17 September 2012
JEOPARDY QUIZ SHOW Monday, 17 September 2012
KEN JENNINGS CHAMPION OF CHAMPIONS Monday, 17 September 2012
KEN JENNINGS CHAMPION OF CHAMPIONS KEN’S PERFORMANCE Monday, 17 September
2012
What if we build a computer to play Jeopardy? Monday,
17 September 2012
What if we build a computer to play Jeopardy? It’s
way too hard Monday, 17 September 2012
Jeopardy! Finite, mathematically defined search space Limited number of moves
and states Symbols completed grounded in mathematical rules of the games Chess Enormous problem domain and search space Source material is inherently unstructured information Advanced natural language processing Monday, 17 September 2012
BASELINE PERFORMANCE INITIAL EXPERIMENT Monday, 17 September 2012
“Fast forward to 2007...” Monday, 17 September 2012
DR. DAVID FERRUCCI - “WATSON” TEAM DIRECTOR 2007 - 2011
Monday, 17 September 2012
SIMULATING JEOPARDY! MATCHES Monday, 17 September 2012
BASELINE PERFORMANCE INITIAL EXPERIMENT Monday, 17 September 2012
WATSON WAS READY FEBRUARY 2011 Monday, 17 September 2012
Watson Jeopardy! Challenge February 14-16 2011. Ken Jennings Brad Rutter
Monday, 17 September 2012
WATSON 1 - HUMANS 0 FEBRUARY 16, 2011 Monday, 17
September 2012
“Its largest airport is named for a WWII hero; its
second largest, for a WWII battle” Category: US Cities Monday, 17 September 2012
“Its largest airport is named for a WWII hero; its
second largest, for a WWII battle” Category: US Cities Watson: Toronto Monday, 17 September 2012
How does it work? Monday, 17 September 2012
WATSON ARCHITECTURE - DEEPQA MASSIVELY PARALLEL PROBABILISTIC EVIDENCE-BASED ARCHITECTURE Monday,
17 September 2012
DEEPQA ARCHITECTURE PHASES Question Analysis Primary Search Candidate Answer Generation
Evidence Retrieval Evidence Scoring Merging and Ranking Monday, 17 September 2012
DEEPQA ARCHITECTURAL PHASES QUESTION ANALYSIS CATEGORY: CAPITALS QUESTION: WHAT IS
THE CAPITAL OF SAMOA? Monday, 17 September 2012
DEEPQA ARCHITECTURAL PHASES QUESTION ANALYSIS CATEGORY: POETS & POETRY QUESTION:
HE WAS A BANK CLERK IN THE YUKON BEFORE HE PUBLISHED “SONGS OF SOURDOUGH” IN 1907. Monday, 17 September 2012
DEEPQA ARCHITECTURAL PHASES QUESTION ANALYSIS CATEGORY: POETS & POETRY QUESTION:
HE WAS A BANK CLERK IN THE YUKON BEFORE HE PUBLISHED “SONGS OF SOURDOUGH” IN 1907. DISCOVER: FOCUS Monday, 17 September 2012
DEEPQA ARCHITECTURAL PHASES QUESTION ANALYSIS CATEGORY: POETS & POETRY QUESTION:
HE WAS A BANK CLERK IN THE YUKON BEFORE HE PUBLISHED “SONGS OF SOURDOUGH” IN 1907. DISCOVER: LEXICAL ANSWER TYPE Monday, 17 September 2012
DEEPQA ARCHITECTURAL PHASES QUESTION ANALYSIS CATEGORY: POETS & POETRY QUESTION:
HE WAS A BANK CLERK IN THE YUKON BEFORE HE PUBLISHED “SONGS OF SOURDOUGH” IN 1907. DISCOVER: RELATIONSHIPS Monday, 17 September 2012
DEEPQA ARCHITECTURAL PHASES QUESTION ANALYSIS CATEGORY: POETS & POETRY QUESTION:
HE WAS A BANK CLERK IN THE YUKON BEFORE HE PUBLISHED “SONGS OF SOURDOUGH” IN 1907. DISCOVER: QUESTION CLASS Monday, 17 September 2012
DEEPQA ARCHITECTURAL PHASES HYPOTHESIS GENERATION Hypothesis generation consists of two
phases... Monday, 17 September 2012
DEEPQA ARCHITECTURAL PHASES HYPOTHESIS GENERATION Primary Search Monday, 17 September
2012
DEEPQA ARCHITECTURAL PHASES HYPOTHESIS GENERATION Data Sources - Unstructured Wikipedia
IMDb Encyclopaedias Dictionaries Thesauri Literary Works Newswire Articles Monday, 17 September 2012
DEEPQA ARCHITECTURAL PHASES HYPOTHESIS GENERATION Data Sources - Structured DBpedia
Wordnet YAGO Monday, 17 September 2012
DEEPQA ARCHITECTURAL PHASES HYPOTHESIS GENERATION Candidate Answer Generation Monday, 17
September 2012
DEEPQA ARCHITECTURAL PHASES EVIDENCE RETRIEVAL Watson then searches for additional
evidence... Monday, 17 September 2012
DEEPQA ARCHITECTURAL PHASES EVIDENCE SCORING Deep Scoring Monday, 17 September
2012
DEEPQA ARCHITECTURAL PHASES EVIDENCE SCORING 0 0.25 0.5 0.75 1
Temporal Geospatial LAT Popularity Deep Scoring Christopher Columbus Vasco De Gamma Monday, 17 September 2012
DEEPQA ARCHITECTURAL PHASES FINAL MERGING AND RANKING Answer Merging Monday,
17 September 2012
DEEPQA ARCHITECTURAL PHASES FINAL MERGING AND RANKING Answer Merging Monday,
17 September 2012
DEEPQA ARCHITECTURAL PHASES FINAL MERGING AND RANKING Answer Ranking ISAAC
NEWTON [0.10, 0.45 ... 0.78, 0.12] ??? ANSWER SCORES RANK EDMOND HALLEY [0.31, 0.52 ... 0.08, 0.72] ??? WILHELM TEMPEL [0.21, 0.54 ... 0.18, 0.92] ??? PETER SELLERS [0.14, 0.04 ... 0.25, 0.41] ??? Monday, 17 September 2012
DEEPQA ARCHITECTURAL PHASES FINAL MERGING AND RANKING Monday, 17 September
2012
DEEPQA ARCHITECTURAL PHASES FINAL MERGING AND RANKING Answer Ranking ISAAC
NEWTON [0.10 ... 0.12] 3 ANSWER SCORES RANK EDMOND HALLEY [0.31 ... 0.72] 1 WILHELM TEMPEL [0.21 ... 0.92] 2 PETER SELLERS [0.14 ... 0.41] 4 0.14 CONFIDENCE 0.78 0.34 0.04 Monday, 17 September 2012
DEEPQA PERFORMANCE SCALING CHALLENGES Need to answer within a few
seconds.... Monday, 17 September 2012
DEEPQA PERFORMANCE SCALING CHALLENGES Need to answer within a few
seconds.... Early implementation took over two hours Monday, 17 September 2012
SCALING WATSON Monday, 17 September 2012
WATSON HARDWARE NINETY POWER 750 SERVERS 2880 POWER7 PROCESSOR CORES
16 TERABYTES OF RAM Monday, 17 September 2012
WATSON 1 - HUMANS 0 FEBRUARY 16, 2011 Monday, 17
September 2012
PUTTING WATSON TO WORK What’s next? Monday, 17 September 2012
PUTTING WATSON TO WORK HEALTHCARE Monday, 17 September 2012
QUESTIONS? Monday, 17 September 2012