Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
A whirlwind tour through Lingual: ANSI SQL for ...
Search
André Kelpe
November 14, 2013
Programming
1
190
A whirlwind tour through Lingual: ANSI SQL for Apache Hadoop
Slides from my #devoxx 2013 talk about Cascading Lingual
André Kelpe
November 14, 2013
Tweet
Share
More Decks by André Kelpe
See All by André Kelpe
Cascading 3 and beyond
fs111
0
170
The Cascading (big) data application framework
fs111
1
230
SELECT ALL THE THINGS - Cascading Lingual, ANSI SQL for Apache Hadoop
fs111
0
200
Tor for everyone!
fs111
0
190
Large scale graph processing with apache giraph
fs111
2
5.5k
Other Decks in Programming
See All in Programming
코딩 에이전트 체크리스트: Claude Code ver.
nacyot
0
1k
Go製CLIツールをnpmで配布するには
syumai
1
920
AI Ramen Fight
yusukebe
0
120
[Codecon - 2025] Como não odiar seus testes
camilacampos
0
100
AWS Summit Japan 2024と2025の比較/はじめてのKiro、今あなたは岐路に立つ
satoshi256kbyte
1
260
AI Agent 時代のソフトウェア開発を支える AWS Cloud Development Kit (CDK)
konokenj
6
1k
AIコーディングエージェント全社導入とセキュリティ対策
hikaruegashira
15
8.8k
React 使いじゃなくても知っておきたい教養としての React
oukayuka
18
4.7k
CDK引数設計道場100本ノック
badmintoncryer
2
590
リッチエディターを安全に開発・運用するために
unachang113
1
310
中級グラフィックス入門~効率的なメッシュレット描画~
projectasura
3
2k
可変性を制する設計: 構造と振る舞いから考える概念モデリングとその実装
a_suenami
8
1.1k
Featured
See All Featured
Building Better People: How to give real-time feedback that sticks.
wjessup
367
19k
YesSQL, Process and Tooling at Scale
rocio
173
14k
Mobile First: as difficult as doing things right
swwweet
223
9.7k
The Cult of Friendly URLs
andyhume
79
6.5k
jQuery: Nuts, Bolts and Bling
dougneiner
63
7.8k
The Illustrated Children's Guide to Kubernetes
chrisshort
48
50k
Six Lessons from altMBA
skipperchong
28
3.9k
Building a Modern Day E-commerce SEO Strategy
aleyda
42
7.4k
Gamification - CAS2011
davidbonilla
81
5.4k
Being A Developer After 40
akosma
90
590k
How to Think Like a Performance Engineer
csswizardry
25
1.8k
Typedesign – Prime Four
hannesfritz
42
2.7k
Transcript
@fs111 #DV13 #lingual A whirlwind tour through Lingual: ANSI SQL
for Apache Hadoop André Kelpe concurrentinc.com
@fs111 #DV13 #lingual Speaker André Kelpe Software Engineer at Concurrent
The company behind Cascading and Lingual concurrentinc.com / @concurrent
[email protected]
@fs111
@fs111 #DV13 #lingual Agenda Cascading and Lingual Lingual: design goals
Lingual: features Demo: Lingual in action Q&A
@fs111 #DV13 #lingual Cascading http://cascading.org
@fs111 #DV13 #lingual Cascading terminology Taps are sources and sinks
for data Schemes represent the format of the data Pipes are connecting Taps
@fs111 #DV13 #lingual Cascading terminology Tuples flow through Pipes Fields
describe the Tuples Operations are executed on Tuples in TupleStreams Flows get scheduled and executed
@fs111 #DV13 #lingual Not just Java!
@fs111 #DV13 #lingual Scalding Scala DSL on top of Cascading
Developed by twitter https://github.com/twitter/scalding/
@fs111 #DV13 #lingual Cascalog Clojure DSL on top of Cascading
Inspired by datalog https://github.com/nathanmarz/cascalog
@fs111 #DV13 #lingual ANSI SQL via Lingual http://www.cascading.org/lingual/
@fs111 #DV13 #lingual Lingual – design goals 1/3 Immediate Data
Access SQL access via Shell or JDBC driver
@fs111 #DV13 #lingual Lingual – design goals 2/3 Simplify SQL
Migration move SQL workflows on your Hadoop Cluster via Cascading flows or JDBC driver
@fs111 #DV13 #lingual Lingual – design goals 3/3 Simplify System
& Data Integration Read and write from hdfs, jdbc, memcached, HBase, redshift...
@fs111 #DV13 #lingual Lingual – ANSI SQL on Cascading http://www.cascading.org/lingual/
@fs111 #DV13 #lingual Lingual and Cascading are about batch processing
large amounts of data
@fs111 #DV13 #lingual Demo
@fs111 #DV13 #lingual Lingual – ANSI SQL on Cascading http://www.cascading.org/lingual/
@fs111 #DV13 #lingual Q&A @fs111 / http://concurrentinc.com http://cascading.org/lingual
@fs111 #DV13 #lingual Link collection http://www.cascading.org/lingual/ http://www.cascading.org/ http://docs.cascading.org/lingual/1.0/ https://github.com/Cascading/ http://concurrentinc.com
https://groups.google.com/forum/#!forum/lingual-user https://groups.google.com/forum/#!forum/cascading-user http://docs.cascading.org/impatient/ https://github.com/Cascading/vagrant-cascading-hadoop-cluster