Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
A whirlwind tour through Lingual: ANSI SQL for ...
Search
André Kelpe
November 14, 2013
Programming
1
180
A whirlwind tour through Lingual: ANSI SQL for Apache Hadoop
Slides from my #devoxx 2013 talk about Cascading Lingual
André Kelpe
November 14, 2013
Tweet
Share
More Decks by André Kelpe
See All by André Kelpe
Cascading 3 and beyond
fs111
0
160
The Cascading (big) data application framework
fs111
1
230
SELECT ALL THE THINGS - Cascading Lingual, ANSI SQL for Apache Hadoop
fs111
0
190
Tor for everyone!
fs111
0
170
Large scale graph processing with apache giraph
fs111
2
5.4k
Other Decks in Programming
See All in Programming
Vitest Browser Mode への期待 / Vitest Browser Mode
odanado
PRO
1
510
4年間変わらなかった YOUTRUSTのアーキテクチャ
daiki1003
2
670
NEWTにおけるiOS18対応の進め方
ryu1sazae
0
330
CSC509 Lecture 04
javiergs
PRO
0
160
レイトレ合宿10 レンダラー紹介 / Renderer Introduction, Ray Tracing Camp 10
shocker_0x15
0
630
Serverless renderování Webových komponent
rarous
PRO
0
130
(Deep|Web) Link support with expo-router
mrtry
0
190
App Store Connect APIで 作業時間を増やそう
mot_techtalk
3
130
Kotlin Multiplatform at Stable and Beyond (Kotlin Vienna, October 2024)
zsmb
2
410
UnJSで簡単に始めるCLIツール開発 / cli-tool-development-with-unjs
aoseyuu
2
380
CSC509 Lecture 05
javiergs
PRO
0
180
学生の時に開催したPerl入学式をきっかけにエンジニアが組織に馴染むために勉強会を主催や仲間と参加して職能間の境界を越えていく
ohmori_yusuke
2
330
Featured
See All Featured
Understanding Cognitive Biases in Performance Measurement
bluesmoon
26
1.4k
The Invisible Side of Design
smashingmag
297
50k
I Don’t Have Time: Getting Over the Fear to Launch Your Podcast
jcasabona
27
1.9k
Build your cross-platform service in a week with App Engine
jlugia
229
18k
Gamification - CAS2011
davidbonilla
80
5k
It's Worth the Effort
3n
183
27k
ピンチをチャンスに:未来をつくるプロダクトロードマップ #pmconf2020
aki_iinuma
105
48k
Making the Leap to Tech Lead
cromwellryan
131
8.9k
Product Roadmaps are Hard
iamctodd
PRO
48
10k
Design and Strategy: How to Deal with People Who Don’t "Get" Design
morganepeng
126
18k
KATA
mclloyd
29
13k
Teambox: Starting and Learning
jrom
132
8.7k
Transcript
@fs111 #DV13 #lingual A whirlwind tour through Lingual: ANSI SQL
for Apache Hadoop André Kelpe concurrentinc.com
@fs111 #DV13 #lingual Speaker André Kelpe Software Engineer at Concurrent
The company behind Cascading and Lingual concurrentinc.com / @concurrent
[email protected]
@fs111
@fs111 #DV13 #lingual Agenda Cascading and Lingual Lingual: design goals
Lingual: features Demo: Lingual in action Q&A
@fs111 #DV13 #lingual Cascading http://cascading.org
@fs111 #DV13 #lingual Cascading terminology Taps are sources and sinks
for data Schemes represent the format of the data Pipes are connecting Taps
@fs111 #DV13 #lingual Cascading terminology Tuples flow through Pipes Fields
describe the Tuples Operations are executed on Tuples in TupleStreams Flows get scheduled and executed
@fs111 #DV13 #lingual Not just Java!
@fs111 #DV13 #lingual Scalding Scala DSL on top of Cascading
Developed by twitter https://github.com/twitter/scalding/
@fs111 #DV13 #lingual Cascalog Clojure DSL on top of Cascading
Inspired by datalog https://github.com/nathanmarz/cascalog
@fs111 #DV13 #lingual ANSI SQL via Lingual http://www.cascading.org/lingual/
@fs111 #DV13 #lingual Lingual – design goals 1/3 Immediate Data
Access SQL access via Shell or JDBC driver
@fs111 #DV13 #lingual Lingual – design goals 2/3 Simplify SQL
Migration move SQL workflows on your Hadoop Cluster via Cascading flows or JDBC driver
@fs111 #DV13 #lingual Lingual – design goals 3/3 Simplify System
& Data Integration Read and write from hdfs, jdbc, memcached, HBase, redshift...
@fs111 #DV13 #lingual Lingual – ANSI SQL on Cascading http://www.cascading.org/lingual/
@fs111 #DV13 #lingual Lingual and Cascading are about batch processing
large amounts of data
@fs111 #DV13 #lingual Demo
@fs111 #DV13 #lingual Lingual – ANSI SQL on Cascading http://www.cascading.org/lingual/
@fs111 #DV13 #lingual Q&A @fs111 / http://concurrentinc.com http://cascading.org/lingual
@fs111 #DV13 #lingual Link collection http://www.cascading.org/lingual/ http://www.cascading.org/ http://docs.cascading.org/lingual/1.0/ https://github.com/Cascading/ http://concurrentinc.com
https://groups.google.com/forum/#!forum/lingual-user https://groups.google.com/forum/#!forum/cascading-user http://docs.cascading.org/impatient/ https://github.com/Cascading/vagrant-cascading-hadoop-cluster