Upgrade to Pro — share decks privately, control downloads, hide ads and more …

A whirlwind tour through Lingual: ANSI SQL for ...

Sponsored · Ship Features Fearlessly Turn features on and off without deploys. Used by thousands of Ruby developers. →
Avatar for André Kelpe André Kelpe
November 14, 2013
Programming
200
1

A whirlwind tour through Lingual: ANSI SQL for Apache Hadoop

Slides from my #devoxx 2013 talk about Cascading Lingual

Avatar for André Kelpe

André Kelpe

November 14, 2013

More Decks by André Kelpe

See All by André Kelpe
Cascading 3 and beyond
Avatar for André Kelpe fs111
0
190
The Cascading (big) data application framework
Avatar for André Kelpe fs111
1
250
SELECT ALL THE THINGS - Cascading Lingual, ANSI SQL for Apache Hadoop
Avatar for André Kelpe fs111
0
220
Tor for everyone!
Avatar for André Kelpe fs111
0
210
Large scale graph processing with apache giraph
Avatar for André Kelpe fs111
2
5.6k

Other Decks in Programming

See All in Programming
サークル参加から学ぶ、小さな事業の回し方
Avatar for yuzneri yuzneri
0
190
AI時代のエンジニアリングの原則 / Engineering Principles in the AI ​​Era
Avatar for haru860 haru860
0
1.3k
When benchmarks go bad - what I learned from measuring performance wrong
Avatar for Holly Cummins hollycummins
0
390
Agent Skills を社内で育てる仕組み作り
Avatar for jackchuka jackchuka
1
2k
ハーネスエンジニアリングとは？
Avatar for kinopee kinopeee
13
7.1k
ReactとSvelteのその先、Ripple-TS / Beyond React and Svelte: Ripple-TS
Avatar for TOMIKAWA Sotaro ssssota
0
120
[RubyKaigi 2026] Require Hooks
Avatar for Vladimir Dementyev palkan
1
320
サプライチェーン攻撃対策「層を重ねて落ちない壁」を10日間で組み上げた話 #TechLeadConf2026
Avatar for Kashun Yoshida kashewnuts
1
290
SREに優しいTerraform構成 modulesとstateの組み方
Avatar for hiyanger hiyanger
2
180
Symfony AI in Action - SymfonyLive Berlin 2026
Avatar for Christopher Hertel chr_hertel
1
150
関係性から理解する"同一性"の型用語たち
Avatar for pvcresin pvcresin
1
170
要はバランスからの卒業 #yumemi_grow
Avatar for Takuma Kajikawa kajitack
0
170

Featured

See All Featured
Let's Do A Bunch of Simple Stuff to Make Websites Faster
Avatar for Chris Coyier chriscoyier
508
140k
Lessons Learnt from Crawling 1000+ Websites
Avatar for Charles Meaden charlesmeaden
PRO
1
1.2k
Groundhog Day: Seeking Process in Gaming for Health
Avatar for Sebastian Deterding codingconduct
0
180
エンジニアに許された特別な時間の終わり
Avatar for watany watany
106
240k
Distributed Sagas: A Protocol for Coordinating Microservices
Avatar for Caitie McCaffrey caitiem20
333
22k
The Anti-SEO Checklist Checklist. Pubcon Cyber Week
Avatar for Ryan Jones ryanjones
0
140
Documentation Writing (for coders)
Avatar for Carmen Chung carmenintech
77
5.3k
Visualizing Your Data: Incorporating Mongo into Loggly Infrastructure
Avatar for mongodb mongodb
49
9.9k
How to build a perfect <img>
Avatar for Jono Alderson jonoalderson
1
5.5k
Impact Scores and Hybrid Strategies: The future of link building
Avatar for Tamara Novitovic tamaranovitovic
0
280
Paper Plane (Part 1)
Avatar for Katie Cordina Lindsey katiecoart
PRO
0
7.6k
世界の人気アプリ100個を分析して見えたペイウォール設計の心得
Avatar for Akihiro Kokubo akihiro_kokubo
PRO
70
39k

Transcript

  1. @fs111 #DV13 #lingual A whirlwind tour through Lingual: ANSI SQL

    for Apache Hadoop André Kelpe concurrentinc.com

  2. @fs111 #DV13 #lingual Speaker André Kelpe Software Engineer at Concurrent

    The company behind Cascading and Lingual concurrentinc.com / @concurrent [email protected] @fs111

  3. @fs111 #DV13 #lingual Agenda Cascading and Lingual Lingual: design goals

    Lingual: features Demo: Lingual in action Q&A

  4. @fs111 #DV13 #lingual Cascading http://cascading.org

  5. @fs111 #DV13 #lingual Cascading terminology Taps are sources and sinks

    for data Schemes represent the format of the data Pipes are connecting Taps

  6. @fs111 #DV13 #lingual Cascading terminology Tuples flow through Pipes Fields

    describe the Tuples Operations are executed on Tuples in TupleStreams Flows get scheduled and executed

  7. @fs111 #DV13 #lingual Not just Java!

  8. @fs111 #DV13 #lingual Scalding Scala DSL on top of Cascading

    Developed by twitter https://github.com/twitter/scalding/

  9. @fs111 #DV13 #lingual Cascalog Clojure DSL on top of Cascading

    Inspired by datalog https://github.com/nathanmarz/cascalog

  10. @fs111 #DV13 #lingual ANSI SQL via Lingual http://www.cascading.org/lingual/

  11. @fs111 #DV13 #lingual Lingual – design goals 1/3 Immediate Data

    Access SQL access via Shell or JDBC driver

  12. @fs111 #DV13 #lingual Lingual – design goals 2/3 Simplify SQL

    Migration move SQL workflows on your Hadoop Cluster via Cascading flows or JDBC driver

  13. @fs111 #DV13 #lingual Lingual – design goals 3/3 Simplify System

    & Data Integration Read and write from hdfs, jdbc, memcached, HBase, redshift...

  14. @fs111 #DV13 #lingual Lingual – ANSI SQL on Cascading http://www.cascading.org/lingual/

  15. @fs111 #DV13 #lingual Lingual and Cascading are about batch processing

    large amounts of data

  16. @fs111 #DV13 #lingual Demo

  17. @fs111 #DV13 #lingual Lingual – ANSI SQL on Cascading http://www.cascading.org/lingual/

  18. @fs111 #DV13 #lingual Q&A @fs111 / http://concurrentinc.com http://cascading.org/lingual

  19. @fs111 #DV13 #lingual Link collection http://www.cascading.org/lingual/ http://www.cascading.org/ http://docs.cascading.org/lingual/1.0/ https://github.com/Cascading/ http://concurrentinc.com

    https://groups.google.com/forum/#!forum/lingual-user https://groups.google.com/forum/#!forum/cascading-user http://docs.cascading.org/impatient/ https://github.com/Cascading/vagrant-cascading-hadoop-cluster