Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Container + Big Data Shinect discussions

Avatar for Timothy Chen Timothy Chen
March 23, 2016
Technology
0
93

Container + Big Data Shinect discussions

Container + Big Data Shinect discussions

Avatar for Timothy Chen

Timothy Chen

March 23, 2016
Tweet

More Decks by Timothy Chen

See All by Timothy Chen
Spark Summit 2017 SF - Spark on Kubernetes
Avatar for Timothy Chen tnachen
2
420
Spark on Mesos - MesosCon 2016
Avatar for Timothy Chen tnachen
0
260
Containers in Mesos: Present and Future
Avatar for Timothy Chen tnachen
0
1.7k
Past, Present and Future of Containers
Avatar for Timothy Chen tnachen
0
2.5k
Deep dive Spark on Mesos
Avatar for Timothy Chen tnachen
0
300
Scale your Docker containers with Mesos
Avatar for Timothy Chen tnachen
0
350
Docker Swarm + Mesos
Avatar for Timothy Chen tnachen
8
7.5k
Scale your Docker containers with Mesos
Avatar for Timothy Chen tnachen
3
640
Introduction To Apache Drill - Big Data Bellevue 20131023
Avatar for Timothy Chen tnachen
2
3.4k

Other Decks in Technology

See All in Technology
Axon Frameworkのイベントストアを独自拡張した話
Avatar for ZOZO Developers zozotech
PRO
0
210
機密情報の漏洩を防げ！ Webフロントエンド開発で意識すべき漏洩パターンとその対策
Avatar for mizdra mizdra
PRO
10
3.7k
ABEMAのCM配信を支えるスケーラブルな分散カウンタの実装
Avatar for Honoka Toda hono0130
4
1k
米軍Platform One / Black Pearlに学ぶ 極限環境DevSecOps
Avatar for jyoshise jyoshise
2
510
2ヶ月で新規事業のシステムを0から立ち上げるスタートアップの舞台裏
Avatar for Shoma Okamoto shmokmt
0
240
社内外から"使ってもらえる"データ基盤を支えるアーキテクチャの秘訣/登壇資料（飯塚 大地・高橋 一貴）
Avatar for Hacobu hacobu
PRO
0
1.8k
生成AI時代に若手エンジニアが最初に覚えるべき内容と、その学習法
Avatar for starfish719 starfish719
2
520
JJUG CCC 2025 Fall バッチ性能!!劇的ビフォーアフター
Avatar for HayashiYuichiro hayashiyuu1
1
370
Moto: Latent Motion Token as the Bridging Language for Learning Robot Manipulation from Videos
Avatar for peisuke peisuke
0
160
国産クラウドを支える設計とチームの変遷
“技術・組織・ミッション”
Avatar for kazeburo kazeburo
3
3.6k
事業状況で変化する最適解。進化し続ける開発組織とアーキテクチャ
Avatar for recruiting@caddi.jp caddi_eng
1
2.1k
組織の“見えない壁”を越えよ！エンタープライズシフトに必須な3つのPMの「在り方」変革 #pmconf2025
Avatar for Masakazu Inaba masakazu178
1
360

Featured

See All Featured
RailsConf 2023
Avatar for Aaron Patterson tenderlove
30
1.3k
Designing for Performance
Avatar for Lara Hogan lara
610
69k
Large-scale JavaScript Application Architecture
Avatar for Addy Osmani addyosmani
514
110k
Designing for humans not robots
Avatar for Tammie Lister tammielis
254
26k
Keith and Marios Guide to Fast Websites
Avatar for Keith Pitt keithpitt
413
23k
Learning to Love Humans: Emotional Interface Design
Avatar for Aarron Walter aarron
274
41k
Chrome DevTools: State of the Union 2024 - Debugging React & Beyond
Avatar for Addy Osmani addyosmani
9
980
Bootstrapping a Software Product
Avatar for Garrett Dimon garrettdimon
PRO
307
110k
The Web Performance Landscape in 2024 [PerfNow 2024]
Avatar for Tammy Everts tammyeverts
11
930
Into the Great Unknown - MozCon
Avatar for Noah Learner thekraken
40
2.2k
CoffeeScript is Beautiful & I Never Want to Write Plain JavaScript Again
Avatar for Sam Stephenson sstephenson
162
15k
The Hidden Cost of Media on the Web [PixelPalooza 2025]
Avatar for Tammy Everts tammyeverts
1
35

Transcript

  1. Containers + Big Data: Present and Future By Timothy Chen

    Apache Mesos & Drill PMC, Lead Engineer @ Mesosphere
  2. None

  3. Containers • Light weight • Deploy cycle reduced • Enterprise-ready

    (soon) open source solutions • Right timing!

  4. YARN Mesos

  5. Cluster Manager

  6. Multi-tenancy • Resource Isolation • Fair sharing / Scheduling •

    Performance Isolation • Security • More..

  7. Container == process

  8. Multi-tenant Between users and systems!

  9. Future...

  10. Everything in Container

  11. None

  12. Stop reimplementing the wheel, use your OS!

  13. Big data systems as an App / Pod

  14. Utilization and Guarantees