Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Container + Big Data Shinect discussions

Avatar for Timothy Chen Timothy Chen
March 23, 2016
Technology
120
0

Container + Big Data Shinect discussions

Container + Big Data Shinect discussions

Avatar for Timothy Chen

Timothy Chen

March 23, 2016

More Decks by Timothy Chen

See All by Timothy Chen
Spark Summit 2017 SF - Spark on Kubernetes
Avatar for Timothy Chen tnachen
2
440
Spark on Mesos - MesosCon 2016
Avatar for Timothy Chen tnachen
0
290
Containers in Mesos: Present and Future
Avatar for Timothy Chen tnachen
0
1.8k
Past, Present and Future of Containers
Avatar for Timothy Chen tnachen
0
2.5k
Deep dive Spark on Mesos
Avatar for Timothy Chen tnachen
0
340
Scale your Docker containers with Mesos
Avatar for Timothy Chen tnachen
0
380
Docker Swarm + Mesos
Avatar for Timothy Chen tnachen
8
7.6k
Scale your Docker containers with Mesos
Avatar for Timothy Chen tnachen
3
660
Introduction To Apache Drill - Big Data Bellevue 20131023
Avatar for Timothy Chen tnachen
2
3.4k

Other Decks in Technology

See All in Technology
A Harness for Behaviour: how to get AI to generate code that does what we intend, or "TDD in the age of AI"
Avatar for Matteo Vaccari xpmatteo
0
420
シンデレラなんかになりたくない！ガラスの靴が割れた時代にどう歩く？
Avatar for Nomizo Nomizo nomizone
0
190
サプライチェーン攻撃への備えについて考えている #湘なんか
Avatar for すてにゃん stefafafan
3
2.4k
checker.tsにチキンレースを仕掛けてみた：型エラー(TS2589)が発生する境界線を求めて
Avatar for Hal hal_spidernight
1
200
AIコーディングエージェントの活用で、コードは静かに肥大化した
Avatar for 篠田 陽介 yosukeshinoda
1
360
Pythonでベイズモデリング
Avatar for Soogie soogie
0
180
Amazon Bedrock 経由の Claude Cowork を試してみよう・MCP にも繋いでみよう
Avatar for Kazuya Sugimoto sugimomoto
0
180
AI とサービス・デザイン / AI and Service Design
Avatar for Kenji Saito ks91
PRO
0
170
Gradle×GitHub_ActionsでCI時間を約50%短縮 ジョブ分割の設計と落とし穴 / Cutting CI Time by ~50% with Gradle and GitHub Actions: Job-Splitting Design and Pitfalls
Avatar for 冨澤宝斗 takatty
0
120
コーポレートサイトのアクセシビリティ改善とJIS準拠への実践
Avatar for LINEヤフーTech (LY Corporation Tech) lycorptech_jp
PRO
2
140
TSKaigi 2026 - 10秒のビルドを1秒へ：tsdownが切り拓く2026年のTypeScriptライブラリ開発
Avatar for teamLab teamlab
PRO
2
260
AI時代の私の技術インプットとアウトプット術
Avatar for tonkotsuboy_com tonkotsuboy_com
7
4.8k

Featured

See All Featured
Creating an realtime collaboration tool: Agile Flush - .NET Oxford
Avatar for Marc Duiker marcduiker
35
2.4k
RailsConf & Balkan Ruby 2019: The Past, Present, and Future of Rails at GitHub
Avatar for Eileen M. Uchitelle eileencodes
141
35k
Bootstrapping a Software Product
Avatar for Garrett Dimon garrettdimon
PRO
307
120k
Taking LLMs out of the black box: A practical guide to human-in-the-loop distillation
Avatar for Ines Montani inesmontani
PRO
3
2.2k
Conquering PDFs: document understanding beyond plain text
Avatar for Ines Montani inesmontani
PRO
4
2.7k
Paper Plane (Part 1)
Avatar for Katie Cordina Lindsey katiecoart
PRO
0
7.8k
SERP Conf. Vienna - Web Accessibility: Optimizing for Inclusivity and SEO
Avatar for Sara Fernández Carmona sarafernandez
2
1.4k
Beyond borders and beyond the search box: How to win the global "messy middle" with AI-driven SEO
Avatar for David Carrasco davidcarrasco
3
140
Imperfection Machines: The Place of Print at Facebook
Avatar for Scott Boms scottboms
270
14k
The World Runs on Bad Software
Avatar for Brandon Keepers bkeepers
PRO
72
12k
Leveraging Curiosity to Care for An Aging Population
Avatar for Cassini Nazir cassininazir
1
240
Code Reviewing Like a Champion
Avatar for maltzj maltzj
528
40k

Transcript

  1. Containers + Big Data: Present and Future By Timothy Chen

    Apache Mesos & Drill PMC, Lead Engineer @ Mesosphere
  2. None

  3. Containers • Light weight • Deploy cycle reduced • Enterprise-ready

    (soon) open source solutions • Right timing!

  4. YARN Mesos

  5. Cluster Manager

  6. Multi-tenancy • Resource Isolation • Fair sharing / Scheduling •

    Performance Isolation • Security • More..

  7. Container == process

  8. Multi-tenant Between users and systems!

  9. Future...

  10. Everything in Container

  11. None

  12. Stop reimplementing the wheel, use your OS!

  13. Big data systems as an App / Pod

  14. Utilization and Guarantees