Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Container + Big Data Shinect discussions

Timothy Chen
March 23, 2016
Technology
0
75

Container + Big Data Shinect discussions

Container + Big Data Shinect discussions

Timothy Chen

March 23, 2016
Tweet

More Decks by Timothy Chen

See All by Timothy Chen
Spark Summit 2017 SF - Spark on Kubernetes
tnachen
2
390
Spark on Mesos - MesosCon 2016
tnachen
0
230
Containers in Mesos: Present and Future
tnachen
0
1.7k
Past, Present and Future of Containers
tnachen
0
2.4k
Deep dive Spark on Mesos
tnachen
0
250
Scale your Docker containers with Mesos
tnachen
0
330
Docker Swarm + Mesos
tnachen
8
7.5k
Scale your Docker containers with Mesos
tnachen
3
610
Introduction To Apache Drill - Big Data Bellevue 20131023
tnachen
2
3.4k

Other Decks in Technology

See All in Technology
SREとしてスタッフエンジニアを目指す / SRE Kaigi 2025
tjun
15
5.2k
タイミーのデータ活用を支えるdbt Cloud導入とこれから
ttccddtoki
2
470
srekaigi2025-hajimete-ippo-aws
masakichieng
0
170
あなたの興味は信頼性？それとも生産性？ SREとしてのキャリアに悩むみなさまに伝えたい選択肢
jacopen
5
2.3k
デザインシステムを始めるために取り組んだこと - TechTrain x ゆめみ ここを意識してほしい！リファクタリング勉強会
kajitack
2
290
Plants vs thieves: Automated Tests in the World of Web Security
leichteckig
0
140
第27回クラウド女子会 ～re:Invent 振り返りLT会～ 宣言型ポリシー、使ってみたらこうだった！
itkr2305
0
280
論文紹介 ”Long-Context LLMs Meet RAG: Overcoming Challenges for Long Inputs in RAG” @GDG Tokyo
shukob
0
240
一人から始めたSREチーム3年の歩み - 求められるスキルの変化とチームのあり方 - / The three-year journey of the SRE team, which started all by myself
vtryo
7
5.1k
GraphRAG: What I Thought I Knew (But Didn’t)
sashimimochi
0
130
2週に1度のビッグバンリリースをデイリーリリース化するまでの苦悩 ~急成長するスタートアップのリアルな裏側~
kworkdev
PRO
8
5.9k
ハンズオンで学ぶ Databricks - Databricksにおけるデータエンジニアリング
taka_aki
1
2k

Featured

See All Featured
Being A Developer After 40
akosma
89
590k
個人開発の失敗を避けるイケてる考え方 / tips for indie hackers
panda_program
98
18k
実際に使うSQLの書き方 徹底解説 / pgcon21j-tutorial
soudai
174
51k
ピンチをチャンスに：未来をつくるプロダクトロードマップ #pmconf2020
aki_iinuma
113
50k
[RailsConf 2023] Rails as a piece of cake
palkan
53
5.2k
Optimising Largest Contentful Paint
csswizardry
33
3k
The Art of Programming - Codeland 2020
erikaheidi
53
13k
A Tale of Four Properties
chriscoyier
157
23k
Fashionably flexible responsive web design (full day workshop)
malarkey
406
66k
Learning to Love Humans: Emotional Interface Design
aarron
274
40k
Chrome DevTools: State of the Union 2024 - Debugging React & Beyond
addyosmani
3
260
Practical Orchestrator
shlominoach
186
10k

Transcript

  1. Containers + Big Data: Present and Future By Timothy Chen

    Apache Mesos & Drill PMC, Lead Engineer @ Mesosphere
  2. None

  3. Containers • Light weight • Deploy cycle reduced • Enterprise-ready

    (soon) open source solutions • Right timing!

  4. YARN Mesos

  5. Cluster Manager

  6. Multi-tenancy • Resource Isolation • Fair sharing / Scheduling •

    Performance Isolation • Security • More..

  7. Container == process

  8. Multi-tenant Between users and systems!

  9. Future...

  10. Everything in Container

  11. None

  12. Stop reimplementing the wheel, use your OS!

  13. Big data systems as an App / Pod

  14. Utilization and Guarantees