Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Container + Big Data Shinect discussions

Timothy Chen
March 23, 2016
Technology
0
80

Container + Big Data Shinect discussions

Container + Big Data Shinect discussions

Timothy Chen

March 23, 2016
Tweet

More Decks by Timothy Chen

See All by Timothy Chen
Spark Summit 2017 SF - Spark on Kubernetes
tnachen
2
390
Spark on Mesos - MesosCon 2016
tnachen
0
240
Containers in Mesos: Present and Future
tnachen
0
1.7k
Past, Present and Future of Containers
tnachen
0
2.4k
Deep dive Spark on Mesos
tnachen
0
270
Scale your Docker containers with Mesos
tnachen
0
340
Docker Swarm + Mesos
tnachen
8
7.5k
Scale your Docker containers with Mesos
tnachen
3
620
Introduction To Apache Drill - Big Data Bellevue 20131023
tnachen
2
3.4k

Other Decks in Technology

See All in Technology
DevinでAI AWSエンジニア製造計画 序章 〜CDKを添えて〜/devin-load-to-aws-engineer
tomoki10
0
260
AIエージェント元年@日本生成AIユーザ会
shukob
1
280
"TEAM"を導入したら最高のエンジニア"Team"を実現できた / Deploying "TEAM" and Building the Best Engineering "Team"
yuj1osm
1
250
AIエージェント開発のノウハウと課題
pharma_x_tech
9
5.7k
Amazon Bedrock 2025 年の熱いアップデート (2025/3 時点)
icoxfog417
PRO
3
420
ライフステージの変化を乗り越える 探索型のキャリア選択
tenshoku_draft
2
370
あなたが人生で成功するための 5つの普遍的法則 #jawsug #jawsdays2025 / 20250301 HEROZ
yoshidashingo
2
480
書籍『入門 OpenTelemetry』 / Intro of OpenTelemetry book
ymotongpoo
8
590
“常に進化する”開発現場へ！ SHIFTが語るアジャイルQAの未来/20250306 Yuma Murase
shift_evolve
0
160
目標と時間軸 〜ベイビーステップでケイパビリティを高めよう〜
kakehashi
PRO
8
1.1k
Aurora PostgreSQLがCloudWatch Logsに 出力するログの課金を削減してみる #jawsdays2025
non97
1
280
OCI IAM Identity Domains Entra IDとの認証連携設定手順 / Identity Domain Federation settings with Entra ID
oracle4engineer
PRO
1
1.3k

Featured

See All Featured
How To Stay Up To Date on Web Technology
chriscoyier
790
250k
Rails Girls Zürich Keynote
gr2m
94
13k
Let's Do A Bunch of Simple Stuff to Make Websites Faster
chriscoyier
507
140k
Designing Dashboards & Data Visualisations in Web Apps
destraynor
231
53k
VelocityConf: Rendering Performance Case Studies
addyosmani
328
24k
Measuring & Analyzing Core Web Vitals
bluesmoon
6
270
The Psychology of Web Performance [Beyond Tellerrand 2023]
tammyeverts
46
2.4k
A better future with KSS
kneath
238
17k
It's Worth the Effort
3n
184
28k
GraphQLとの向き合い方2022年版
quramy
44
14k
Imperfection Machines: The Place of Print at Facebook
scottboms
267
13k
CSS Pre-Processors: Stylus, Less & Sass
bermonpainter
356
29k

Transcript

  1. Containers + Big Data: Present and Future By Timothy Chen

    Apache Mesos & Drill PMC, Lead Engineer @ Mesosphere
  2. None

  3. Containers • Light weight • Deploy cycle reduced • Enterprise-ready

    (soon) open source solutions • Right timing!

  4. YARN Mesos

  5. Cluster Manager

  6. Multi-tenancy • Resource Isolation • Fair sharing / Scheduling •

    Performance Isolation • Security • More..

  7. Container == process

  8. Multi-tenant Between users and systems!

  9. Future...

  10. Everything in Container

  11. None

  12. Stop reimplementing the wheel, use your OS!

  13. Big data systems as an App / Pod

  14. Utilization and Guarantees