Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Container + Big Data Shinect discussions

Avatar for Timothy Chen Timothy Chen
March 23, 2016
Technology
130
0

Container + Big Data Shinect discussions

Container + Big Data Shinect discussions

Avatar for Timothy Chen

Timothy Chen

March 23, 2016

More Decks by Timothy Chen

See All by Timothy Chen
Spark Summit 2017 SF - Spark on Kubernetes
Avatar for Timothy Chen tnachen
2
460
Spark on Mesos - MesosCon 2016
Avatar for Timothy Chen tnachen
0
300
Containers in Mesos: Present and Future
Avatar for Timothy Chen tnachen
0
1.8k
Past, Present and Future of Containers
Avatar for Timothy Chen tnachen
0
2.5k
Deep dive Spark on Mesos
Avatar for Timothy Chen tnachen
0
350
Scale your Docker containers with Mesos
Avatar for Timothy Chen tnachen
0
390
Docker Swarm + Mesos
Avatar for Timothy Chen tnachen
8
7.6k
Scale your Docker containers with Mesos
Avatar for Timothy Chen tnachen
3
670
Introduction To Apache Drill - Big Data Bellevue 20131023
Avatar for Timothy Chen tnachen
2
3.4k

Other Decks in Technology

See All in Technology
AndroidでHDRメディアを「壊さずに」扱う
Avatar for Kazuki Chigita chigichan24
0
420
推論の観測、できていますか？ 〜 Google Cloud Gemini Enterprise Agent Platformで 3つの Gemini モデルを実測して踏んだ、評価の罠 〜
Avatar for Shu Kobuchi shukob
PRO
0
170
2026-09-10 【Snowflake World Tour Tokyo 2026】dbt Core と Snowflake で実現する多層的なデータガバナンス / Multi-Layered Data Governance Powered by dbt Core and Snowflake
Avatar for civitaspo civitaspo
0
180
少人数データチームのDevin活用実践事例
Avatar for Runa Yamada runandy16
2
450
Benchmarking Vector Databases: pgvector vs. LanceDB
Avatar for tsho tsho
0
150
Azure Cost Management の FOCUS コストデータを迷わず読むための“3つの軸”
Avatar for Tetsuya Odashima tetsuyaooooo
0
150
Sigmaユーザーのための有用リソース一挙公開 & Sigmaで使えるMCP #sigma_ucj /useful-resources-for-sigma-computing-users-and-mcps-with-sigma
Avatar for shinyaa31 shinyaa31
0
150
【Oracle AI Spotlight ウェビナー】AWSか、Azureか、Google Cloudか。その議論にオラクルを含める意義。
Avatar for oracle4engineer oracle4engineer
PRO
2
240
生成AI時代の クレデンシャルとパーミッション設計
Avatar for NRI Netcom nrinetcom
PRO
4
1.6k
AIで仕事のやり方を変える
Avatar for Kentaro Matsumoto matsu7874
2
980
OpenTelemetry eBPF Instrumentationの舞台裏 / Behind the Scenes of OpenTelemetry eBPF Instrumentation
Avatar for ymotongpoo ymotongpoo
1
160
Azure App Service / Container Apps の組み込み認証
Avatar for Kuniteru Asami kuniteru
0
210

Featured

See All Featured
Speed Design
Avatar for Sergey Chernyshev sergeychernyshev
33
2.1k
Paper Plane
Avatar for Katie Cordina Lindsey katiecoart
PRO
2
53k
Context Engineering - Making Every Token Count
Avatar for Addy Osmani addyosmani
9
1.1k
Lightning Talk: Beautiful Slides for Beginners
Avatar for Ines Montani inesmontani
PRO
2
670
Creating an realtime collaboration tool: Agile Flush - .NET Oxford
Avatar for Marc Duiker marcduiker
35
2.6k
Marketing to machines
Avatar for Jono Alderson jonoalderson
1
5.7k
So, you think you're a good person
Avatar for Per Axbom axbom
PRO
2
2.1k
The Organizational Zoo: Understanding Human Behavior Agility Through Metaphoric Constructive Conversations (based on the works of Arthur Shelley, Ph.D)
Avatar for Dr. Kim W Petersen kimpetersen
PRO
0
440
Claude Code のすすめ
Avatar for schroneko schroneko
67
230k
Bootstrapping a Software Product
Avatar for Garrett Dimon garrettdimon
PRO
306
120k
Game over? The fight for quality and originality in the time of robots
Avatar for Wayne Barker wayneb77
1
270
Claude Code どこまでも/ Claude Code Everywhere
Avatar for nwiizo nwiizo
67
58k

Transcript

  1. Containers + Big Data: Present and Future By Timothy Chen

    Apache Mesos & Drill PMC, Lead Engineer @ Mesosphere
  2. None

  3. Containers • Light weight • Deploy cycle reduced • Enterprise-ready

    (soon) open source solutions • Right timing!

  4. YARN Mesos

  5. Cluster Manager

  6. Multi-tenancy • Resource Isolation • Fair sharing / Scheduling •

    Performance Isolation • Security • More..

  7. Container == process

  8. Multi-tenant Between users and systems!

  9. Future...

  10. Everything in Container

  11. None

  12. Stop reimplementing the wheel, use your OS!

  13. Big data systems as an App / Pod

  14. Utilization and Guarantees