Upgrade to Pro — share decks privately, control downloads, hide ads and more …
Sign up for free

Container + Big Data Shinect discussions

Sponsored · Ship Features Fearlessly Turn features on and off without deploys. Used by thousands of Ruby developers. →
Avatar for Timothy Chen Timothy Chen
March 23, 2016
Technology
130
0

Container + Big Data Shinect discussions

Container + Big Data Shinect discussions

Avatar for Timothy Chen

Timothy Chen

March 23, 2016

More Decks by Timothy Chen

See All by Timothy Chen
Spark Summit 2017 SF - Spark on Kubernetes
Avatar for Timothy Chen tnachen
2
460
Spark on Mesos - MesosCon 2016
Avatar for Timothy Chen tnachen
0
310
Containers in Mesos: Present and Future
Avatar for Timothy Chen tnachen
0
1.8k
Past, Present and Future of Containers
Avatar for Timothy Chen tnachen
0
2.5k
Deep dive Spark on Mesos
Avatar for Timothy Chen tnachen
0
350
Scale your Docker containers with Mesos
Avatar for Timothy Chen tnachen
0
390
Docker Swarm + Mesos
Avatar for Timothy Chen tnachen
8
7.6k
Scale your Docker containers with Mesos
Avatar for Timothy Chen tnachen
3
670
Introduction To Apache Drill - Big Data Bellevue 20131023
Avatar for Timothy Chen tnachen
2
3.5k

Other Decks in Technology

See All in Technology
【Findyテック文化祭ワークショップ】新卒エンジニア&採用担当と作る、 なりたい姿と今やるべき一歩
Avatar for ディップ株式会社 dip_tech
PRO
0
150
VS Code × GitHub Copilot での Fabric 開発
Avatar for Ryoma Nagata ryomaru0825
1
170
AWS App Runnerから Cloudflare Workersへ移行した話
Avatar for ryota-09 ryota09
0
110
猫でもわかるKiro Web
Avatar for Hiroo Katoh kentapapa
1
150
雪かき部 #7 もう怖くない！SELECT文！
Avatar for numa foursue
0
200
20260915deck.gl-raster を使ってみた
Avatar for rena1208 rena1208
0
160
Swap and Memory Reclaim - Squeezing Out More RAM
Avatar for Kernel Recipes ennael
PRO
1
1.3k
Snowflake Horizon Catalog と Apache Iceberg で作る オープンなデータ基盤
Avatar for キタガワ kitagawaz
0
320
Azure Copilot Resiliency Agentをいろいろ試してみる
Avatar for tomokusaba tomokusaba
0
140
AI駆動開発で仕様はどこまで書くべきか？ ― 人とAIの責務境界から考える開発プロセスの実践
Avatar for matsui-dmm takahiromatsui
1
230
AIエージェント時代のPlatform as a Product —— テックリードがPdMとして回す発見・導入・計測 / Platform as a Product in the AI Agent Era
Avatar for Toshinori Sugita toshi0607
1
530
20260930_Gemma4_Hands-on
Avatar for tsho tsho
0
160

Featured

See All Featured
[Rails World 2023 - Day 1 Closing Keynote] - The Magic of Rails
Avatar for Eileen M. Uchitelle eileencodes
38
3k
The Anti-SEO Checklist Checklist. Pubcon Cyber Week
Avatar for Ryan Jones ryanjones
0
250
Cheating the UX When There Is Nothing More to Optimize - PixelPioneers
Avatar for Stéphanie Walter stephaniewalter
287
14k
From Legacy to Launchpad: Building Startup-Ready Communities
Avatar for Dug Song dugsong
0
340
How STYLIGHT went responsive
Avatar for nonsquared nonsquared
100
6.3k
Game over? The fight for quality and originality in the time of robots
Avatar for Wayne Barker wayneb77
1
290
The Cult of Friendly URLs
Avatar for Andy Hume andyhume
79
7k
Ruling the World: When Life Gets Gamed
Avatar for Sebastian Deterding codingconduct
0
380
SEO Brein meetup: CTRL+C is not how to scale international SEO
Avatar for Linda Hogenes lindahogenes
2
2.9k
How to Align SEO within the Product Triangle To Get 
Buy-In & Support - #RIMC
Avatar for Aleyda Solis aleyda
2
1.8k
Highjacked: Video Game Concept Design
Avatar for Ryan Kendrick rkendrick25
PRO
1
470
A better future with KSS
Avatar for Kyle Neath kneath
240
18k

Transcript

  1. Containers + Big Data: Present and Future By Timothy Chen

    Apache Mesos & Drill PMC, Lead Engineer @ Mesosphere
  2. None

  3. Containers • Light weight • Deploy cycle reduced • Enterprise-ready

    (soon) open source solutions • Right timing!

  4. YARN Mesos

  5. Cluster Manager

  6. Multi-tenancy • Resource Isolation • Fair sharing / Scheduling •

    Performance Isolation • Security • More..

  7. Container == process

  8. Multi-tenant Between users and systems!

  9. Future...

  10. Everything in Container

  11. None

  12. Stop reimplementing the wheel, use your OS!

  13. Big data systems as an App / Pod

  14. Utilization and Guarantees