Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Container + Big Data Shinect discussions

Avatar for Timothy Chen Timothy Chen
March 23, 2016
Technology
0
89

Container + Big Data Shinect discussions

Container + Big Data Shinect discussions

Avatar for Timothy Chen

Timothy Chen

March 23, 2016
Tweet

More Decks by Timothy Chen

See All by Timothy Chen
Spark Summit 2017 SF - Spark on Kubernetes
Avatar for Timothy Chen tnachen
2
410
Spark on Mesos - MesosCon 2016
Avatar for Timothy Chen tnachen
0
260
Containers in Mesos: Present and Future
Avatar for Timothy Chen tnachen
0
1.7k
Past, Present and Future of Containers
Avatar for Timothy Chen tnachen
0
2.5k
Deep dive Spark on Mesos
Avatar for Timothy Chen tnachen
0
290
Scale your Docker containers with Mesos
Avatar for Timothy Chen tnachen
0
350
Docker Swarm + Mesos
Avatar for Timothy Chen tnachen
8
7.5k
Scale your Docker containers with Mesos
Avatar for Timothy Chen tnachen
3
630
Introduction To Apache Drill - Big Data Bellevue 20131023
Avatar for Timothy Chen tnachen
2
3.4k

Other Decks in Technology

See All in Technology
Flutterでキャッチしないエラーはどこに行く
Avatar for AOKI Taiju taiju59
0
210
Function Body Macros で、SwiftUI の View に Accessibility Identifier を自動付与する/Function Body Macros: Autogenerate accessibility identifiers for SwiftUI Views
Avatar for Yuki Miida miichan
2
160
PRDの正しい使い方 ～AI時代にも効く思考・対話・成長ツールとして～
Avatar for PERSOL CAREER Dev | techtekt techtekt
PRO
0
1.7k
20250903_1つのAWSアカウントに複数システムがある環境におけるアクセス制御をABACで実現.pdf
Avatar for yhana yhana
2
320
「魔法少女まどか☆マギカ Magia Exedra」の必殺技演出を徹底解剖！ -キャラクターの魅力を最大限にファンに届けるためのこだわり-
Avatar for gree_tech gree_tech
PRO
0
500
Language Update: Java
Avatar for Yuichi.Sakuraba skrb
2
240
『FailNet～やらかし共有SNS～』エレベーターピッチ
Avatar for yoko yokomachi
1
200
Browser
Avatar for Recruit recruitengineers
PRO
8
2.3k
エラーとアクセシビリティ
Avatar for Tajima Sachiko schktjm
0
810
AI時代にPdMとPMMはどう連携すべきか / PdM–PMM-collaboration-in-AI-era
Avatar for Rakus_Dev rakus_dev
0
270
5年目から始める Vue3 サイト改善 #frontendo
Avatar for Kihara, Takuya tacck
PRO
3
160
「魔法少女まどか☆マギカ Magia Exedra」のグローバル展開を支える、開発チームと翻訳チームの「意識しない協創」を実現するローカライズシステム
Avatar for gree_tech gree_tech
PRO
0
500

Featured

See All Featured
Producing Creativity
Avatar for Steve Smith orderedlist
PRO
347
40k
Refactoring Trust on Your Teams (GOTO; Chicago 2020)
Avatar for Rebecca Miller-Webster rmw
34
3.1k
XXLCSS - How to scale CSS and keep your sanity
Avatar for Zaharenia Atzitzikaki sugarenia
248
1.3M
RailsConf 2023
Avatar for Aaron Patterson tenderlove
30
1.2k
Imperfection Machines: The Place of Print at Facebook
Avatar for Scott Boms scottboms
268
13k
The Web Performance Landscape in 2024 [PerfNow 2024]
Avatar for Tammy Everts tammyeverts
9
800
A designer walks into a library…
Avatar for Paul Jervis Heath pauljervisheath
207
24k
Rebuilding a faster, lazier Slack
Avatar for samanthasiow samanthasiow
83
9.1k
What's in a price? How to price your products and services
Avatar for Michael Herold michaelherold
246
12k
Connecting the Dots Between Site Speed, User Experience & Your Business [WebExpo 2025]
Avatar for Tammy Everts tammyeverts
8
510
Why You Should Never Use an ORM
Avatar for John Nunemaker jnunemaker
PRO
59
9.5k
Bash Introduction
Avatar for André Augusto Costa Santos 62gerente
615
210k

Transcript

  1. Containers + Big Data: Present and Future By Timothy Chen

    Apache Mesos & Drill PMC, Lead Engineer @ Mesosphere
  2. None

  3. Containers • Light weight • Deploy cycle reduced • Enterprise-ready

    (soon) open source solutions • Right timing!

  4. YARN Mesos

  5. Cluster Manager

  6. Multi-tenancy • Resource Isolation • Fair sharing / Scheduling •

    Performance Isolation • Security • More..

  7. Container == process

  8. Multi-tenant Between users and systems!

  9. Future...

  10. Everything in Container

  11. None

  12. Stop reimplementing the wheel, use your OS!

  13. Big data systems as an App / Pod

  14. Utilization and Guarantees