Upgrade to Pro — share decks privately, control downloads, hide ads and more …
Sign up for free

Container + Big Data Shinect discussions

Avatar for Timothy Chen Timothy Chen
March 23, 2016
Technology
130
0

Container + Big Data Shinect discussions

Container + Big Data Shinect discussions

Avatar for Timothy Chen

Timothy Chen

March 23, 2016

More Decks by Timothy Chen

See All by Timothy Chen
Spark Summit 2017 SF - Spark on Kubernetes
Avatar for Timothy Chen tnachen
2
470
Spark on Mesos - MesosCon 2016
Avatar for Timothy Chen tnachen
0
310
Containers in Mesos: Present and Future
Avatar for Timothy Chen tnachen
0
1.8k
Past, Present and Future of Containers
Avatar for Timothy Chen tnachen
0
2.5k
Deep dive Spark on Mesos
Avatar for Timothy Chen tnachen
0
360
Scale your Docker containers with Mesos
Avatar for Timothy Chen tnachen
0
390
Docker Swarm + Mesos
Avatar for Timothy Chen tnachen
8
7.6k
Scale your Docker containers with Mesos
Avatar for Timothy Chen tnachen
3
670
Introduction To Apache Drill - Big Data Bellevue 20131023
Avatar for Timothy Chen tnachen
2
3.5k

Other Decks in Technology

See All in Technology
How to Design Configuration for Rails Applications
Avatar for Shinichi Maeshima willnet
1
850
WasmをRustにする
Avatar for SansanTech sansantech
PRO
0
300
LLM-as-a-Judgeは本当に信頼できるのか――評価器を評価する話
Avatar for Takaaki Yayoi taka_aki
1
220
実践！Cloud Run ハンズオン！！ / Cloud Run handson
Avatar for y-ohgi y0hgi
2
300
[JAWS-UG彩の国埼玉#12]そろそろ準備する？re:Invent2026をやさしく解説 / reinvent2026-sainokuni
Avatar for sh_fk2 sh_fk2
1
360
宣言型部分更新は何を解決しどこへ向かうのか
Avatar for did0es shuta13
1
490
Rustuna: Rustによる高速なOptuna実装
Avatar for Preferred Networks pfn
PRO
0
200
AI時代のPRレビューにどう向き合うか？
Avatar for KairiM kairim0
1
240
コンテナ運用におけるネットワーク・コンテナコストの削減方法／How to Reduce Network and Container Costs in Container Operations
Avatar for モブエンジニア masakiokuda
2
310
AIがコードを書く時代に、エンジニアは何で自分の価値を証明するのか / In an era where AI writes code how do engineers prove their value
Avatar for CARTA Engineering carta_engineering
3
1.1k
DBについての基礎説明（MySQL編） - コロプラ 2026年度 新卒研修
Avatar for COLOPL Inc. colopl
0
140
NDIでApple Vision Proにリアルタイム映像送信
Avatar for jyouryuusui jyouryuusui
0
130

Featured

See All Featured
svc-hook: hooking system calls on ARM64 by binary rewriting
Avatar for Akira Moroo retrage
2
630
The Mindset for Success: Future Career Progression
Avatar for Greg Gifford greggifford
PRO
0
540
Easily Structure & Communicate Ideas using Wireframe
Avatar for Afnizar Nur Ghifari afnizarnur
194
17k
Stewardship and Sustainability of Urban and Community Forests
Avatar for Eric Wiseman pwiseman
0
560
Building Adaptive Systems
Avatar for Chris Keathley keathley
44
3.3k
Facilitating Awesome Meetings
Avatar for Lara Hogan lara
57
7.2k
We Have a Design System, Now What?
Avatar for Morgane Peng morganepeng
55
8.4k
Lightning talk: Run Django tests with GitHub Actions
Avatar for Sarah Abderemane sabderemane
0
300
"I'm Feeling Lucky" - Building Great Search Experiences for Today's Users (#IAC19)
Avatar for Dan Newman danielanewman
230
23k
The Cost Of JavaScript in 2023
Avatar for Addy Osmani addyosmani
55
10k
Design in an AI World
Avatar for tapps tapps
1
350
Build The Right Thing And Hit Your Dates
Avatar for Maggie C. maggiecrowley
39
3.5k

Transcript

  1. Containers + Big Data: Present and Future By Timothy Chen

    Apache Mesos & Drill PMC, Lead Engineer @ Mesosphere
  2. None

  3. Containers • Light weight • Deploy cycle reduced • Enterprise-ready

    (soon) open source solutions • Right timing!

  4. YARN Mesos

  5. Cluster Manager

  6. Multi-tenancy • Resource Isolation • Fair sharing / Scheduling •

    Performance Isolation • Security • More..

  7. Container == process

  8. Multi-tenant Between users and systems!

  9. Future...

  10. Everything in Container

  11. None

  12. Stop reimplementing the wheel, use your OS!

  13. Big data systems as an App / Pod

  14. Utilization and Guarantees