Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Container + Big Data Shinect discussions

Avatar for Timothy Chen Timothy Chen
March 23, 2016
Technology
0
81

Container + Big Data Shinect discussions

Container + Big Data Shinect discussions
Avatar for Timothy Chen

Timothy Chen

March 23, 2016
Tweet

More Decks by Timothy Chen

See All by Timothy Chen
Spark Summit 2017 SF - Spark on Kubernetes
Avatar for Timothy Chen tnachen
2
400
Spark on Mesos - MesosCon 2016
Avatar for Timothy Chen tnachen
0
240
Containers in Mesos: Present and Future
Avatar for Timothy Chen tnachen
0
1.7k
Past, Present and Future of Containers
Avatar for Timothy Chen tnachen
0
2.5k
Deep dive Spark on Mesos
Avatar for Timothy Chen tnachen
0
270
Scale your Docker containers with Mesos
Avatar for Timothy Chen tnachen
0
340
Docker Swarm + Mesos
Avatar for Timothy Chen tnachen
8
7.5k
Scale your Docker containers with Mesos
Avatar for Timothy Chen tnachen
3
620
Introduction To Apache Drill - Big Data Bellevue 20131023
Avatar for Timothy Chen tnachen
2
3.4k

Other Decks in Technology

See All in Technology
Swiftは最高だよの話
Avatar for 野瀬田　裕樹 yuukiw00w
2
290
カンファレンスのつくりかた / The Conference Code: What Makes It All Work
Avatar for HASEGAWA Tomoki tomzoh
8
940
単一Gitリポジトリから独立しました
Avatar for LINEヤフーTech (LY Corporation Tech) lycorptech_jp
PRO
0
100
積み上げられた技術資産と向き合いながら、プロダクトの信頼性をどう守るか
Avatar for PLAID Tech plaidtech
PRO
0
950
Bill One 開発エンジニア 紹介資料
Avatar for Sansan, Inc. sansan33
PRO
4
12k
セキュリティSaaS企業が実践するCursor運用ルールと知見 / How a Security SaaS Company Runs Cursor: Rules & Insights
Avatar for tetsuzawa tetsuzawa
0
490
AIコードエディタは開発を変えるか？Cursorをチームに導入して1ヶ月経った本音
Avatar for Itaru Ota ota1022
1
710
継続戦闘能⼒
Avatar for SansanTech sansantech
PRO
0
220
ソフトウェアテストのAI活用_ver1.10
Avatar for fumisuke fumisuke
0
240
FastMCPでSQLをチェックしてくれるMCPサーバーを自作してCursorから動かしてみた
Avatar for Nayuta S. nayuts
1
220
Flutterアプリを⾃然⾔語で操作する
Avatar for Yuki Sakai yukisakai1225
0
120
大事なのは、AIの精度だけじゃない！〜1円のズレも許されない経理領域とAI〜
Avatar for Jun Nemoto jun_nemoto
11
5.2k

Featured

See All Featured
Building a Modern Day 
E-commerce SEO Strategy
Avatar for Aleyda Solis aleyda
40
7.3k
Product Roadmaps are Hard
Avatar for C. Todd Lombardo iamctodd
PRO
53
11k
RailsConf & Balkan Ruby 2019: The Past, Present, and Future of Rails at GitHub
Avatar for Eileen M. Uchitelle eileencodes
137
34k
YesSQL, Process and Tooling at Scale
Avatar for Rocio Delgado rocio
172
14k
Exploring the Power of Turbo Streams & Action Cable | RailsConf2023
Avatar for Kevin Liebholz kevinliebholz
32
5.8k
Art, The Web, and Tiny UX
Avatar for Lynn Fisher lynnandtonic
298
21k
Bash Introduction
Avatar for André Augusto Costa Santos 62gerente
614
210k
Embracing the Ebb and Flow
Avatar for Simon Collison colly
85
4.7k
Building Flexible Design Systems
Avatar for Yesenia Perez-Cruz yeseniaperezcruz
329
39k
For a Future-Friendly Web
Avatar for Brad Frost brad_frost
178
9.7k
Unsuck your backbone
Avatar for Amy Palamountain ammeep
671
58k
Reflections from 52 weeks, 52 projects
Avatar for Jefferson Lam jeffersonlam
349
20k

Transcript

  1. Containers + Big Data: Present and Future By Timothy Chen

    Apache Mesos & Drill PMC, Lead Engineer @ Mesosphere
  2. None

  3. Containers • Light weight • Deploy cycle reduced • Enterprise-ready

    (soon) open source solutions • Right timing!

  4. YARN Mesos

  5. Cluster Manager

  6. Multi-tenancy • Resource Isolation • Fair sharing / Scheduling •

    Performance Isolation • Security • More..

  7. Container == process

  8. Multi-tenant Between users and systems!

  9. Future...

  10. Everything in Container

  11. None

  12. Stop reimplementing the wheel, use your OS!

  13. Big data systems as an App / Pod

  14. Utilization and Guarantees