Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Container + Big Data Shinect discussions

Sponsored · Ship Features Fearlessly Turn features on and off without deploys. Used by thousands of Ruby developers. →
Avatar for Timothy Chen Timothy Chen
March 23, 2016
Technology
120
0

Container + Big Data Shinect discussions

Container + Big Data Shinect discussions

Avatar for Timothy Chen

Timothy Chen

March 23, 2016

More Decks by Timothy Chen

See All by Timothy Chen
Spark Summit 2017 SF - Spark on Kubernetes
Avatar for Timothy Chen tnachen
2
460
Spark on Mesos - MesosCon 2016
Avatar for Timothy Chen tnachen
0
300
Containers in Mesos: Present and Future
Avatar for Timothy Chen tnachen
0
1.8k
Past, Present and Future of Containers
Avatar for Timothy Chen tnachen
0
2.5k
Deep dive Spark on Mesos
Avatar for Timothy Chen tnachen
0
350
Scale your Docker containers with Mesos
Avatar for Timothy Chen tnachen
0
380
Docker Swarm + Mesos
Avatar for Timothy Chen tnachen
8
7.6k
Scale your Docker containers with Mesos
Avatar for Timothy Chen tnachen
3
670
Introduction To Apache Drill - Big Data Bellevue 20131023
Avatar for Timothy Chen tnachen
2
3.4k

Other Decks in Technology

See All in Technology
ソフトウェアサプライチェーンの構造的リスクとコンテナ環境の保護
Avatar for Kyohei Mizumoto kyohmizu
5
740
MulticaとPi Coding Agentで、小規模OSSを30本同時運用した流れ
Avatar for eiei114 eiei114
0
130
Bill One 開発エンジニア 紹介資料
Avatar for Sansan, Inc. sansan33
PRO
7
20k
AIで変わるエンジニアの働き方（仮）
Avatar for naoinaoi naoinaoi
0
220
猫付きpingコマンドを自作
Avatar for uyuki uyuki234
0
280
ハッカソンで入賞した話 @ Findy LT
Avatar for asari asari194617
0
1.4k
コーチングの奥義 何もしないテクニック
Avatar for Watanabe Jin jinwatanabe
0
140
Head First モブプログラミング / Head First Mobprogramming
Avatar for TAKAKING22 takaking22
10
12k
What's new in Go 1.27?
Avatar for Koya IWAMURA ciarana
0
280
カートの信頼性を担保するWireMockを使ったe2eテスト
Avatar for ykagano ykagano
0
620
巨大気象データと戦う ― サロゲートモデル学習を高速化する圧縮技術
Avatar for GPU UNITE gpuunite_official
0
170
私がブラウザを自作したくなった理由
Avatar for Miyamoto Naoyuki supurazako
1
270

Featured

See All Featured
The Invisible Side of Design
Avatar for Vitaly Friedman smashingmag
301
52k
How To Stay Up To Date on Web Technology
Avatar for Chris Coyier chriscoyier
790
250k
Visualizing Your Data: Incorporating Mongo into Loggly Infrastructure
Avatar for mongodb mongodb
49
10k
Refactoring Trust on Your Teams (GOTO; Chicago 2020)
Avatar for Rebecca Miller-Webster rmw
35
3.8k
Digital Projects Gone Horribly Wrong (And the UX Pros Who Still Save the Day) - Dean Schuster
Avatar for UX Y'all uxyall
1
2.4k
Git: the NoSQL Database
Avatar for Brandon Keepers bkeepers
PRO
432
67k
Have SEOs Ruined the Internet? - User Awareness of SEO in 2025
Avatar for Akash Hashmi akashhashmi
0
430
The Limits of Empathy - UXLibs8
Avatar for Cassini Nazir cassininazir
1
610
Save Time (by Creating Custom Rails Generators)
Avatar for Garrett Dimon garrettdimon
PRO
32
4.4k
Effective software design: The role of men in debugging patriarchy in IT @ Voxxed Days AMS
Avatar for Kenny Baas-Schwegler baasie
0
480
Site-Speed That Sticks
Avatar for Harry Roberts csswizardry
13
1.5k
Amusing Abliteration
Avatar for ianozsvald ianozsvald
1
260

Transcript

  1. Containers + Big Data: Present and Future By Timothy Chen

    Apache Mesos & Drill PMC, Lead Engineer @ Mesosphere
  2. None

  3. Containers • Light weight • Deploy cycle reduced • Enterprise-ready

    (soon) open source solutions • Right timing!

  4. YARN Mesos

  5. Cluster Manager

  6. Multi-tenancy • Resource Isolation • Fair sharing / Scheduling •

    Performance Isolation • Security • More..

  7. Container == process

  8. Multi-tenant Between users and systems!

  9. Future...

  10. Everything in Container

  11. None

  12. Stop reimplementing the wheel, use your OS!

  13. Big data systems as an App / Pod

  14. Utilization and Guarantees