Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Container + Big Data Shinect discussions

Avatar for Timothy Chen Timothy Chen
March 23, 2016
Technology
120
0

Container + Big Data Shinect discussions

Container + Big Data Shinect discussions

Avatar for Timothy Chen

Timothy Chen

March 23, 2016

More Decks by Timothy Chen

See All by Timothy Chen
Spark Summit 2017 SF - Spark on Kubernetes
Avatar for Timothy Chen tnachen
2
450
Spark on Mesos - MesosCon 2016
Avatar for Timothy Chen tnachen
0
300
Containers in Mesos: Present and Future
Avatar for Timothy Chen tnachen
0
1.8k
Past, Present and Future of Containers
Avatar for Timothy Chen tnachen
0
2.5k
Deep dive Spark on Mesos
Avatar for Timothy Chen tnachen
0
340
Scale your Docker containers with Mesos
Avatar for Timothy Chen tnachen
0
380
Docker Swarm + Mesos
Avatar for Timothy Chen tnachen
8
7.6k
Scale your Docker containers with Mesos
Avatar for Timothy Chen tnachen
3
660
Introduction To Apache Drill - Big Data Bellevue 20131023
Avatar for Timothy Chen tnachen
2
3.4k

Other Decks in Technology

See All in Technology
ループエンジニアリングでE2Eテストを実践
Avatar for Noriyuki TAKEI noriyukitakei
0
230
RAGの精度向上とエージェント活用
Avatar for KintoTech_Dev kintotechdev
2
120
背中から、背中へ /paying forward to community
Avatar for naiban naitosatoshi
0
210
ゼロをイチにする仕事が終わったあと
Avatar for Masato Sugiyama smasato
0
250
クラウドファンディング版StackChan 3体（4体）をインタラクティブな体験型作品にして展示もした話 / ｽﾀｯｸﾁｬﾝお誕生日会2026
Avatar for you（@youtoy） you
PRO
0
270
AI Agentをシステムに組み込む前にゆるく向き合ってみる
Avatar for hayama hayama17
0
190
AIエージェントとPhysical AIが拓く製造業の変革（ハノーバーメッセリキャップ）
Avatar for AIxIoTビジネス共創ラボ iotcomjpadmin
0
210
「ビジネスがわかるエンジニア」とは何か？
Avatar for ryooob ryooob
0
490
金融の未来を考える / Thinking About the Future of Finance
Avatar for Kenji Saito ks91
PRO
0
150
“ID沼入口” - 基本とセキュリティから始める、考え続けるためのID管理技術勉強会 告知&イントロ
Avatar for ritou ritou
0
380
組織における AI-DLC 実践
Avatar for ASKUL Engineer askul
0
300
HookでSAST、CIでSAST、SCAでどうにかしている話 / layered-security-for-ai-written-code-with-sast-and-sca
Avatar for Takashi Yamaguchi yamaguchitk333
0
100

Featured

See All Featured
Rails Girls Zürich Keynote
Avatar for Gregor Martynus gr2m
96
14k
Improving Core Web Vitals using Speculation Rules API
Avatar for Sergey Chernyshev sergeychernyshev
21
1.5k
実際に使うSQLの書き方 徹底解説 / pgcon21j-tutorial
Avatar for soudai sone soudai
PRO
201
75k
Build your cross-platform service in a week with App Engine
Avatar for Jose L jlugia
234
18k
Git: the NoSQL Database
Avatar for Brandon Keepers bkeepers
PRO
432
67k
The Myth of the Modular Monolith - Day 2 Keynote - Rails World 2024
Avatar for Eileen M. Uchitelle eileencodes
28
3.5k
Save Time (by Creating Custom Rails Generators)
Avatar for Garrett Dimon garrettdimon
PRO
32
3.6k
Leadership Guide Workshop - DevTernity 2021
Avatar for David Neal reverentgeek
1
320
How To Stay Up To Date on Web Technology
Avatar for Chris Coyier chriscoyier
790
250k
Lightning Talk: Beautiful Slides for Beginners
Avatar for Ines Montani inesmontani
PRO
2
590
DBのスキルで生き残る技術 - AI時代におけるテーブル設計の勘所
Avatar for soudai sone soudai
PRO
67
56k
New Earth Scene 8
Avatar for Sydney Stone popppiees
3
2.4k

Transcript

  1. Containers + Big Data: Present and Future By Timothy Chen

    Apache Mesos & Drill PMC, Lead Engineer @ Mesosphere
  2. None

  3. Containers • Light weight • Deploy cycle reduced • Enterprise-ready

    (soon) open source solutions • Right timing!

  4. YARN Mesos

  5. Cluster Manager

  6. Multi-tenancy • Resource Isolation • Fair sharing / Scheduling •

    Performance Isolation • Security • More..

  7. Container == process

  8. Multi-tenant Between users and systems!

  9. Future...

  10. Everything in Container

  11. None

  12. Stop reimplementing the wheel, use your OS!

  13. Big data systems as an App / Pod

  14. Utilization and Guarantees