Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Container + Big Data Shinect discussions

Timothy Chen
March 23, 2016
Technology
0
80

Container + Big Data Shinect discussions

Container + Big Data Shinect discussions

Timothy Chen

March 23, 2016
Tweet

More Decks by Timothy Chen

See All by Timothy Chen
Spark Summit 2017 SF - Spark on Kubernetes
tnachen
2
390
Spark on Mesos - MesosCon 2016
tnachen
0
240
Containers in Mesos: Present and Future
tnachen
0
1.7k
Past, Present and Future of Containers
tnachen
0
2.4k
Deep dive Spark on Mesos
tnachen
0
270
Scale your Docker containers with Mesos
tnachen
0
340
Docker Swarm + Mesos
tnachen
8
7.5k
Scale your Docker containers with Mesos
tnachen
3
620
Introduction To Apache Drill - Big Data Bellevue 20131023
tnachen
2
3.4k

Other Decks in Technology

See All in Technology
自分の軸足を見つけろ
tsuemura
2
600
プロダクト開発におけるAI時代の開発生産性
shnjtk
2
200
AWSLambdaMCPServerを使ってツールとMCPサーバを分離する
tkikuchi
1
2.5k
こんなデータマートは嫌だ。どんな？ / waiwai-data-meetup-202504
shuntak
6
1.7k
SREが実現する開発者体験の革新
sansantech
PRO
0
190
Spring Bootで実装とインフラをこれでもかと分離するための試み
shintanimoto
4
410
LangfuseでAIエージェントの 可観測性を高めよう！/Enhancing AI Agent Observability with Langfuse!
jnymyk
0
170
SREの視点で考えるSIEM活用術 〜AWS環境でのセキュリティ強化〜
coconala_engineer
1
250
20250413_湘南kaggler会_音声認識で使うのってメルス・・・なんだっけ？
sugupoko
1
390
大AI時代で輝くために今こそドメインにディープダイブしよう / Deep Dive into Domain in AI-Agent-Era
yuitosato
1
270
【2025年度新卒技術研修】100分で学ぶ サイバーエージェントのデータベース 活用事例とMySQLパフォーマンス調査
cyberagentdevelopers
PRO
4
6.5k
開発視点でAWS Signerを考えてみよう！！ ～コード署名のその先へ～
masakiokuda
3
140

Featured

See All Featured
Fireside Chat
paigeccino
37
3.4k
Principles of Awesome APIs and How to Build Them.
keavy
126
17k
Building a Scalable Design System with Sketch
lauravandoore
462
33k
Build The Right Thing And Hit Your Dates
maggiecrowley
35
2.6k
Agile that works and the tools we love
rasmusluckow
328
21k
Embracing the Ebb and Flow
colly
85
4.6k
Stop Working from a Prison Cell
hatefulcrawdad
268
20k
Code Review Best Practice
trishagee
67
18k
The Cost Of JavaScript in 2023
addyosmani
49
7.7k
Building Better People: How to give real-time feedback that sticks.
wjessup
367
19k
10 Git Anti Patterns You Should be Aware of
lemiorhan
PRO
656
60k
Visualizing Your Data: Incorporating Mongo into Loggly Infrastructure
mongodb
45
9.5k

Transcript

  1. Containers + Big Data: Present and Future By Timothy Chen

    Apache Mesos & Drill PMC, Lead Engineer @ Mesosphere
  2. None

  3. Containers • Light weight • Deploy cycle reduced • Enterprise-ready

    (soon) open source solutions • Right timing!

  4. YARN Mesos

  5. Cluster Manager

  6. Multi-tenancy • Resource Isolation • Fair sharing / Scheduling •

    Performance Isolation • Security • More..

  7. Container == process

  8. Multi-tenant Between users and systems!

  9. Future...

  10. Everything in Container

  11. None

  12. Stop reimplementing the wheel, use your OS!

  13. Big data systems as an App / Pod

  14. Utilization and Guarantees