Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Container + Big Data Shinect discussions

Avatar for Timothy Chen Timothy Chen
March 23, 2016
Technology
0
85

Container + Big Data Shinect discussions

Container + Big Data Shinect discussions

Avatar for Timothy Chen

Timothy Chen

March 23, 2016
Tweet

More Decks by Timothy Chen

See All by Timothy Chen
Spark Summit 2017 SF - Spark on Kubernetes
Avatar for Timothy Chen tnachen
2
410
Spark on Mesos - MesosCon 2016
Avatar for Timothy Chen tnachen
0
250
Containers in Mesos: Present and Future
Avatar for Timothy Chen tnachen
0
1.7k
Past, Present and Future of Containers
Avatar for Timothy Chen tnachen
0
2.5k
Deep dive Spark on Mesos
Avatar for Timothy Chen tnachen
0
280
Scale your Docker containers with Mesos
Avatar for Timothy Chen tnachen
0
350
Docker Swarm + Mesos
Avatar for Timothy Chen tnachen
8
7.5k
Scale your Docker containers with Mesos
Avatar for Timothy Chen tnachen
3
630
Introduction To Apache Drill - Big Data Bellevue 20131023
Avatar for Timothy Chen tnachen
2
3.4k

Other Decks in Technology

See All in Technology
Snowflake のアーキテクチャは本当に筋がよかったのか / Data Engineering Study #30
Avatar for Yoshi Matsuzaki indigo13love
0
250
今日からあなたもGeminiを好きになる
Avatar for subaru subaruhello
1
550
AI エンジニアの立場からみた、AI コーディング時代の開発の品質向上の取り組みと妄想
Avatar for Soh Ohara soh9834
5
140
QuickBooks®️ Customer®️ USA Contact Numbers: Complete 2025 Support Guide
Avatar for wispyviolet@ qbsupportinfo
0
100
claude codeでPrompt Engineering
Avatar for いおりん iori0311
0
380
Data Engineering Study#30 LT資料
Avatar for tetsuroito tetsuroito
1
550
2025/07/22_家族アルバム みてねのCRE における生成AI活用事例
Avatar for Masaru Hoshino masartz
2
100
The Madness of Multiple Gemini CLIs Developing Simultaneously with Jujutsu
Avatar for Gunther Brunner gunta
1
2.4k
Jitera Company Deck / JP
Avatar for Jitera Inc. jitera
0
140
エンジニアリングマネージャー“お悩み相談”パネルセッション
Avatar for ar_tama ar_tama
1
640
MCP とマネージド PaaS で実現する大規模 AI アプリケーションの高速開発
Avatar for Nahoko Ushirokawa nahokoxxx
1
1.4k
AI時代にも変わらぬ価値を発揮したい: インフラ・クラウドを切り口にユーザー価値と非機能要件に向き合ってエンジニアとしての地力を培う
Avatar for Toshiaki Baba netmarkjp
0
220

Featured

See All Featured
Site-Speed That Sticks
Avatar for Harry Roberts csswizardry
10
710
Keith and Marios Guide to Fast Websites
Avatar for Keith Pitt keithpitt
411
22k
Design and Strategy: How to Deal with People Who Don’t "Get" Design
Avatar for Morgane Peng morganepeng
130
19k
Building an army of robots
Avatar for Kyle Neath kneath
306
45k
4 Signs Your Business is Dying
Avatar for Josh Pigford shpigford
184
22k
Practical Orchestrator
Avatar for Shlomi Noach shlominoach
189
11k
Save Time (by Creating Custom Rails Generators)
Avatar for Garrett Dimon garrettdimon
PRO
31
1.3k
How to Create Impact in a Changing Tech Landscape [PerfNow 2023]
Avatar for Tammy Everts tammyeverts
53
2.9k
Faster Mobile Websites
Avatar for Dean Hume deanohume
308
31k
"I'm Feeling Lucky" - Building Great Search Experiences for Today's Users (#IAC19)
Avatar for Dan Newman danielanewman
229
22k
Bash Introduction
Avatar for André Augusto Costa Santos 62gerente
613
210k
The Invisible Side of Design
Avatar for Vitaly Friedman smashingmag
301
51k

Transcript

  1. Containers + Big Data: Present and Future By Timothy Chen

    Apache Mesos & Drill PMC, Lead Engineer @ Mesosphere
  2. None

  3. Containers • Light weight • Deploy cycle reduced • Enterprise-ready

    (soon) open source solutions • Right timing!

  4. YARN Mesos

  5. Cluster Manager

  6. Multi-tenancy • Resource Isolation • Fair sharing / Scheduling •

    Performance Isolation • Security • More..

  7. Container == process

  8. Multi-tenant Between users and systems!

  9. Future...

  10. Everything in Container

  11. None

  12. Stop reimplementing the wheel, use your OS!

  13. Big data systems as an App / Pod

  14. Utilization and Guarantees