Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Sign up for free
Menu
Search
Features
All features
Private URLs
Password Protection
Custom URLS
Scheduled publishing
Remove Branding
Restrict embedding
Deck Collections
Notes
Features
All features
Private URLs
Password Protection
Custom URLS
Scheduled publishing
Remove Branding
Restrict embedding
Deck Collections
Notes
Explore
Featured decks
Featured speakers
Programming
Technology
Storyboards
Explore
Featured decks
Featured speakers
Programming
Technology
Storyboards
Pricing
Search
Sign in
Sign up for free
Lakehouseプラットフォームを 採用するまでの話/Lakehouse Platform ...
Search
Sponsored
·
SiteGround - Reliable hosting with speed, security, and support you can count on.
→
Masatoshi Shimada
May 26, 2021
Programming
1.1k
1
Share
Embed
Copy iframe code
Copy JS code
Copy link
Start on current slide
Lakehouseプラットフォームを 採用するまでの話/Lakehouse Platform Adoption
Masatoshi Shimada
May 26, 2021
Transcript
12 slides
σʔλΣΞϋεੈผ -BLFIPVTFϓϥοτϑΥʔϜΛ ࠾༻͢Δ·Ͱͷ ౡాխ JEDAI ୈೋճ: DeltaΛ͍͓ͨͨ͠ײ
ࣗݾհ w ౡాխ!TNENUT w %8)ΞʔΩςΫτσʔλΞφϦετ w 4DBMBc1ZUIPOc+BWBc(PMBOHc%%% w
גࣜձࣾΤϒϦʔॴଐ w ։ൃຊ෦%"5""*άϧʔϓ.(3
࣍ dͷؒͰσʔλϨΠΫσʔλΣΞϋεͷ &5-&-5ॲཧΛ߹ܭճϦϑΝΫλϦϯά͍ͯ͠·͢ɻ -BLFIPVTFϓϥοτϑΥʔϜ࠾༻·ͰͷಓͷΓΛ͓͠͠·͢ɻ
ୈҰੈd&5- w &NCVML&.3Λར༻ͯ͠&5-ॲཧ͢ΔΈ w 1SPTൺֱతγϯϓϧͳσʔλϑϩʔ ҰఆֹۚͰεΩϟϯՄೳͳܭࢉج൫ͷఏڙ w $POT&NCVML.BQ3FEVDF&YFDVUPSͷকདྷੑʹෆ҆
ୈҰੈd%BTICPBSE w ߏԽσʔλͷશΠϕϯτϩάͷ3"8ςʔϒϧΛࢀর͢Δํࣜ w 1SPTҰͭͷςʔϒϧΛࢀর͢Εྑ͍ w $POT3"8ςʔϒϧංେԽʹΑΔίετͷઢܗ૿Ճ
ୈೋੈ&5- w "QBDIF4QBSL%BUBCSJDLTʹΑΔ&5-ॲཧͷಋೖ w 1SPTΠϯϑϥ؍Ͱͷ&5-ॲཧͷεέʔϧԽ σʔλϑϩʔ/PUFCPPLԽʹΑΔσόοάͷίετԽ w $POT+40/-1BSRVFUͷυϝΠϯࣝͷൃࢄʢڽूʣ &5-ॲཧதͷ614&35ܥॲཧ࣮͕ߴίετ
ୈೋੈ%BTICPBSE w ΠϕϯτςʔϒϧͷϑϧεΩϟϯΛ༰ೝ͢Δํࣜ w 1SPTΠϕϯτςʔϒϧͷυϝΠϯׂʹΑΔॲཧߴԽ ୳ࡧతσʔλੳՄೳͳνʔϜͷεέʔϧԽʢ1E.ɺ&OHɺ4BMFTʣ w $POTΠϕϯτςʔϒϧ૿ՃʹΑΔίετͷઢܗ૿Ճ
ୈࡾੈ&5- w %BUBCSJDLT%FMUBʹΑΔϝμϦΦϯΞʔΩςΫνϟͷಋೖ w 1SPT%FMUBʹΑΔ&5-ॲཧͷ࣮ίετͷίετԽ ɹɹɹɹɹϝμϦΦϯΞʔΩςΫνϟʹΑΔυϝΠϯࣝͷߴڽूԽͱૄ݁߹Խ σʔλαΠΤϯεͳͲͷυϝΠϯࣝར༻ͷεέʔϧԽ w $POTσʔλύΠϓϥΠϯͷߏෳࡶԽͱσʔλஔॴͷൃࢄ
ୈࡾੈ%BTICPBSE w ΠϕϯτςʔϒϧͷϑϧεΩϟϯΛ༰ೝ͢Δํࣜ w 1SPTΠϕϯτςʔϒϧͷυϝΠϯׂʹΑΔॲཧߴԽ ୳ࡧతσʔλੳՄೳͳνʔϜͷεέʔϧԽʢ1E.ɺ&OHɺ4BMFTʣ w $POTΠϕϯτςʔϒϧ૿ՃʹΑΔίετͷઢܗ૿Ճ ୈೋੈͱมߋແ͠
ୈ࢛ੈ&5- w -BLFIPVTFϓϥοτϑΥʔϜͷಋೖ w 1SPTϝμϦΦϯΞʔΩςΫνϟʹΑΔυϝΠϯࣝͷߴڽूૄ݁߹ͷଅਐ w $POT΄΅ແ͠
ୈ࢛ੈ %BTICPBSE w -BLFIPVTFϓϥοτϑΥʔϜ 42-"OBMZUJDTͷ࠾༻ʢ10$தʣ w 1SPTσʔλιʔεͷ΄΅શͳ4405Խ w $POTݱߦͱಉ͡ॲཧੑೳͱ͢Δʹڧ͍ΠϯελϯελΠϓ͕ඞཁ
͝ਗ਼ௌ͋Γ͕ͱ͏͍͟͝·ͨ͠
More Decks by Masatoshi Shimada
See All by Masatoshi Shimada
データプラットフォーム技術におけるメダリオンアーキテクチャという考え方/DataPlatformWithMedallionArchitecture
smdmts
12
4.4k
Delta Lakeを用いた LLM処理基盤 / Delta Lake with LLM on Dataplatform
smdmts
3
9.4k
Sparkから利用するAirframe/Spark-With-Airframe
smdmts
0
1.9k
Redashで何をみるのか/What Do You Wanna See Redash?
smdmts
1
1.9k
DatabricksとSparkではじめる [ビッグデータETL処理/データ可視化] 実践入門 / Databricks and Spark with ETL and Visualization
smdmts
1
1.8k
DatabricksとSparkではじめる [データ分析/機械学習] 実践入門 / Databrick and Spark with Data Analyze and ML for newbie.
smdmts
6
2.5k
作らない分析基板のススメ/DWH For Startup With YAGNI
smdmts
1
840
エンジニアのためのドメイン駆動設計実践入門 / DDD for Engineer newbie
smdmts
18
4k
How to growth the delish kitchen team to data-driven team
smdmts
1
1.2k
Other Decks in Programming
See All in Programming
社内AIエージェント「Askワンバン」における コストチューニングの取り組み
t0yohei
0
170
Seven New Principles of Software Engineering
yegor256
0
480
Claude Code ハーネスDeep Dive – 君はどこまで制御する? -
takateeen_knj
6
5.5k
Vue.jsで作る空間解析アプリとCapacitorプラグインのData Bridge
hal_spidernight
1
170
Snowflake Openflow Connector利用の勘所 / 20261024developersio2026tokyo-snowflake-openflow
kasacchiful
PRO
0
330
AI時代のIaC入門 〜なぜインフラをコードで管理したいのか?〜 / Introduction to IaC in the AI Era
akihisaikeda
6
1.5k
Long Living Tokens, Die, Die, Die! (or: The One Ring is Banned in Modern)
sylph01
0
420
Rails初心者がパスキーを実装してみて大変だったこと
ktombow
0
170
Augmenting AI with the Power of Jakarta EE
ivargrimstad
0
270
AIで開発が速くなった先で、開発チームは何を目指すか
shihochan
1
2k
Kawaiicon: Kubernetes, it's no longer cool, but let's secure it anyway!
barnbarn
0
130
선언형 햅틱 라이브러리 진동을 소개합니다
l2hyunwoo
1
310
Featured
See All Featured
[RailsConf 2023 Opening Keynote] The Magic of Rails
eileencodes
31
10k
Mobile First: as difficult as doing things right
swwweet
225
10k
Why Mistakes Are the Best Teachers: Turning Failure into a Pathway for Growth
auna
0
350
Cheating the UX When There Is Nothing More to Optimize - PixelPioneers
stephaniewalter
287
14k
Testing 201, or: Great Expectations
jmmastey
46
8.4k
Building Better People: How to give real-time feedback that sticks.
wjessup
371
20k
The browser strikes back
jonoalderson
0
1.9k
<Decoding/> the Language of Devs - We Love SEO 2024
nikkihalliwell
1
380
The AI Revolution Will Not Be Monopolized: How open-source beats economies of scale, even for LLMs
inesmontani
PRO
3
3.8k
Efficient Content Optimization with Google Search Console & Apps Script
katarinadahlin
PRO
1
990
Context Engineering - Making Every Token Count
addyosmani
9
1.3k
Evolution of real-time – Irina Nazarova, EuRuKo, 2024
irinanazarova
9
1.7k