Momento Confidential Agenda ● Brief introduction of PingCAP & TiDB ● The journey of building TiDB Serverless ● Example: AI powered OSSInsight.io on TiDB Serverless ● TiDB Serverless key capabilities ● Developer resources
Momento Confidential Silicon Valley Amsterdam Beijing Tokyo The creators of TiDB Founded in 2015 Based in Sunnyvale, CA More than 550+ employees globally Over $600M in total funding Mission: Empower engineers and enterprises to innovate with speed, agility, and scale Singapore
Momento Confidential The most advanced, open source, distributed SQL database for modern applications. Scalable. Versatile. Titanium (Ti) Reliable. 35K+ GitHub Stars 800+ Contributors Trusted By FlipKart Pinterest
Momento Confidential 26.9 million clusters Even we provide a tiny tidb (aws t2.nano) cluster. For each year it will cost: 26.9 million * 4 vCPUs (3 storage node+ 1 compute node + 1 placement driver) * (0.003 * 365 * 24) = $2.83 billion / year Really? what a shocking number!
Momento Confidential ELB ~ 30$ for each cluster/year, we need another $807 million. We need total $3.6 billion/year. Oh, I forget to mention ELB, storage, HA and more…
Momento Confidential ELB ~ 30$ for each cluster/year, we need another $807 million. We need total $3.6 billion/year. Let’s forget about the cost of the storage, monitoring system and so on, that’s too scary to calculate. What’s more, AI transforms individuals into developers. The number could be 10x larger in the next few years. Oh, I forget to mention ELB, storage, HA and more…
Momento Confidential To Make it possible ● Reuse as many spot instances as we can. ~70% off discount ● 80/20 theory. 80% of the cluster are not active. 80% off Quick math in your mind: $3.6 billion/year * 30% * 20% One more thing
Momento Confidential Tell me more about ● lightweight compute ○ Read/Write a few records or indexes ○ Small OLTP transactions ● heavy compute ○ Adding index ○ Change/Remove a column from a table ○ Collect table statistics(Analyze table) ○ Scan a whole table or lots of records ○ Compression ○ And more
Momento Confidential Tell me more about ● lightweight compute ○ Read/Write a few records or indexes ○ Small OLTP transactions (e.g. primary key lookup) ● heavy compute (offload to dynamic micro services) ○ Adding index ○ Change/Remove a column from a table ○ Collect table statistics(Analyze table) ○ Scan a whole table or lots of records ○ Compression ○ And more
Momento Confidential Results of Lightweight compute ● 2x better cpu utilization ( Saved 50% money, again! ) ● Lower latency for lightweight compute, less spike Now it’s $100 million per year. Wow, it’s close to $3.7 per developer per year.
Momento Confidential Separation of compute and compute ● Better user experience ( after offload heavy compute) ○ 100x Faster adding index (WIP) ○ Fast table statistics collection (Done. leverage the distributed architecture) ○ Backup large clusters in seconds (Done. e.g., hundreds of TBs, with the help of S3) ● Higher Durability & Availability ○ Leverage the durability of S3 ○ Recover from a failed server faster by loading data from S3 concurrently
Momento Confidential Example: OSSInsight.io https://github.com/pingcap/ossinsight OSSInsight is a powerful open-source tool that gives detailed and up-to-date information about the open source world by analyzing over 6 billion GitHub events. OSS Insight's Data Explorer makes exploring GitHub data easy. Simply ask a question in natural language, and Data Explorer will create a SQL, execute the SQL, and show you the results visually.
Momento Confidential OSSInsight on TiDB Serverless Data Volume - 12 TBs, over 6 Billion rows of data - all growing in real-time. Random Mixed Workloads - Serving online transactions plus analytical queries generated by AI Unpredictable Traffic Spikes - Featured on HackerNews with 7x traffic in one day. 72.7% Cost Reduction Zero Manual Intervention During Spikes 5X Development Efficiency for LLM Data Apps https://github.com/pingcap/ossinsight
Momento Confidential TiDB Serverless Lalency Time Workload Peak 100 Time PVs Automatically scale in and out to meet workload demands in real-time Resource Pool Real-time elasticity
Momento Confidential 12,491ms vs 187.5ms 67x Faster with HTAP Versatile to run Hybrid Transactional and Analytical (HTAP) workloads with smart optimizer and two distinct storage layers
Momento Confidential Developer Resources TiDB Cloud CLI VS Code @TiDB_Developer Partner integrations to meet where developers are Comprehensive docs to learn about TiDB Cloud Resource hub and online courses for developers
Momento Confidential AJU Center of Independent Living & TiDB Serverless AJU migrated some websites below (built with Wordpress) to TiDB Serverless: 1) こころの絆創膏 2) ゲートキーパー研修 3) なごや食育ひろば (coming soon) AJU Center for Independent Living is an association run by colleagues of wheelchair users in Aichi Prefecture.
pingcap0315
bownie
minorun365
orgachem
chumajin
sat
knsg16
nikkei_engineer_recruiting
aoshun7
biwashi
k1low
niftycorp
yutoy
tammyeverts
akosma
scottboms
mclloyd
philhawksworth
geoffreycrofte
frogandcode
speakerdeck
mojombo
marcduiker
jacobian
aleyda