Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Sign up for free
Menu
Search
Features
All features
Private URLs
Password Protection
Custom URLS
Scheduled publishing
Remove Branding
Restrict embedding
Deck Collections
Notes
Features
All features
Private URLs
Password Protection
Custom URLS
Scheduled publishing
Remove Branding
Restrict embedding
Deck Collections
Notes
Explore
Featured decks
Featured speakers
Programming
Technology
Storyboards
Explore
Featured decks
Featured speakers
Programming
Technology
Storyboards
Pricing
Search
Sign in
Sign up for free
What is Google BigQuery?
Search
Kazunori Sato
February 04, 2016
Programming
160
0
Share
Embed
Copy iframe code
Copy JS code
Copy link
Start on current slide
What is Google BigQuery?
For CROSS 2016 presentation
Kazunori Sato
February 04, 2016
Transcript
14 slides
What is Google BigQuery?
+Kazunori Sato @kazunori_279 Kaz Sato Staff Developer Advocate, Tech Lead
for Data & Analytics, Cloud Platform, Google Inc.
= The Datacenter as a Computer
None
Enterprise
Jupiter network 40GbE ports 10GbE x 100K = 1 Pbps
CLOS topology Software Defined Network
Borg Launches 2B containers / week Manages 10K machines /
Cell DC-scale proactive job sched (CPU, mem, disk IO, TCP ports) Paxos-based metadata store
Google BigQuery
1 B 1 B 100 B 900 M
At Google, MapReduce is classic. We use BigQuery. Confidential &
Proprietary Google Cloud Platform 10
SELECT your_data FROM billions_of_rows WHERE full_disk_scan_required = true; Scanning 1
TB in 1 sec with 5,000 - 10,000 disk spindles
BigQuery Analytic Service in the Cloud BigQuery Analyze Export Import
How to use BigQuery? Google Analytics ETL tools Connectors Google Cloud BI tools and Visualization Google Cloud Spreadsheets, R, Hadoop
Blazingly Fast Capable of scanning 10B rows in ~10 sec
Low Cost Storage: $0.020 per GB per month Queries: $5 per TB Fully Managed Use thousands of servers with zero-ops SQL Simple and Intuitive SQL with JS UDF Benefits of BigQuery
Thank you
More Decks by Kazunori Sato
See All by Kazunori Sato
Tensor Processing Unit (TPU) Overview (July 6, 2018)
kazunori279
0
400
FPGAによる大規模データ処理の高速化
kazunori279
0
210
Googleがめざす、誰もが使える機械学習
kazunori279
4
5.2k
Machine Intelligence at Google Scale
kazunori279
3
1.5k
Machine Intelligence at Google Scale: Vision/Speech API, TensorFlow and Cloud Machine Learning
kazunori279
3
5.8k
Distributed TensorFlow
kazunori279
3
2.6k
Cloud Vision API and TensorFlow
kazunori279
7
9.6k
Having fun with Google Cloud + RasPi
kazunori279
0
1.4k
[GCPUG India] Firebase - Build Extraordinary Apps
kazunori279
2
350
Other Decks in Programming
See All in Programming
Claude Code ハーネスDeep Dive – 君はどこまで制御する? -
takateeen_knj
6
5.6k
LLM 101
dalinaum
0
480
Growing PicoRuby's Ecosystem on ESP32
yuuu
2
120
エージェントを使い続けるためのメタワーク / Meta-work for keeping using the agent
rkaga
6
2.3k
AIが生成したコードは読むべきか?抽象化設計とコードの品質保証 / abstraction-design-and-quality
minodriven
16
9.1k
Next.js: The final boss of Web Performance
guaca
0
400
Apple Intelligenceとオンデバイス時代の到来
yahir0
0
240
Web Framework Benchmark Battle 2026, Any%
a_matsuda
3
3.2k
Seven New Principles of Software Engineering
yegor256
0
480
クラウドゲーミングのパフォーマンス最適化に挑む / Cloud Gaming Performance Tuning
vivion
0
330
作れる、でも消せるか?──安全に「枯らして消す」機能削除術 / Drain, Then Delete
chobishiba
3
1.5k
Rails初心者がパスキーを実装してみて大変だったこと
ktombow
0
170
Featured
See All Featured
Abbi's Birthday
coloredviolet
5
11k
Performance Is Good for Brains [We Love Speed 2024]
tammyeverts
12
1.9k
Distributed Sagas: A Protocol for Coordinating Microservices
caitiem20
333
23k
Build The Right Thing And Hit Your Dates
maggiecrowley
39
3.5k
We Have a Design System, Now What?
morganepeng
55
8.4k
Measuring Dark Social's Impact On Conversion and Attribution
stephenakadiri
2
330
Raft: Consensus for Rubyists
vanstee
143
7.9k
VelocityConf: Rendering Performance Case Studies
addyosmani
331
25k
Heart Work Chapter 1 - Part 1
lfama
PRO
11
37k
Navigating Weather and Climate Data
rabernat
0
590
Unlocking the hidden potential of vector embeddings in international SEO
frankvandijk
0
1k
Agile Actions for Facilitating Distributed Teams - ADO2019
mkilby
0
340