Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
What is Google BigQuery?
Search
Sponsored
·
SiteGround - Reliable hosting with speed, security, and support you can count on.
→
Kazunori Sato
February 04, 2016
Programming
140
0
Share
Embed
Copy iframe code
Copy JS code
Copy link
Start on current slide
What is Google BigQuery?
For CROSS 2016 presentation
Kazunori Sato
February 04, 2016
More Decks by Kazunori Sato
See All by Kazunori Sato
Tensor Processing Unit (TPU) Overview (July 6, 2018)
kazunori279
0
340
FPGAによる大規模データ処理の高速化
kazunori279
0
160
Googleがめざす、誰もが使える機械学習
kazunori279
4
5.1k
Machine Intelligence at Google Scale
kazunori279
3
1.4k
Machine Intelligence at Google Scale: Vision/Speech API, TensorFlow and Cloud Machine Learning
kazunori279
3
5.7k
Distributed TensorFlow
kazunori279
3
2.5k
Cloud Vision API and TensorFlow
kazunori279
7
9.5k
Having fun with Google Cloud + RasPi
kazunori279
0
1.4k
[GCPUG India] Firebase - Build Extraordinary Apps
kazunori279
2
320
Other Decks in Programming
See All in Programming
Semantic Version 単位で戦略を柔軟に変えて、パッケージアップデートを自動化する
daitasu
1
270
Lemonade + Foundry Toolkit でお手軽アプリ開発
seosoft
1
360
生成AI時代にこそ効くGo | Why Go Works in the Age of Generative AI
mom0tomo
8
3.3k
The NotImplementedError Problem in Ruby
koic
1
860
C# and C++ Interoperability - cho-dotnetnew
harukasao
0
310
Dataformのリポジトリを立ち上げるときにまずやること / dataform-day0-2026
snhryt
0
170
Observability in Practice:Grafana 與 Edge Device SRE 的那些事
blueswen
0
170
技術記事、 専門家としてのプログラマ、 言語化
mizchi
13
6.3k
AI 輔助遺留系統現代化的經驗分享
jame2408
1
850
決定論的オーケストレーションの設計と実装 / Design and Implementation of Deterministic Orchestration
nrslib
4
1.4k
依存関係から依存物へ―Dependencyという言葉の歴史をひも解く
j_lee
0
120
さぁV100、メモリをお食べ・・・
nilpe
0
150
Featured
See All Featured
Believing is Seeing
oripsolob
1
150
StorybookのUI Testing Handbookを読んだ
zakiyama
31
6.8k
Git: the NoSQL Database
bkeepers
PRO
432
67k
Collaborative Software Design: How to facilitate domain modelling decisions
baasie
1
250
The browser strikes back
jonoalderson
0
1.3k
Visualization
eitanlees
152
17k
Done Done
chrislema
186
16k
YesSQL, Process and Tooling at Scale
rocio
174
15k
Discover your Explorer Soul
emna__ayadi
2
1.1k
WENDY [Excerpt]
tessaabrams
11
38k
The Illustrated Children's Guide to Kubernetes
chrisshort
51
52k
Taking LLMs out of the black box: A practical guide to human-in-the-loop distillation
inesmontani
PRO
3
2.3k
Transcript
What is Google BigQuery?
+Kazunori Sato @kazunori_279 Kaz Sato Staff Developer Advocate, Tech Lead
for Data & Analytics, Cloud Platform, Google Inc.
= The Datacenter as a Computer
None
Enterprise
Jupiter network 40GbE ports 10GbE x 100K = 1 Pbps
CLOS topology Software Defined Network
Borg Launches 2B containers / week Manages 10K machines /
Cell DC-scale proactive job sched (CPU, mem, disk IO, TCP ports) Paxos-based metadata store
Google BigQuery
1 B 1 B 100 B 900 M
At Google, MapReduce is classic. We use BigQuery. Confidential &
Proprietary Google Cloud Platform 10
SELECT your_data FROM billions_of_rows WHERE full_disk_scan_required = true; Scanning 1
TB in 1 sec with 5,000 - 10,000 disk spindles
BigQuery Analytic Service in the Cloud BigQuery Analyze Export Import
How to use BigQuery? Google Analytics ETL tools Connectors Google Cloud BI tools and Visualization Google Cloud Spreadsheets, R, Hadoop
Blazingly Fast Capable of scanning 10B rows in ~10 sec
Low Cost Storage: $0.020 per GB per month Queries: $5 per TB Fully Managed Use thousands of servers with zero-ops SQL Simple and Intuitive SQL with JS UDF Benefits of BigQuery
Thank you