Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
What is Google BigQuery?
Search
Kazunori Sato
February 04, 2016
Programming
0
87
What is Google BigQuery?
For CROSS 2016 presentation
Kazunori Sato
February 04, 2016
Tweet
Share
More Decks by Kazunori Sato
See All by Kazunori Sato
Tensor Processing Unit (TPU) Overview (July 6, 2018)
kazunori279
0
260
FPGAによる大規模データ処理の高速化
kazunori279
0
130
Googleがめざす、誰もが使える機械学習
kazunori279
4
4.9k
Machine Intelligence at Google Scale
kazunori279
3
1.4k
Machine Intelligence at Google Scale: Vision/Speech API, TensorFlow and Cloud Machine Learning
kazunori279
3
5.6k
Distributed TensorFlow
kazunori279
3
2.4k
Cloud Vision API and TensorFlow
kazunori279
7
9.3k
Having fun with Google Cloud + RasPi
kazunori279
0
1.3k
[GCPUG India] Firebase - Build Extraordinary Apps
kazunori279
2
290
Other Decks in Programming
See All in Programming
CSC305 Lecture 01
javiergs
PRO
1
380
PostgreSQLで手軽にDuckDBを使う!DuckDB&pg_duckdb入門/osk2025-duckdb
takahashiikki
1
230
Swiftビルド弾丸ツアー - Swift Buildが作る新しいエコシステム
giginet
PRO
0
1.5k
大規模アプリにおけるXcode Previews実用化までの道のり
ikesyo
0
950
半自動E2Eで手っ取り早くリグレッションテストを効率化しよう
beryu
6
2.3k
Build your own WebP codec in Swift
kishikawakatsumi
2
840
議事録の要点整理を自動化! サーバレス Bot 構築術
penpeen
3
1.6k
生成AIを活用した初学者向けPython講座
soogie
1
130
Web技術を最大限活用してRAW画像を現像する / Developing RAW Images on the Web
ssssota
2
980
iOSエンジニア向けの英語学習アプリを作る!
yukawashouhei
0
150
フロントエンド開発に役立つクライアントプログラム共通のノウハウ / Universal client-side programming best practices for frontend development
nrslib
7
3.8k
AIで開発生産性を上げる個人とチームの取り組み
taniigo
0
120
Featured
See All Featured
The Myth of the Modular Monolith - Day 2 Keynote - Rails World 2024
eileencodes
26
3.1k
Why You Should Never Use an ORM
jnunemaker
PRO
59
9.5k
Building Adaptive Systems
keathley
43
2.8k
Code Reviewing Like a Champion
maltzj
525
40k
The Invisible Side of Design
smashingmag
301
51k
Typedesign – Prime Four
hannesfritz
42
2.8k
Building Applications with DynamoDB
mza
96
6.6k
Bootstrapping a Software Product
garrettdimon
PRO
307
110k
Navigating Team Friction
lara
189
15k
Building Flexible Design Systems
yeseniaperezcruz
329
39k
Bash Introduction
62gerente
615
210k
Large-scale JavaScript Application Architecture
addyosmani
513
110k
Transcript
What is Google BigQuery?
+Kazunori Sato @kazunori_279 Kaz Sato Staff Developer Advocate, Tech Lead
for Data & Analytics, Cloud Platform, Google Inc.
= The Datacenter as a Computer
None
Enterprise
Jupiter network 40GbE ports 10GbE x 100K = 1 Pbps
CLOS topology Software Defined Network
Borg Launches 2B containers / week Manages 10K machines /
Cell DC-scale proactive job sched (CPU, mem, disk IO, TCP ports) Paxos-based metadata store
Google BigQuery
1 B 1 B 100 B 900 M
At Google, MapReduce is classic. We use BigQuery. Confidential &
Proprietary Google Cloud Platform 10
SELECT your_data FROM billions_of_rows WHERE full_disk_scan_required = true; Scanning 1
TB in 1 sec with 5,000 - 10,000 disk spindles
BigQuery Analytic Service in the Cloud BigQuery Analyze Export Import
How to use BigQuery? Google Analytics ETL tools Connectors Google Cloud BI tools and Visualization Google Cloud Spreadsheets, R, Hadoop
Blazingly Fast Capable of scanning 10B rows in ~10 sec
Low Cost Storage: $0.020 per GB per month Queries: $5 per TB Fully Managed Use thousands of servers with zero-ops SQL Simple and Intuitive SQL with JS UDF Benefits of BigQuery
Thank you