Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
What is Google BigQuery?
Search
Kazunori Sato
February 04, 2016
Programming
0
44
What is Google BigQuery?
For CROSS 2016 presentation
Kazunori Sato
February 04, 2016
Tweet
Share
More Decks by Kazunori Sato
See All by Kazunori Sato
Tensor Processing Unit (TPU) Overview (July 6, 2018)
kazunori279
0
180
FPGAによる大規模データ処理の高速化
kazunori279
0
90
Googleがめざす、誰もが使える機械学習
kazunori279
4
4.7k
Machine Intelligence at Google Scale
kazunori279
3
1.4k
Machine Intelligence at Google Scale: Vision/Speech API, TensorFlow and Cloud Machine Learning
kazunori279
3
5.3k
Distributed TensorFlow
kazunori279
3
2.3k
Cloud Vision API and TensorFlow
kazunori279
7
9.1k
Having fun with Google Cloud + RasPi
kazunori279
0
1.1k
[GCPUG India] Firebase - Build Extraordinary Apps
kazunori279
2
250
Other Decks in Programming
See All in Programming
Our Websites Need a Lifestyle Change, Not a Diet
ryantownsend
0
150
Rubyのobject_id
qnighy
6
1.3k
rbs-inlineを導入してYARDからRBSに移行する
euglena1215
1
290
Prolog入門
qnighy
4
1k
実践!難読化ガイド
mitchan
0
200
Amazon BedrockでサーバレスなAIお料理ボットを作成する!!
tosuri13
0
230
オートマトン学習しろ / Do automata learning
makenowjust
3
130
Developer Joy == Developer Productivity (really!)
hollycummins
1
220
あなたのアプリ、ログはでてますか?あるいはログをだしてますか? (Funabashi.dev用 軽量版)
uzulla
2
120
長期運用プロダクトの開発速度を維持し続けるためのリファクタリング実践例
wataruss
8
2.7k
Android開発以外のAndroid開発経験の活かしどころ
konifar
2
1k
Scala アプリケーションのビルドを改善してデプロイ時間を 1/4 にした話 | How I improved the build of my Scala application and reduced deployment time by 4x
nomadblacky
1
180
Featured
See All Featured
Docker and Python
trallard
39
3k
Making Projects Easy
brettharned
113
5.8k
GraphQLとの向き合い方2022年版
quramy
43
13k
Intergalactic Javascript Robots from Outer Space
tanoku
268
26k
Rebuilding a faster, lazier Slack
samanthasiow
78
8.6k
jQuery: Nuts, Bolts and Bling
dougneiner
61
7.4k
Infographics Made Easy
chrislema
239
18k
How to Think Like a Performance Engineer
csswizardry
16
960
The Power of CSS Pseudo Elements
geoffreycrofte
71
5.3k
Evolution of real-time – Irina Nazarova, EuRuKo, 2024
irinanazarova
0
120
Exploring the Power of Turbo Streams & Action Cable | RailsConf2023
kevinliebholz
25
3.9k
Save Time (by Creating Custom Rails Generators)
garrettdimon
PRO
24
610
Transcript
What is Google BigQuery?
+Kazunori Sato @kazunori_279 Kaz Sato Staff Developer Advocate, Tech Lead
for Data & Analytics, Cloud Platform, Google Inc.
= The Datacenter as a Computer
None
Enterprise
Jupiter network 40GbE ports 10GbE x 100K = 1 Pbps
CLOS topology Software Defined Network
Borg Launches 2B containers / week Manages 10K machines /
Cell DC-scale proactive job sched (CPU, mem, disk IO, TCP ports) Paxos-based metadata store
Google BigQuery
1 B 1 B 100 B 900 M
At Google, MapReduce is classic. We use BigQuery. Confidential &
Proprietary Google Cloud Platform 10
SELECT your_data FROM billions_of_rows WHERE full_disk_scan_required = true; Scanning 1
TB in 1 sec with 5,000 - 10,000 disk spindles
BigQuery Analytic Service in the Cloud BigQuery Analyze Export Import
How to use BigQuery? Google Analytics ETL tools Connectors Google Cloud BI tools and Visualization Google Cloud Spreadsheets, R, Hadoop
Blazingly Fast Capable of scanning 10B rows in ~10 sec
Low Cost Storage: $0.020 per GB per month Queries: $5 per TB Fully Managed Use thousands of servers with zero-ops SQL Simple and Intuitive SQL with JS UDF Benefits of BigQuery
Thank you