Upgrade to Pro — share decks privately, control downloads, hide ads and more …

What is Google BigQuery?

Avatar for Kazunori Sato Kazunori Sato
February 04, 2016
Programming
0
110

What is Google BigQuery?

For CROSS 2016 presentation

Avatar for Kazunori Sato

Kazunori Sato

February 04, 2016
Tweet

More Decks by Kazunori Sato

See All by Kazunori Sato
Tensor Processing Unit (TPU) Overview (July 6, 2018)
Avatar for Kazunori Sato kazunori279
0
290
FPGAによる大規模データ処理の高速化
Avatar for Kazunori Sato kazunori279
0
140
Googleがめざす、誰もが使える機械学習
Avatar for Kazunori Sato kazunori279
4
5k
Machine Intelligence at Google Scale
Avatar for Kazunori Sato kazunori279
3
1.4k
Machine Intelligence at Google Scale: Vision/Speech API, TensorFlow and Cloud Machine Learning
Avatar for Kazunori Sato kazunori279
3
5.6k
Distributed TensorFlow
Avatar for Kazunori Sato kazunori279
3
2.5k
Cloud Vision API and TensorFlow
Avatar for Kazunori Sato kazunori279
7
9.4k
Having fun with Google Cloud + RasPi
Avatar for Kazunori Sato kazunori279
0
1.3k
[GCPUG India] Firebase - Build Extraordinary Apps
Avatar for Kazunori Sato kazunori279
2
300

Other Decks in Programming

See All in Programming
AIエージェントの設計で注意するべきポイント6選
Avatar for Har1101 har1101
6
3.1k
PostgreSQLで手軽にDuckDBを使う！DuckDB&pg_duckdb入門/osc25hi-duckdb
Avatar for Takahashi Ikki takahashiikki
0
240
コマンドとリード間の連携に対する脅威分析フレームワーク
Avatar for Aja9tochin pandayumi
1
210
例外処理とどう使い分ける？Result型を使ったエラー設計 #burikaigi
Avatar for Takuma Kajikawa kajitack
16
5.2k
Cap'n Webについて
Avatar for Yusuke Wada yusukebe
0
160
公共交通オープンデータ × モバイルUX 複雑な運行情報を 『直感』に変換する技術
Avatar for Tsubasa SEKIGUCHI tinykitten
PRO
0
180
JETLS.jl ─ A New Language Server for Julia
Avatar for abap34 abap34
2
470
QAフローを最適化し、品質水準を満たしながらリリースまでの期間を最短化する #RSGT2026
Avatar for shibayu36 shibayu36
0
1.9k
AIで開発はどれくらい加速したのか？AIエージェントによるコード生成を、現場の評価と研究開発の評価の両面からdeep diveしてみる
Avatar for どすこい daisuketakeda
1
650
Go コードベースの構成と AI コンテキスト定義
Avatar for ANDPAD inc andpad
0
160
[AI Engineering Summit Tokyo 2025] LLMは計画業務のゲームチェンジャーか？ 最適化業務における活⽤の可能性と限界
Avatar for terry-u16 terryu16
2
290
AIエージェント、”どう作るか”で差は出るか？ / AI Agents: Does the "How" Make a Difference?
Avatar for r-kagaya rkaga
2
870

Featured

See All Featured
A Tale of Four Properties
Avatar for Chris Coyier chriscoyier
162
24k
Producing Creativity
Avatar for Steve Smith orderedlist
PRO
348
40k
How to Grow Your eCommerce with AI & Automation
Avatar for Katarina Dahlin katarinadahlin
PRO
0
89
Navigating Team Friction
Avatar for Lara Hogan lara
191
16k
Reality Check: Gamification 10 Years Later
Avatar for Sebastian Deterding codingconduct
0
2k
Hiding What from Whom? A Critical Review of the History of Programming languages for Music
Avatar for Tomoya Matsuura tomoyanonymous
1
350
The Organizational Zoo: Understanding Human Behavior Agility Through Metaphoric Constructive Conversations (based on the works of Arthur Shelley, Ph.D)
Avatar for Dr. Kim W Petersen kimpetersen
PRO
0
210
GraphQLとの向き合い方2022年版
Avatar for Yosuke Kurami quramy
50
14k
New Earth Scene 8
Avatar for Sydney Stone popppiees
1
1.3k
How to build a perfect <img>
Avatar for Jono Alderson jonoalderson
1
4.8k
Imperfection Machines: The Place of Print at Facebook
Avatar for Scott Boms scottboms
269
13k
Rebuilding a faster, lazier Slack
Avatar for samanthasiow samanthasiow
85
9.3k

Transcript

  1. What is Google BigQuery?

  2. +Kazunori Sato @kazunori_279 Kaz Sato Staff Developer Advocate, Tech Lead

    for Data & Analytics, Cloud Platform, Google Inc.

  3. = The Datacenter as a Computer

  4. None

  5. Enterprise

  6. Jupiter network 40GbE ports 10GbE x 100K = 1 Pbps

    CLOS topology Software Defined Network

  7. Borg Launches 2B containers / week Manages 10K machines /

    Cell DC-scale proactive job sched (CPU, mem, disk IO, TCP ports) Paxos-based metadata store

  8. Google BigQuery

  9. 1 B 1 B 100 B 900 M

  10. At Google, MapReduce is classic. We use BigQuery. Confidential &

    Proprietary Google Cloud Platform 10

  11. SELECT your_data FROM billions_of_rows WHERE full_disk_scan_required = true; Scanning 1

    TB in 1 sec with 5,000 - 10,000 disk spindles

  12. BigQuery Analytic Service in the Cloud BigQuery Analyze Export Import

    How to use BigQuery? Google Analytics ETL tools Connectors Google Cloud BI tools and Visualization Google Cloud Spreadsheets, R, Hadoop

  13. Blazingly Fast Capable of scanning 10B rows in ~10 sec

    Low Cost Storage: $0.020 per GB per month Queries: $5 per TB Fully Managed Use thousands of servers with zero-ops SQL Simple and Intuitive SQL with JS UDF Benefits of BigQuery

  14. Thank you