Upgrade to Pro — share decks privately, control downloads, hide ads and more …

What is Google BigQuery?

Avatar for Kazunori Sato Kazunori Sato
February 04, 2016
Programming
140
0

What is Google BigQuery?

For CROSS 2016 presentation

Avatar for Kazunori Sato

Kazunori Sato

February 04, 2016

More Decks by Kazunori Sato

See All by Kazunori Sato
Tensor Processing Unit (TPU) Overview (July 6, 2018)
Avatar for Kazunori Sato kazunori279
0
350
FPGAによる大規模データ処理の高速化
Avatar for Kazunori Sato kazunori279
0
170
Googleがめざす、誰もが使える機械学習
Avatar for Kazunori Sato kazunori279
4
5.1k
Machine Intelligence at Google Scale
Avatar for Kazunori Sato kazunori279
3
1.4k
Machine Intelligence at Google Scale: Vision/Speech API, TensorFlow and Cloud Machine Learning
Avatar for Kazunori Sato kazunori279
3
5.7k
Distributed TensorFlow
Avatar for Kazunori Sato kazunori279
3
2.6k
Cloud Vision API and TensorFlow
Avatar for Kazunori Sato kazunori279
7
9.5k
Having fun with Google Cloud + RasPi
Avatar for Kazunori Sato kazunori279
0
1.4k
[GCPUG India] Firebase - Build Extraordinary Apps
Avatar for Kazunori Sato kazunori279
2
330

Other Decks in Programming

See All in Programming
React本体のコードリーディング
Avatar for high-g high_g_engineer
1
140
<title><a id="</title>君はこのHTMLをパースできるか"></a></title> #雑LT_study
Avatar for pizzacat83 pizzacat83
0
140
VibeCodingからAgenticWorkflowへ
Avatar for starfish719 starfish719
0
330
関東Kaggler会_NVIDIA_Nemotron_コンペ_振り返り
Avatar for rick rick_ds
0
490
ルールを書いて終わらせないハーネスエンジニアリング
Avatar for Yuji Yamaguchi yug1224
4
1.9k
Apache Hive: そしてCloud Native Lakehouseへ
Avatar for okumin okumin
1
210
琵琶湖の水は止められてもNet--HTTPのリトライは止められない / You might be able to stop the water flow of Lake Biwa but you can't stop Net::HTTP retries
Avatar for luccafort luccafort
PRO
0
620
Google Apps Script で Ruby を動かす
Avatar for Shogo Kawahara kawahara
0
140
AI時代に設計が 最大の生産性レバーになる 意図駆動開発とデータを消さない設計｜Don't Delete Your Data or Your Intent — Design as the Deepest Lever in the AI Era
Avatar for Tomohisa Takaoka tomohisa
1
740
OpenSpecのproposalにbrainstormingを持たせてみた
Avatar for Toranosuke Minamikawa tigertora7571
1
210
メールのエイリアス機能を履き違えない
Avatar for 船長（せんちょう） isshinfunada
0
230
Android CLI
Avatar for Sungyong An fornewid
0
210

Featured

See All Featured
A brief & incomplete history of 
UX Design for the World Wide Web: 1989–2019
Avatar for Jason CranfordTeague jct
2
450
Ruling the World: When Life Gets Gamed
Avatar for Sebastian Deterding codingconduct
0
290
職位にかかわらず全員がリーダーシップを発揮するチーム作り / Building a team where everyone can demonstrate leadership regardless of position
Avatar for MADOX madoxten
64
56k
<Decoding/> the Language of Devs - We Love SEO 2024
Avatar for Nikki Halliwell nikkihalliwell
1
280
Done Done
Avatar for chrislema chrislema
186
16k
YesSQL, Process and Tooling at Scale
Avatar for Rocio Delgado rocio
174
15k
How to Align SEO within the Product Triangle To Get 
Buy-In & Support - #RIMC
Avatar for Aleyda Solis aleyda
2
1.8k
Product Roadmaps are Hard
Avatar for C. Todd Lombardo iamctodd
55
12k
Practical Orchestrator
Avatar for Shlomi Noach shlominoach
191
12k
Principles of Awesome APIs and How to Build Them.
Avatar for Keavy McMinn keavy
128
18k
The innovator’s Mindset - 
Leading Through an Era of Exponential Change - McGill University 2025
Avatar for Jean-Marc De Jonghe jdejongh
PRO
1
230
How People are Using Generative and Agentic AI to Supercharge Their Products, Projects, Services and Value Streams Today
Avatar for Helen Beal helenjbeal
1
260

Transcript

  1. What is Google BigQuery?

  2. +Kazunori Sato @kazunori_279 Kaz Sato Staff Developer Advocate, Tech Lead

    for Data & Analytics, Cloud Platform, Google Inc.

  3. = The Datacenter as a Computer

  4. None

  5. Enterprise

  6. Jupiter network 40GbE ports 10GbE x 100K = 1 Pbps

    CLOS topology Software Defined Network

  7. Borg Launches 2B containers / week Manages 10K machines /

    Cell DC-scale proactive job sched (CPU, mem, disk IO, TCP ports) Paxos-based metadata store

  8. Google BigQuery

  9. 1 B 1 B 100 B 900 M

  10. At Google, MapReduce is classic. We use BigQuery. Confidential &

    Proprietary Google Cloud Platform 10

  11. SELECT your_data FROM billions_of_rows WHERE full_disk_scan_required = true; Scanning 1

    TB in 1 sec with 5,000 - 10,000 disk spindles

  12. BigQuery Analytic Service in the Cloud BigQuery Analyze Export Import

    How to use BigQuery? Google Analytics ETL tools Connectors Google Cloud BI tools and Visualization Google Cloud Spreadsheets, R, Hadoop

  13. Blazingly Fast Capable of scanning 10B rows in ~10 sec

    Low Cost Storage: $0.020 per GB per month Queries: $5 per TB Fully Managed Use thousands of servers with zero-ops SQL Simple and Intuitive SQL with JS UDF Benefits of BigQuery

  14. Thank you