Upgrade to Pro — share decks privately, control downloads, hide ads and more …

What is Google BigQuery?

Sponsored · Ship Features Fearlessly Turn features on and off without deploys. Used by thousands of Ruby developers. →
Avatar for Kazunori Sato Kazunori Sato
February 04, 2016
Programming
0
110

What is Google BigQuery?

For CROSS 2016 presentation

Avatar for Kazunori Sato

Kazunori Sato

February 04, 2016
Tweet

More Decks by Kazunori Sato

See All by Kazunori Sato
Tensor Processing Unit (TPU) Overview (July 6, 2018)
Avatar for Kazunori Sato kazunori279
0
300
FPGAによる大規模データ処理の高速化
Avatar for Kazunori Sato kazunori279
0
140
Googleがめざす、誰もが使える機械学習
Avatar for Kazunori Sato kazunori279
4
5k
Machine Intelligence at Google Scale
Avatar for Kazunori Sato kazunori279
3
1.4k
Machine Intelligence at Google Scale: Vision/Speech API, TensorFlow and Cloud Machine Learning
Avatar for Kazunori Sato kazunori279
3
5.6k
Distributed TensorFlow
Avatar for Kazunori Sato kazunori279
3
2.5k
Cloud Vision API and TensorFlow
Avatar for Kazunori Sato kazunori279
7
9.4k
Having fun with Google Cloud + RasPi
Avatar for Kazunori Sato kazunori279
0
1.3k
[GCPUG India] Firebase - Build Extraordinary Apps
Avatar for Kazunori Sato kazunori279
2
300

Other Decks in Programming

See All in Programming
20260127_試行錯誤の結晶を1冊に。著者が解説 先輩データサイエンティストからの指南書 / author's_commentary_ds_instructions_guide
Avatar for nash_efp nash_efp
1
1.1k
2026/02/04 AIキャラクター人格の実装論 口 調の模倣から、コンテキスト制御による 『思想』と『行動』の創発へ
Avatar for Sald ra sr2mg4
0
610
「やめとこ」がなくなった — 1月にZennを始めて22本書いた AI共創開発のリアル
Avatar for atani atani14
0
150
AI駆動開発の本音 〜Claude Code並列開発で見えたエンジニアの新しい役割〜
Avatar for hisuzuya hisuzuya
1
270
Ruby x Terminal
Avatar for Akira Matsuda a_matsuda
4
290
AIコーディングの理想と現実 2026 | AI Coding: Expectations vs. Reality 2026
Avatar for Tomohisa Takaoka tomohisa
0
570
The Ralph Wiggum Loop: First Principles of Autonomous Development
Avatar for Ryuichiro Semba sembayui
0
3.7k
Package Management Learnings from Homebrew
Avatar for Mike McQuaid mikemcquaid
0
280
kintone + ローカルLLM = ?
Avatar for ITO Akihiro akit37
0
120
FOSDEM 2026: STUNMESH-go: Building P2P WireGuard Mesh Without Self-Hosted Infrastructure
Avatar for Date Huang tjjh89017
0
190
要求定義・仕様記述・設計・検証の手引き - 理論から学ぶ明確で統一された成果物定義
Avatar for Kuniwak orgachem
PRO
1
400
iOSアプリでフロントエンドと仲良くする
Avatar for Ryu-nakayama ryunakayama
0
120

Featured

See All Featured
The Psychology of Web Performance [Beyond Tellerrand 2023]
Avatar for Tammy Everts tammyeverts
49
3.3k
Embracing the Ebb and Flow
Avatar for Simon Collison colly
88
5k
Visual Storytelling: How to be a Superhuman Communicator
Avatar for David Neal reverentgeek
2
450
Faster Mobile Websites
Avatar for Dean Hume deanohume
310
31k
Fight the Zombie Pattern Library - RWD Summit 2016
Avatar for Marcelo Somers marcelosomers
234
17k
Imperfection Machines: The Place of Print at Facebook
Avatar for Scott Boms scottboms
269
14k
Leo the Paperboy
Avatar for Maya Tellez mayatellez
4
1.5k
Making Projects Easy
Avatar for Brett Harned brettharned
120
6.6k
Facilitating Awesome Meetings
Avatar for Lara Hogan lara
57
6.8k
Information Architects: The Missing Link in Design Systems
Avatar for Michelle Chin soysaucechin
0
810
Learning to Love Humans: Emotional Interface Design
Avatar for Aarron Walter aarron
275
41k
30 Presentation Tips
Avatar for Ian Lurie portentint
PRO
1
240

Transcript

  1. What is Google BigQuery?

  2. +Kazunori Sato @kazunori_279 Kaz Sato Staff Developer Advocate, Tech Lead

    for Data & Analytics, Cloud Platform, Google Inc.

  3. = The Datacenter as a Computer

  4. None

  5. Enterprise

  6. Jupiter network 40GbE ports 10GbE x 100K = 1 Pbps

    CLOS topology Software Defined Network

  7. Borg Launches 2B containers / week Manages 10K machines /

    Cell DC-scale proactive job sched (CPU, mem, disk IO, TCP ports) Paxos-based metadata store

  8. Google BigQuery

  9. 1 B 1 B 100 B 900 M

  10. At Google, MapReduce is classic. We use BigQuery. Confidential &

    Proprietary Google Cloud Platform 10

  11. SELECT your_data FROM billions_of_rows WHERE full_disk_scan_required = true; Scanning 1

    TB in 1 sec with 5,000 - 10,000 disk spindles

  12. BigQuery Analytic Service in the Cloud BigQuery Analyze Export Import

    How to use BigQuery? Google Analytics ETL tools Connectors Google Cloud BI tools and Visualization Google Cloud Spreadsheets, R, Hadoop

  13. Blazingly Fast Capable of scanning 10B rows in ~10 sec

    Low Cost Storage: $0.020 per GB per month Queries: $5 per TB Fully Managed Use thousands of servers with zero-ops SQL Simple and Intuitive SQL with JS UDF Benefits of BigQuery

  14. Thank you