Upgrade to Pro — share decks privately, control downloads, hide ads and more …
Sign up for free

What is Google BigQuery?

Sponsored · SiteGround - Reliable hosting with speed, security, and support you can count on. →
Avatar for Kazunori Sato Kazunori Sato
February 04, 2016
Programming
150
0

What is Google BigQuery?

For CROSS 2016 presentation

Avatar for Kazunori Sato

Kazunori Sato

February 04, 2016

More Decks by Kazunori Sato

See All by Kazunori Sato
Tensor Processing Unit (TPU) Overview (July 6, 2018)
Avatar for Kazunori Sato kazunori279
0
380
FPGAによる大規模データ処理の高速化
Avatar for Kazunori Sato kazunori279
0
200
Googleがめざす、誰もが使える機械学習
Avatar for Kazunori Sato kazunori279
4
5.2k
Machine Intelligence at Google Scale
Avatar for Kazunori Sato kazunori279
3
1.5k
Machine Intelligence at Google Scale: Vision/Speech API, TensorFlow and Cloud Machine Learning
Avatar for Kazunori Sato kazunori279
3
5.8k
Distributed TensorFlow
Avatar for Kazunori Sato kazunori279
3
2.6k
Cloud Vision API and TensorFlow
Avatar for Kazunori Sato kazunori279
7
9.6k
Having fun with Google Cloud + RasPi
Avatar for Kazunori Sato kazunori279
0
1.4k
[GCPUG India] Firebase - Build Extraordinary Apps
Avatar for Kazunori Sato kazunori279
2
340

Other Decks in Programming

See All in Programming
JIS keyboard support in Omarchy
Avatar for LEF lef237
0
140
パズルゲームの作り方 / how to make puzzle games
Avatar for kaityo256 kaityo256
PRO
2
300
Kotlinの15年とServer-Side Kotlin
Avatar for Takehata Naoto n_takehata
1
160
Compiling a real-world CLI tool to native with Static Hermes
Avatar for Tzvetan Mikov tmikov2023
0
130
作って学ぶSpring BootのAuto Configuration / JJUG Night Seminar 2026-10-19
Avatar for Ryo Shindo rshindo
0
190
IBM Bob でAI駆動開発『QC-Playbook』
Avatar for 1kano ichirokano2
0
110
半永久的に提供し続けられるプライベートクラウドを目指して ― 利用者の認知負荷を抑えるAPI抽象化とハードウェア世代交代の基盤設計
Avatar for Tomofumi Kondo tomokon
0
510
GemmaをJevのように使ってみる / Use Gemma like Jev
Avatar for Naoki Kishida kishida
5
800
Railsのためのパスキー実践入門 〜マルチテナントSaaSでの意思決定〜
Avatar for utakaha utakaha
3
830
Herb in Rails 8.2: Your ERB views, now HTML-aware @ Kaigi on Rails 2026, Tokyo, Japan
Avatar for Marco Roth marcoroth
2
300
コーディング自動化の次へ。人の介入をゼロにするファクトリーとサポートAIによる実践
Avatar for Seiji Takahashi timakin
5
4k
設計次第でAIコードの読む量は減らせる / designing-for-code-reading
Avatar for MinoDriven minodriven
35
17k

Featured

See All Featured
Build The Right Thing And Hit Your Dates
Avatar for Maggie C. maggiecrowley
39
3.5k
Claude Code どこまでも/ Claude Code Everywhere
Avatar for nwiizo nwiizo
68
59k
The Illustrated Children's Guide to Kubernetes
Avatar for Chris Short chrisshort
51
53k
Sam Torres - BigQuery for SEOs
Avatar for Tech SEO Connect techseoconnect
PRO
0
580
End of SEO as We Know It (SMX Advanced Version)
Avatar for Michael King ipullrank
3
4.4k
Design and Strategy: How to Deal with People Who Don’t "Get" Design
Avatar for Morgane Peng morganepeng
133
20k
Taking LLMs out of the black box: A practical guide to human-in-the-loop distillation
Avatar for Ines Montani inesmontani
PRO
3
2.5k
The B2B funnel & how to create a winning content strategy
Avatar for Katarina Dahlin katarinadahlin
PRO
1
570
Performance Is Good for Brains [We Love Speed 2024]
Avatar for Tammy Everts tammyeverts
12
1.9k
Statistics for Hackers
Avatar for Jake VanderPlas jakevdp
799
230k
Navigating the moral maze — ethical principles for Al-driven product design
Avatar for Skipper Chong Warson skipperchong
2
630
SEOcharity - Dark patterns in SEO and UX: How to avoid them and build a more ethical web
Avatar for Sara Fernández Carmona sarafernandez
0
300

Transcript

  1. What is Google BigQuery?

  2. +Kazunori Sato @kazunori_279 Kaz Sato Staff Developer Advocate, Tech Lead

    for Data & Analytics, Cloud Platform, Google Inc.

  3. = The Datacenter as a Computer

  4. None

  5. Enterprise

  6. Jupiter network 40GbE ports 10GbE x 100K = 1 Pbps

    CLOS topology Software Defined Network

  7. Borg Launches 2B containers / week Manages 10K machines /

    Cell DC-scale proactive job sched (CPU, mem, disk IO, TCP ports) Paxos-based metadata store

  8. Google BigQuery

  9. 1 B 1 B 100 B 900 M

  10. At Google, MapReduce is classic. We use BigQuery. Confidential &

    Proprietary Google Cloud Platform 10

  11. SELECT your_data FROM billions_of_rows WHERE full_disk_scan_required = true; Scanning 1

    TB in 1 sec with 5,000 - 10,000 disk spindles

  12. BigQuery Analytic Service in the Cloud BigQuery Analyze Export Import

    How to use BigQuery? Google Analytics ETL tools Connectors Google Cloud BI tools and Visualization Google Cloud Spreadsheets, R, Hadoop

  13. Blazingly Fast Capable of scanning 10B rows in ~10 sec

    Low Cost Storage: $0.020 per GB per month Queries: $5 per TB Fully Managed Use thousands of servers with zero-ops SQL Simple and Intuitive SQL with JS UDF Benefits of BigQuery

  14. Thank you