Upgrade to Pro — share decks privately, control downloads, hide ads and more …
Sign up for free

What is Google BigQuery?

Sponsored · Ship Features Fearlessly Turn features on and off without deploys. Used by thousands of Ruby developers. →
Avatar for Kazunori Sato Kazunori Sato
February 04, 2016
Programming
150
0

What is Google BigQuery?

For CROSS 2016 presentation

Avatar for Kazunori Sato

Kazunori Sato

February 04, 2016

More Decks by Kazunori Sato

See All by Kazunori Sato
Tensor Processing Unit (TPU) Overview (July 6, 2018)
Avatar for Kazunori Sato kazunori279
0
360
FPGAによる大規模データ処理の高速化
Avatar for Kazunori Sato kazunori279
0
190
Googleがめざす、誰もが使える機械学習
Avatar for Kazunori Sato kazunori279
4
5.1k
Machine Intelligence at Google Scale
Avatar for Kazunori Sato kazunori279
3
1.5k
Machine Intelligence at Google Scale: Vision/Speech API, TensorFlow and Cloud Machine Learning
Avatar for Kazunori Sato kazunori279
3
5.7k
Distributed TensorFlow
Avatar for Kazunori Sato kazunori279
3
2.6k
Cloud Vision API and TensorFlow
Avatar for Kazunori Sato kazunori279
7
9.6k
Having fun with Google Cloud + RasPi
Avatar for Kazunori Sato kazunori279
0
1.4k
[GCPUG India] Firebase - Build Extraordinary Apps
Avatar for Kazunori Sato kazunori279
2
330

Other Decks in Programming

See All in Programming
GraphRAGのKnowledge Graphを 直接！見る/View-GraphRAG's-KnowledgeGraph-directly!
Avatar for tyumugiko tyumugi1113
1
370
【高い買い物LT会】初任給で話題の国産フィジカルAIを買った話
Avatar for 赤神青空 akagami
PRO
0
170
AIは賢い。でも実行環境は？ CLIおじさんがAI時代に伝えたいこと ~ CLIおじさんがAI時代に伝えたいこと ~
Avatar for curekoshimizu curekoshimizu
1
250
TiDB Cloudのカスタムコントローラーによるオートスケール対応
Avatar for takaidohigasi takaidohigasi
0
130
What We Talk About When We Talk About XP
Avatar for seki at druby.org m_seki
2
670
Everything will be SERVERLESS — 信じて運用した10年の経験値 / Everything Will be Serverless — Lessons Learned from 10 Years of Operational Experience
Avatar for shiro seike seike460
PRO
1
430
LoopHub - ローカルで動く GitHub で、AI と共同開発
Avatar for jugyo jugyo
1
560
一人だけ、Kiroが静止する日
Avatar for Hideyuki Nagata hideg
0
120
iOSDC2026登壇資料.pdf
Avatar for RioFujimon riofujimon
0
180
速習iPhone Duo対応
Avatar for 野瀬田　裕樹 yuukiw00w
1
710
Omarchy Tokyo やると聞いて UMPC 買ってセットアップしてきた
Avatar for Fumiaki MATSUSHIMA mtsmfm
0
150
モデルのリファクタリングが難しいと思ったら、そもそも複雑だったのはビジネス仕様だった ? / is-the-business-domain-the-real-complexity
Avatar for hatsu hatsu38
0
380

Featured

See All Featured
How Software Deployment tools have changed in the past 20 years
Avatar for Geshan Manandhar geshan
1
34k
Product Roadmaps are Hard
Avatar for C. Todd Lombardo iamctodd
55
13k
New Earth Scene 8
Avatar for Sydney Stone popppiees
4
2.6k
How to audit for AI Accessibility on your Front & Back End
Avatar for davetheseo davetheseo
0
550
Primal Persuasion: How to Engage the Brain for Learning That Lasts
Avatar for Mike Taylor tmiket
0
470
The Art of Programming - Codeland 2020
Avatar for Erika Heidi erikaheidi
57
14k
Rails Girls Zürich Keynote
Avatar for Gregor Martynus gr2m
96
14k
Context Engineering - Making Every Token Count
Avatar for Addy Osmani addyosmani
9
1.1k
Everyday Curiosity
Avatar for Cassini Nazir cassininazir
0
320
The Curse of the Amulet
Avatar for Matthew Lei leimatthew05
3
15k
Balancing Empowerment & Direction
Avatar for Lara Hogan lara
6
1.3k
Intergalactic Javascript Robots from Outer Space
Avatar for Vicent Martí tanoku
273
27k

Transcript

  1. What is Google BigQuery?

  2. +Kazunori Sato @kazunori_279 Kaz Sato Staff Developer Advocate, Tech Lead

    for Data & Analytics, Cloud Platform, Google Inc.

  3. = The Datacenter as a Computer

  4. None

  5. Enterprise

  6. Jupiter network 40GbE ports 10GbE x 100K = 1 Pbps

    CLOS topology Software Defined Network

  7. Borg Launches 2B containers / week Manages 10K machines /

    Cell DC-scale proactive job sched (CPU, mem, disk IO, TCP ports) Paxos-based metadata store

  8. Google BigQuery

  9. 1 B 1 B 100 B 900 M

  10. At Google, MapReduce is classic. We use BigQuery. Confidential &

    Proprietary Google Cloud Platform 10

  11. SELECT your_data FROM billions_of_rows WHERE full_disk_scan_required = true; Scanning 1

    TB in 1 sec with 5,000 - 10,000 disk spindles

  12. BigQuery Analytic Service in the Cloud BigQuery Analyze Export Import

    How to use BigQuery? Google Analytics ETL tools Connectors Google Cloud BI tools and Visualization Google Cloud Spreadsheets, R, Hadoop

  13. Blazingly Fast Capable of scanning 10B rows in ~10 sec

    Low Cost Storage: $0.020 per GB per month Queries: $5 per TB Fully Managed Use thousands of servers with zero-ops SQL Simple and Intuitive SQL with JS UDF Benefits of BigQuery

  14. Thank you