Upgrade to Pro — share decks privately, control downloads, hide ads and more …

What is Google BigQuery?

Sponsored · Your Podcast. Everywhere. Effortlessly. Share. Educate. Inspire. Entertain. You do you. We'll handle the rest. →
Avatar for Kazunori Sato Kazunori Sato
February 04, 2016
Programming
0
110

What is Google BigQuery?

For CROSS 2016 presentation

Avatar for Kazunori Sato

Kazunori Sato

February 04, 2016
Tweet

More Decks by Kazunori Sato

See All by Kazunori Sato
Tensor Processing Unit (TPU) Overview (July 6, 2018)
Avatar for Kazunori Sato kazunori279
0
300
FPGAによる大規模データ処理の高速化
Avatar for Kazunori Sato kazunori279
0
140
Googleがめざす、誰もが使える機械学習
Avatar for Kazunori Sato kazunori279
4
5k
Machine Intelligence at Google Scale
Avatar for Kazunori Sato kazunori279
3
1.4k
Machine Intelligence at Google Scale: Vision/Speech API, TensorFlow and Cloud Machine Learning
Avatar for Kazunori Sato kazunori279
3
5.6k
Distributed TensorFlow
Avatar for Kazunori Sato kazunori279
3
2.5k
Cloud Vision API and TensorFlow
Avatar for Kazunori Sato kazunori279
7
9.4k
Having fun with Google Cloud + RasPi
Avatar for Kazunori Sato kazunori279
0
1.3k
[GCPUG India] Firebase - Build Extraordinary Apps
Avatar for Kazunori Sato kazunori279
2
300

Other Decks in Programming

See All in Programming
「やめとこ」がなくなった — 1月にZennを始めて22本書いた AI共創開発のリアル
Avatar for atani atani14
0
390
go directiveを最新にしすぎないで欲しい話──あるいは、Go 1.26からgo mod initで作られるgo directiveの値が変わる話 / Go 1.26 リリースパーティ
Avatar for Arthur arthur1
2
550
モダンOBSプラグイン開発
Avatar for Kaito Udagawa umireon
0
130
AI時代のシステム設計：ドメインモデルで変更しやすさを守る設計戦略
Avatar for 増田 亨 masuda220
PRO
5
1k
CDIの誤解しがちな仕様とその対処TIPS
Avatar for futokiyo futokiyo
0
220
ベクトル検索のフィルタを用いた機械学習モデルとの統合 / python-meetup-fukuoka-06-vector-attr
Avatar for monochromegane monochromegane
2
440
野球解説AI Agentを開発してみた - 2026/02/27 LayerX社内LT会資料
Avatar for Shinichi Nakagawa shinyorke
PRO
0
310
Everything Claude Code OSS詳細 — 5層構造の中身と導入方法
Avatar for techs-targe targe
0
110
Ruby and LLM Ecosystem 2nd
Avatar for Koichi ITO koic
1
820
PostgreSQL を使った快適な go test 環境を求めて
Avatar for Kotaro Otaka otakakot
0
550
AHC061解説
Avatar for Shun_PI shun_pi
0
380
モジュラモノリスにおける境界をGoのinternalパッケージで守る
Avatar for magavel magavel
0
3.5k

Featured

See All Featured
What does AI have to do with Human Rights?
Avatar for Per Axbom axbom
PRO
1
2k
Public Speaking Without Barfing On Your Shoes - THAT 2023
Avatar for David Neal reverentgeek
1
340
Visualization
Avatar for Eitan Lees eitanlees
150
17k
Agile Leadership in an Agile Organization
Avatar for Dr. Kim W Petersen kimpetersen
PRO
0
110
Leadership Guide Workshop - DevTernity 2021
Avatar for David Neal reverentgeek
1
240
Docker and Python
Avatar for Tania Allard trallard
47
3.8k
Mobile First: as difficult as doing things right
Avatar for Swwweet swwweet
225
10k
The World Runs on Bad Software
Avatar for Brandon Keepers bkeepers
PRO
72
12k
StorybookのUI Testing Handbookを読んだ
Avatar for Shingo Yamazaki zakiyama
31
6.6k
Building Experiences: Design Systems, User Experience, and Full Site Editing
Avatar for Michelle Schulp Hunt marktimemedia
0
440
Bridging the Design Gap: How Collaborative Modelling removes blockers to flow between stakeholders and teams @FastFlow conf
Avatar for Kenny Baas-Schwegler baasie
0
480
Rails Girls Zürich Keynote
Avatar for Gregor Martynus gr2m
96
14k

Transcript

  1. What is Google BigQuery?

  2. +Kazunori Sato @kazunori_279 Kaz Sato Staff Developer Advocate, Tech Lead

    for Data & Analytics, Cloud Platform, Google Inc.

  3. = The Datacenter as a Computer

  4. None

  5. Enterprise

  6. Jupiter network 40GbE ports 10GbE x 100K = 1 Pbps

    CLOS topology Software Defined Network

  7. Borg Launches 2B containers / week Manages 10K machines /

    Cell DC-scale proactive job sched (CPU, mem, disk IO, TCP ports) Paxos-based metadata store

  8. Google BigQuery

  9. 1 B 1 B 100 B 900 M

  10. At Google, MapReduce is classic. We use BigQuery. Confidential &

    Proprietary Google Cloud Platform 10

  11. SELECT your_data FROM billions_of_rows WHERE full_disk_scan_required = true; Scanning 1

    TB in 1 sec with 5,000 - 10,000 disk spindles

  12. BigQuery Analytic Service in the Cloud BigQuery Analyze Export Import

    How to use BigQuery? Google Analytics ETL tools Connectors Google Cloud BI tools and Visualization Google Cloud Spreadsheets, R, Hadoop

  13. Blazingly Fast Capable of scanning 10B rows in ~10 sec

    Low Cost Storage: $0.020 per GB per month Queries: $5 per TB Fully Managed Use thousands of servers with zero-ops SQL Simple and Intuitive SQL with JS UDF Benefits of BigQuery

  14. Thank you