Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Navigating Google Cloud Platform

Navigating Google Cloud Platform

An introduction for all of GCP at I/O

Terrence Ryan

August 02, 2017
Tweet

More Decks by Terrence Ryan

Other Decks in Technology

Transcript

  1. @tpryan • Computing • Networking • Storage • Big data

    • Administration • Development • Machine learning Agenda
  2. @tpryan Virtual Machines • 1 - 64 processors • .6

    - 416 GB (.9 - 6.5 GB per proc) • Disk limits ­ 65 TB Persistent ­ 3 TB SSD ­ 208 RAM • Preconfigured images • Can build your own • Spin up in 10s of seconds Compute Engine
  3. @tpryan Frontend 10.0.0.1 Public 130.91.x.x1 API 10.0.0.2 Public 130.91.x.x2 Data

    10.0.0.3 Kubernetes • Container Orchestration System • Allows for running a large number of containers in production • Organizing them into workloads ­ Microservices Scheduled jobs Batch jobs
  4. @tpryan • Managed Kubernetes (Containers as a service) • Smart

    defaults for ­ Monitoring ­ Logging ­ DNS ­ Service Discovery • Auto scaling Container Engine • Custom Runtime ­ Bring your own Dockerfile • Autoscaling • Given one endpoint per service App Engine flexible environment
  5. @tpryan • Container image storage • Works with Container Engine

    App Engine flexible Docker Container Registry • Container building as service • Integrates with Container Registry • Integrated with build processes Container Builder
  6. @tpryan • Languages ­ Java 8 / Servlet 3.1 /

    ­ Jetty 9 ­ Python 2.7 & 3.5 ­ Node.js ­ Ruby ­ PHP ­ Go ­ Open capabilities App Engine flexible runtime • Languages ­ Python 2.7 ­ Java 7 ­ PHP 5.5 ­ Go • Constrained capabilities • Incredibly rapid scale App Engine standard runtime • Javascript / Node.js • Respond to events Cloud functions
  7. @tpryan • Create custom private cloud networks • Set up

    custom routes to your other non-Google locations Cloud Virtual Network • Create a dedicated connection to Google • Direct Peer to one of our local or regional Points of Presence Cloud Interconnect
  8. @tpryan • Gateway to Gateway Only • Can be used

    to connect to any IPSEC compliant gateway VPN • Set up rules • Apply rules to tags • Apply tags to hosts Firewall
  9. @tpryan • Activate through our load balancers • Uses HTTP

    headers to determine cacheability CDN • Manage DNS on Google’s network • SLA promises 100% availability of our Authoritative Name Servers DNS • HTTP • SSL • Internal • Network Load Balancers
  10. @tpryan • Build by hand Compute Engine • Prebuilt solutions

    for: ­ Barracuda ­ Brocade ­ Cloudflare ­ more... Cloud Launcher
  11. @tpryan File Storage • One set of interfaces • Several

    types ­ Multi-regional ­ Regional ­ Nearline ­ Coldline Cloud Storage
  12. @tpryan Public Processed Long Term Storage Characteristics 99.95% availability Geo-redundant

    99.9% availability Data stored in a narrow geographic region 99.0% availability 30-day minimum storage duration 99.0% availability 90-day minimum storage duration Uses Cases Frequently accessed World Audience Website content Streaming video Gaming Mobile Accessed by your system But not by your customers Big Data sets for processing Backup Long tail multimedia Disaster recovery Compliance archives Storage Cost GB/month $.026 $.02 $.01 $.007 Retrieval Cost GB $.01 $.05 Storage Type Multi-region Regional Nearline Coldline
  13. @tpryan • Traditional SQL Server • Vertically scalable • Managed

    backups • Easy to setup replicas • Types ­ MySQL ­ Postgres Cloud SQL • Structured data • Highly available • Strongly consistent • CAP theorem says impossible • Globally distributed • Horizontally scalable Cloud Spanner
  14. @tpryan • Document based • Indexable • Giant Cloud Datastore

    • Columnar • Low latency • Hbase API compatible • Needs scale to be cost effective Cloud Bigtable
  15. @tpryan Big Data • Pipe in semi-structured data • Analyze

    it quickly • Use SQL to do it. BigQuery
  16. @tpryan • Messaging Bus • Many to many Pub/Sub •

    Managed service for data analysis • Apache Beam Dataflow • Managed Spark and Hadoop • With Autoscaling DataProc
  17. @tpryan Cloud Datastore Cloud SQL Cloud Spanner Cloud Bigtable BigQuery

    Translation API Natural Language API Speech API Vision API Cloud Dataflow Compute Engine App Engine Container Engine Cloud Functions Cloud Pub/Sub Cloud Storage
  18. @tpryan • Build by hand Compute Engine • Prebuilt solutions

    for: ­ Cassandra Redis Mongo CouchDB more... Cloud Launcher
  19. @tpryan • Cross Cloud Logging ­ GCP AWS On Prem

    possible Stackdriver Logging • Cross Cloud Monitoring ­ GCP ­ AWS • Alerts based off ­ Logs ­ Uptime checks ­ Built in or Custom Metrics Stackdriver Monitoring
  20. @tpryan Security • Allow for group of resources • Role

    based permissions • Fine grained controls • Vary from product to product Cloud IAM
  21. @tpryan • Gcloud • gsutil CLI • SDK for most

    languages • REST endpoints • Functional equivalent to gcloud API • Repeatable Complex deployments • Configs • Templates • Disk Images • Network setup • more Deployment Manager
  22. @tpryan • Gcloud • gsutil SDK • IntelliJ • Android

    Studio • Powershell • Visual Studio • Eclipse Plugins • Cloud Source Repository Others
  23. @tpryan Reporting • Automatic ­ App Engine ­ Load Balancers

    • Enabled through an SDK ­ Java ­ Node.js ­ Go ­ Ruby ­ Zipkin • Links to logs Stackdriver Trace
  24. @tpryan Debugging • App Engine Java Python Node.js Ruby •

    Compute Engine Java Python Go Stackdriver Debugging
  25. @tpryan Natural Language API • Syntax Analysis • Entity Recognition

    • Sentiment Analysis • Multi-Language Speech API • Automatic Speech Recognition • Streaming • 80 languages Translation API • Language Detection • Translation • Whole document Vision API • Face Detection • Label Detection • Logo Detection • OCR Machine Learning
  26. @tpryan Machine Learning • Open Source ML Library • Builds

    models • Allows you to compute with variable levels of CPU/GPU power Tensor Flow