Upgrade to Pro — share decks privately, control downloads, hide ads and more …

AWS Meetup Geneva - Prepare for the new Swiss R...

AWS Meetup Geneva - Prepare for the new Swiss Region

AWS Swiss Region is coming in 2022. During the meetup, we described how AWS build the Regions, what services you can leverage to migrate your data and workloads in a Region, and how to leverage infrastructure as code to deploy your workload anywhere.

Jérôme Van Der Linden

April 05, 2022
Tweet

More Decks by Jérôme Van Der Linden

Other Decks in Technology

Transcript

  1. © 2021, Amazon Web Services, Inc. or its Affiliates. Eric

    Bianchi Jérôme Van Der Linden AWS Meetup Migrating to the new Swiss region
  2. © 2021, Amazon Web Services, Inc. or its Affiliates. How

    AWS builds its infrastructure regions
  3. © 2021, Amazon Web Services, Inc. or its Affiliates. Making

    your life easier since 2006 Just choose the services you need and the region where to store your data or run your workloads, without worrying about the infrastructure. Today we want to show you how that “invisible infrastructure” is built.
  4. © 2021, Amazon Web Services, Inc. or its Affiliates. AWS

    is opening a region in Switzerland Will be operating in H2 – 2022 3 Availability Zones (more about this later) 7th European region (Ireland, Frankfurt, London, Paris, Stockholm, Milan) Even lower latency for end users Execute your workloads and store your data in Switzerland Geneva AWS Office Edge Location Zurich AWS Office Location of the upcoming region
  5. © 2021, Amazon Web Services, Inc. or its Affiliates. How

    hard can it be? • Servers (CPU + RAM) • Storage • Networking • A control panel • A building • Some energy
  6. © 2021, Amazon Web Services, Inc. or its Affiliates. Millions

    of Active Customers Customers like you care about security, performance, scalability, choice, global reach, price, reliability... As an example, Amazon S3 —one of our services— now stores over 100 trillion (1014, or 100,000,000,000,000) objects, and regularly peaks at tens of millions of requests per second. 2012 2013 2015 2018 2014 2016 2008 2009 2010 2011
  7. © 2021, Amazon Web Services, Inc. or its Affiliates. How

    hard can it be? Quite actually. • What if someone tries to tamper with our firmware? • How can we enable high availability and ultra low latency? • Is speed of light fast enough? • Can we make cement/concrete production emit less CO2? • How many global component providers do we need to make sure we always have supplies?
  8. © 2021, Amazon Web Services, Inc. or its Affiliates. At

    ~2001 Amazon.com ran on a single Data Center
  9. © 2021, Amazon Web Services, Inc. or its Affiliates. AWS

    Global Infrastructure as of today 25 geographical regions, 81 availability zones, 230+ POPs Region & Number of Availability Zones (AZs) GovCloud (US) Europe US-East (3), US-West (3) Frankfurt (3), Paris (3), Ireland (3), Stockholm (3), US West London (3), Milan (3) Oregon (4) Northern California (3) US East N. Virginia (6), Ohio (3) Middle East Bahrain (3) Canada Asia Pacific Central (3) Singapore (3), Sydney (3), Tokyo (4), Osaka (3) South America São Paulo (3) Seoul (4), Mumbai (3), Hong Kong (3) Africa China Cape Town (3) Beijing (2), Ningxia (3) Announced Regions 8 Regions and 24 AZs in Australia, India, Indonesia, Israel, Australia, Switzerland, Spain, and United Arab Emirates (UAE)
  10. © 2021, Amazon Web Services, Inc. or its Affiliates. AWS

    Region design AWS Regions are comprised of multiple AZs for high availability, high scalability, and high fault tolerance. Applications and data are replicated in real time and consistent in the different AZs. AWS Availability Zone (AZ) A Region is a physical location in the world where we have multiple Availability Zones. Availability Zones consist of one or more discrete data centers, each with redundant power, networking, and connectivity, housed in separate facilities. AZ AZ AZ AZ Transit Transit Datacenter Datacenter Datacenter AWS Region
  11. © 2021, Amazon Web Services, Inc. or its Affiliates. AWS

    Availability Zone (AZ) design • Fully isolated infrastructure with one or more datacenters • Meaningful distance of separation • Unique power infrastructure • Many 100Ks of servers at scale • Datacenters connected via fully redundant and isolated metro fiber
  12. © 2021, Amazon Web Services, Inc. or its Affiliates. AWS

    network design At least 2 redundant transit centers Highly peered & connected Transit center connections Inter-AZ connections Intra-AZ connections
  13. © 2021, Amazon Web Services, Inc. or its Affiliates. Global

    network: Redundant 100GbE network and private capacity between all regions except China Direct Connect: 80+ locations; customers can reach every AWS Region from their local Direct Connect PoP
  14. © 2021, Amazon Web Services, Inc. or its Affiliates. Innovation

    at lower costs 3456 fibers into a single conduit
  15. © 2021, Amazon Web Services, Inc. or its Affiliates. Innovation

    at lower costs 3456 6912 fibers into a single conduit *
  16. © 2021, Amazon Web Services, Inc. or its Affiliates. Traditional

    datacenters tend to standardize their servers
  17. © 2021, Amazon Web Services, Inc. or its Affiliates. At

    scale, many specialized configurations make sense
  18. © 2021, Amazon Web Services, Inc. or its Affiliates. Broad

    and deep platform choice Categories Capabilities Options + + = 475+ instance types
  19. © 2021, Amazon Web Services, Inc. or its Affiliates. Choice

    of processors and architectures Intel Xeon Scalable (Skylake) processor Right compute for each application and workload Choice of GPUs and FPGAs for compute acceleration AWS Graviton processor 64-bit Arm AMD EPYC processor
  20. © 2021, Amazon Web Services, Inc. or its Affiliates. Amazon

    EC2 Mac hardware: Mac mini with the AWS Nitro System
  21. © 2021, Amazon Web Services, Inc. or its Affiliates. Generators,

    UPSs, and Switches How can do we do predictive maintenance, taking the devices offline, while still on a highly available environment?
  22. © 2021, Amazon Web Services, Inc. or its Affiliates. Two

    independent power line-ups We’ve been getting ~99.99997% Availability in our DCs with this design
  23. © 2021, Amazon Web Services, Inc. or its Affiliates. But

    you can always simplify … Battery packs and custom power supplies integrated into the rack
  24. © 2021, Amazon Web Services, Inc. or its Affiliates. Investing

    in wind and solar energy Amazon Web Services (AWS) is committed to running our business in the most environmentally friendly way possible and achieving 100% renewable energy usage for our global infrastructure. Cloud efficiency “Our results show that AWS’s infrastructure is 3.6 times more energy efficient than the median of the surveyed U.S. enterprise data centers. More than two-thirds of this advantage is attributable to the combination of a more energy efficient server population and much higher server utilization. AWS data centers are also more energy efficient than enterprise sites due to comprehensive efficiency programs that touch every facet of the facility. When we factor in the carbon intensity of consumed electricity and renewable energy purchases, which reduce associated carbon emissions, AWS performs the same task with an 88% lower carbon footprint.” Source: 451 Research, 2019, All Rights Reserved.
  25. © 2021, Amazon Web Services, Inc. or its Affiliates. ©

    2021, Amazon Web Services, Inc. or its Affiliates. Do you still believe cloud is just someone’s else computer?
  26. © 2021, Amazon Web Services, Inc. or its Affiliates. AWS

    Services for a multi-region approach
  27. © 2021, Amazon Web Services, Inc. or its Affiliates. Single-region

    high-availability approach Leverage multiple Availability Zones (AZs) Zurich VPC Instances Database Instances Database Instances Database Availability Zone A Availability Zone B Availability Zone C
  28. © 2021, Amazon Web Services, Inc. or its Affiliates. How

    to replicate data and services across region ?
  29. © 2021, Amazon Web Services, Inc. or its Affiliates. Amazon

    S3 Replication at a glance S3 Replication is an elastic, fully managed, low-cost feature that replicates objects between buckets S3 Replication offers flexibility via a rich set of features that allow you to configure where and how you want to replicate Once the replication rule is configured, S3 Replication automatically replicates objects and metadata in the source bucket
  30. © 2021, Amazon Web Services, Inc. or its Affiliates. S3

    Batch Replication • Replicate existing objects • Filtering capabilities • Granular visibility into replication progress
  31. © 2021, Amazon Web Services, Inc. or its Affiliates. Amazon

    Elastic Block Store snapshots • Point-in-time backup • Stored in S3 • Incremental • Cross-region copy EBS volume EBS snapshot
  32. © 2021, Amazon Web Services, Inc. or its Affiliates. Source

    Destination Introducing Amazon EFS Replication You can enable replication on an existing file system and select the replica settings independent of its source READ ONLY A read-only replica is automatically created in the selected Region and changes to your file system are transparently applied to its replica You can use the AWS Console, API, or CLI to enable replication or initiate failover to the replica
  33. © 2021, Amazon Web Services, Inc. or its Affiliates. DynamoDB

    Global Tables Replica (US) Replica (Europe) Replica (Asia)
  34. © 2021, Amazon Web Services, Inc. or its Affiliates. Amazon

    RDS cross-region replication Master Replica Replica Replica Replica
  35. © 2021, Amazon Web Services, Inc. or its Affiliates. Source

    region Application users Internet VPN DMS – Database Migration Process • Start a replication instance • Connect to source and target databases • Select tables, schemas, or databases • Let AWS DMS load data and keep them in sync • Switch applications over to the target after they are in sync at your convenience AWS DMS
  36. © 2021, Amazon Web Services, Inc. or its Affiliates. Copy

    AMIs across Regions AMI (Amazon Machine Image) Distribute image AWS account AWS regions Golden AMI: “Known good” EC2 instance type, OS, packages Create them with Packer or EC2 Image Builder Get Them from running instances
  37. © 2021, Amazon Web Services, Inc. or its Affiliates. EC2

    Image Builder Image Recipe Image Recipe defines image configuration. It consists of source image and one or more components to be applied to the source image. Component describes how to build, validate, and test your image. Build Validate Test Build Component Test Component Source Image Output Image Image Recipe Image Builder Image Or Customer AMI
  38. © 2021, Amazon Web Services, Inc. or its Affiliates. Handling

    Region parity with infrastructure as code
  39. © 2021, Amazon Web Services, Inc. or its Affiliates. Provisionning

    infrastructure in the cloud Manually in the Console ? Amazon EC2 👍 Easy to get started 🤔 Not reproducible 🤔 Error prone 🤔 Time consuming
  40. © 2021, Amazon Web Services, Inc. or its Affiliates. Provisionning

    infrastructure in the cloud Scripting with the AWS CLI or an AWS SDK? 🤔 What happens if an API call fails? 🤔 How do I make updates? 🤔 How do I know a resource is ready? 🤔 How do I roll back? Amazon EC2 Ex with python sdk (boto3) Amazon SQS
  41. © 2021, Amazon Web Services, Inc. or its Affiliates. Provisionning

    infrastructure in the cloud Using infrastructure as “code” AWS CloudFormation template (JSON/YAML) HashiCorp Configuration Language (HCL) Desired state configuration AWS CloudFormation 👍 Easy to automate 👍 Reproducible & consistent 😩 Configuration syntax 🤔 No abstraction, lots of details* Amazon EC2 Amazon SQS * Terraform modules and Cloudformation modules can help reduce the amount of code
  42. © 2021, Amazon Web Services, Inc. or its Affiliates. Key

    principles of infrastructure as code Declarative: define the desired state, not how to achieve it. Idempotent: reapplying the same code should not modify or add resources. Immutable: do not change the infrastructure manually (drift), use IaC to update or create a new one. Reproducible: can be applied in the same way in any region and will produce the same infrastructure with the same resources.
  43. © 2021, Amazon Web Services, Inc. or its Affiliates. Reproducibility

    / Repeatability Amazon EC2 us-east-1 Amazon EC2 us-west-1 Amazon EC2 eu-west-1 Amazon SQS Amazon SQS Amazon SQS
  44. © 2021, Amazon Web Services, Inc. or its Affiliates. Provisionning

    infrastructure in the cloud Using infrastructure as REAL code AWS Cloud Development Kit (CDK) CLI Templates + assets AWS CloudFormation Amazon EC2 Amazon SQS synthesize deploy Declarative?! Imperative Declarative