Upgrade to Pro — share decks privately, control downloads, hide ads and more …

COM402-Building SaaS Platform with AWS Serverle...

Avatar for Lalit Lalit
October 10, 2024

COM402-Building SaaS Platform with AWS Serverless - An Experience Report

AWS Cloud Day Dublin, 2024

Avatar for Lalit

Lalit

October 10, 2024
Tweet

Other Decks in Technology

Transcript

  1. D U B L I N | 1 0 .

    1 0 . 2 0 2 4 Cloud Day Dublin
  2. © 2024, Amazon Web Services, Inc. or its affiliates. All

    rights reserved. Building SaaS Enablement Platform with AWS Serverless – An Experience Report Lalit Kale C O M 4 0 2 Platform Architect Globalization Partners
  3. © 2024, Amazon Web Services, Inc. or its affiliates. All

    rights reserved. AWS SaaS Factory Program Your place for all things SaaS on AWS The AWS SaaS Factory Program helps AWS Partners at any stage of the software-as-a-service (SaaS) journey. https://aws.amazon.com/partners/programs/saas-factory
  4. © 2024, Amazon Web Services, Inc. or its affiliates. All

    rights reserved. $whoami ⚫ Lalit Kale ⚫ Platform Architect ⚫ First AWS Usage: 2006 ⚫ Dell → Verizon → Amdocs → Globalization Partners ⚫ 5 X AWS Community Builder ⚫ AWS SaaS Community Builder
  5. © 2024, Amazon Web Services, Inc. or its affiliates. All

    rights reserved. Agenda • Business Overview • Platform Architecture • Platform Cloud Infrastructure • Platform Continuous Deployment • Takeaways
  6. © 2024, Amazon Web Services, Inc. or its affiliates. All

    rights reserved. Business Overview Telecom and Media Enterprise ~10B > 60 Products SaaS as a side offer GreenField SaaSify All Products Java, K8s, No previous SaaS Experience, Jr. Eng > Sr. Eng 4 Teams Israel, Ireland, India, USA, Canada
  7. © 2024, Amazon Web Services, Inc. or its affiliates. All

    rights reserved. source: https://www.amdocs.com/sites/default/files/2023-02/amdocs-service-offering-review-2022.pdf
  8. © 2024, Amazon Web Services, Inc. or its affiliates. All

    rights reserved. Business Overview – User Journey Register Select from Product Catalog Custom parameters e.g. geo-region, Deployment size Bill payment Receive Deployment Email Visit Platform ISV Console Define Users Roles Define Users Roles Access Products via Console
  9. © 2024, Amazon Web Services, Inc. or its affiliates. All

    rights reserved. Outcome - Growth focus for transformation Procurement to Product Use– 12 Months → 48 Hours Increased Conversations – Customers can try and then buy → Free Trials Operational Efficiency – Streamline Sales Channel 5G Market Readiness New Customer Segment – Tier 2,3 + MNVO Telco Providers New Markets– Ability to reach New Geos and New Logos 0 Deals →4 Deals/Qtr ($500k)
  10. © 2024, Amazon Web Services, Inc. or its affiliates. All

    rights reserved. Platform Architecture
  11. © 2024, Amazon Web Services, Inc. or its affiliates. All

    rights reserved. Product A Product A Product A Tenant A Product A Tenant 1-A Tenant 2-A Tenant 3-A customer1 customer2 customer3 Product C Product B Tenant A Product A Tenant 1-A Tenant 2-B Tenant 3-C customer1 customer2 customer3 Tenant 4-A+C customer4 Platform’s Unconventional Challenge Typical SaaS Player Product Portfolio SaaS Player
  12. © 2024, Amazon Web Services, Inc. or its affiliates. All

    rights reserved. Product Onboarding Identity Monitoring, Metrics and analytics Billing and metering Management and monitoring DevOps and provisioning Routing Shared Characteristics of SaaS Product Disaster Recovery Product Delivery and Upgrades Product Configurations Product Integrations
  13. © 2024, Amazon Web Services, Inc. or its affiliates. All

    rights reserved. Tenant 1 Silo Microservice WebApp Microservice Tenant 2 Microservice WebApp Microservice Bridge Tenant 1 Microservice WebApp Tenant 2 Microservice Pool Microservice WebApp Microservice Microservice Microservice Tenant isolation Patterns
  14. © 2024, Amazon Web Services, Inc. or its affiliates. All

    rights reserved. AWS SaaS Factory Guidance
  15. © 2024, Amazon Web Services, Inc. or its affiliates. All

    rights reserved. Platform Architecture – Conceptual View Admin Console CLI API User Mgt (Platform + Product + Customer) Product Catalog ISV mgt Tenant Mgt Provisioning engine Provisioning engine Account Mgt (Infra+ Networking) Identity (Platform + Product + Customer) Monitoring & Observability Backups Compliance FinOps Tenant ISV Management Product Deployment and Upgrades SaaS Onboarding Product User Platform User Billing Tenant Agent
  16. © 2024, Amazon Web Services, Inc. or its affiliates. All

    rights reserved. Initial Key Decisions • ISV – aka business unit • Product – Product/Solution • Customer – End-Customer – Telco Provider • Platform Geo-Region – US, EU, APAC • Environment – Dev,Test, Prod Tenancy Dimensions • AWS Account • VPC • Subnets • Logical Tenancy in DB Tenant Isolation Levels • AWS EC2 based • Serverless • EKS Based • AWS Single Region • Multi-tenant Product Product Architectures Supported • Multi-Region • Cross Cloud Product Not Supported
  17. © 2024, Amazon Web Services, Inc. or its affiliates. All

    rights reserved. • AWS DynamoDB and S3: Cross Region Replication • Disaster Recovery • Less Operations and Toil • Focus on Customer Value and Delivering Capabilities • Team Composition and Expertise Why Serverless?
  18. © 2024, Amazon Web Services, Inc. or its affiliates. All

    rights reserved. Platform Service Anatomy AWS Cloud AWS Cloud AWS Cloud • Programming Languages: • Typescript + Node • Python • IaC: Terraform → OpenTofu • DataStores: Amazon DynamoDB • AWS – For All Heavy Lifting • AuthN/AuthZ: Cognito → Auth0 • Github ES → Github Cloud
  19. © 2024, Amazon Web Services, Inc. or its affiliates. All

    rights reserved. Platform Architecture – Conceptual View Admin Console CLI API User Mgt (Platform + Customer) Product Catalog ISV mgt Tenant Mgt Provisioning engine Provisioning engine Account Mgt (Infra+ Networking) Identity (Platform + Customer) Monitoring & Observability Backups Compliance FinOps Tenant ISV Management Product Deployment and Upgrades SaaS Onboarding Product User Platform User Billing Tenant Agent
  20. © 2024, Amazon Web Services, Inc. or its affiliates. All

    rights reserved. Platform Cloud Infrastructure Landscape
  21. © 2024, Amazon Web Services, Inc. or its affiliates. All

    rights reserved. Platform Landing Zone Management Account Network OU Dev Network Account Prod Network Account Security OU Log Achieve Account Audit Account Dev OU Control Plane Dev Account Test OU Test Account Prod OU Tenant UAT Tenant LIVE
  22. © 2024, Amazon Web Services, Inc. or its affiliates. All

    rights reserved. Platform Infrastructure Key Decisions • Region Selection – NO US-East-1 Failures • Hub and Spoke Architecture • Networking – Single Ingress-Single Egress • Availability via Redundancy • Account Pool – 50 Accounts • Security is job zero –Design Validation with Infosec and AWS SAs
  23. © 2024, Amazon Web Services, Inc. or its affiliates. All

    rights reserved. Infosec • Overworked and Understaffed • Age-old security practices • Not significantly aware of Cloud Security Practices • Roadblocks Instead of Guardrails • IT Security and Compliance Intermingle • Security Theater
  24. © 2024, Amazon Web Services, Inc. or its affiliates. All

    rights reserved. Architecture Product Mgt Collaboration - Shared Responsibility Models Platform Team Responsibility For Security ’OF’ the Platform AWS Responsibility For Security ’OF’ the Cloud software Compute Storage Database Networking Hardware/Global Infrastructure Platform AWS Infrastructure Platform Data Platform Security Platform Availability Networking Backbone Platform Control Plane API and Services Product Team Responsibility For Security ’OF’ the PRODUCT Product AWS Account Resources End-Customer Data Platform App Security Product Access Management Platform Team Responsibility For Security ’OF’ the Platform Platform AWS Infrastructure Platform Data Platform Security Platform Availability Networking Backbone Platform Control Plane API and Services
  25. © 2024, Amazon Web Services, Inc. or its affiliates. All

    rights reserved. Platform Continuous Deployment Story
  26. © 2024, Amazon Web Services, Inc. or its affiliates. All

    rights reserved. Once upon a time… • New Organization • People Churn + Contractors • No Customer • Lack of Better Engineering Practices • Telco – Traditional Development Culture • SaFe - Not So Agile • Lack of Technical Product Management Expertise
  27. © 2024, Amazon Web Services, Inc. or its affiliates. All

    rights reserved. Production Deployments A C C E L E R AT E : T H E S C I E N C E O F L E A N S O F T W A R E A N D D E V O P S : B U I L D I N G A N D S C A L I N G H I G H P E R F O R M I N G T E C H N O L O G Y O R G A N I Z AT I O N S Change Advisory boards are useless. Industry doesn’t matter Integration times and branch lifetimes lasting hours are better than days
  28. © 2024, Amazon Web Services, Inc. or its affiliates. All

    rights reserved. After 5 Months of branch Merge 2 9 china.org.cn
  29. © 2024, Amazon Web Services, Inc. or its affiliates. All

    rights reserved. Inverse Conway Maneuver • Two Pizza Teams focused on Business Capability • You Build it, You Run it! • Microservices
  30. © 2024, Amazon Web Services, Inc. or its affiliates. All

    rights reserved. If it hurts do it more!
  31. © 2024, Amazon Web Services, Inc. or its affiliates. All

    rights reserved. Deployment Improvement F R O M M O R E T H A N 6 M O N T H S → E V E R Y W E E K Teams taking Ownership Collaboration Improvement Inner sourcing Utilization of Modules Push to production Every week 5 Days -> 30 minutes
  32. © 2024, Amazon Web Services, Inc. or its affiliates. All

    rights reserved. Platform Disaster Recovery
  33. © 2024, Amazon Web Services, Inc. or its affiliates. All

    rights reserved. Disaster Recovery Strategies
  34. © 2024, Amazon Web Services, Inc. or its affiliates. All

    rights reserved. AWS Backup Service
  35. © 2024, Amazon Web Services, Inc. or its affiliates. All

    rights reserved. Backup Challenges AWS Cognito Product Data Customer Data CICD – Github Enterprise Server Github Cloud Solution Platform Shared Responsibility Model
  36. © 2024, Amazon Web Services, Inc. or its affiliates. All

    rights reserved. DR Firedrill / Mockdrill Pre-requisite – Monitoring and Observability of System Conduct DR exercise as if there is real disaster happened Wheel of Misfortune – (Failure Hypothesis) Backups are good but Restore!! Restore!! Restore!!
  37. © 2024, Amazon Web Services, Inc. or its affiliates. All

    rights reserved. DR Firedrill / Mockdrill Complexities Involved - • CICD Pipelines Flaws • Auth0 Restoring Users and Permissions • Sequence of Activities • Team’s Measuring RTO and RPO (No cheating! No Beating!!) • Share the Trends as wins with Management • Runbooks • Transitioning runbooks to L1 Support
  38. © 2024, Amazon Web Services, Inc. or its affiliates. All

    rights reserved. Outcome - Growth focus for transformation Procurement to Product Use– 12 Months → 48 Hours Increased Conversations – Customers can try and then buy → Free Trials Operational Efficiency – Streamline Sales Channel 5G Market Readiness New Markets– Ability to reach New Geos and New Logos 0 Deals →4 Deals/Qtr ($500k)
  39. © 2024, Amazon Web Services, Inc. or its affiliates. All

    rights reserved. Takeaways SaaS is a business strategy Serverless makes Control Plane easier SaaS is a team sport Think Value Streams and Capabilities Instead of Features Platforms can’t solve culture Start Imperfect and follow Continuous Improvements Build Tenant Oriented Observability and Operations
  40. © 2024, Amazon Web Services, Inc. or its affiliates. All

    rights reserved. The road to success is not a straight line
  41. Thank you! © 2024, Amazon Web Services, Inc. or its

    affiliates. All rights reserved. Lalit Kale [email protected] @atechiethought in/lalitkale/
  42. ! Please complete the session survey © 2024, Amazon Web

    Services, Inc. or its affiliates. All rights reserved.
  43. © 2024, Amazon Web Services, Inc. or its affiliates. All

    rights reserved. Lalit Kale https://www.linkedin.com/in/lalitkale/