Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Design factors for decentralised edge applications

Design factors for decentralised edge applications

Andrew Betts

October 09, 2020
Tweet

More Decks by Andrew Betts

Other Decks in Programming

Transcript

  1. 1

  2. 3

  3. 5 Traditional stack + virtualisation Hardware Host OS Server process

    Code Hypervisor / container engine Guest OS Server process Code Guest OS
  4. 6 Moving to IAAS Hardware Host OS Server process Code

    Hypervisor / container engine Guest OS Server process Code Guest OS Cloud platform Infrastructure as a service
  5. 7 Moving to PAAS Hardware Host OS Server process Code

    Hypervisor / container engine Guest OS Server process Code Guest OS Cloud platform Platform as a service
  6. 8

  7. 9 12 factors Adam Wiggins' twelve principles of application design

    1. One codebase 2. Explicit dependencies 3. Store config in the environment 4. Other services as attached resources 5. Separate build and run stages 6. Stateless processes 7. Export services via port binding 8. Run processes concurrently 9. Allow for disposability 10. Maintain dev/prod parity 11. Treat logs as event streams 12. Run admin tasks as one-off processes
  8. 10 12 factors Adam Wiggins' twelve principles of application design

    1. One codebase 2. Explicit dependencies 3. Store config in the environment 4. Other services as attached resources 5. Separate build and run stages 6. Stateless processes 7. Export services via port binding 8. Run processes concurrently 9. Allow for disposability 10. Maintain dev/prod parity 11. Treat logs as event streams 12. Run admin tasks as one-off processes
  9. 11

  10. 12 Moving to PAAS Hardware Host OS Server process Code

    Hypervisor / container engine Guest OS Server process Code Guest OS Cloud platform Platform as a service
  11. 13 Moving to serverless / FAAS Hardware Host OS Server

    process Code Hypervisor / container engine Guest OS Server process Code Guest OS Cloud platform Functions as a service
  12. 14 Constraints of serverless / FAAS • Restricted memory per-invocation

    • Restricted CPU per-invocation • Restricted runtime per-invocation • No shared state between invocations • (Often) no access to filesystem
  13. 15 Benefits of serverless / FAAS • No idling costs

    • Looser coupling between components • Just code to manage • Easier to iterate
  14. 16

  15. 18 Hardware Host OS Server process Code Hypervisor / container

    engine Guest OS Server process Code Guest OS
  16. 19 Hardware Host OS Server process Code Hypervisor / container

    engine Guest OS Server process Code Guest OS Cloud platform
  17. 21 Server process Code Guest OS Cloud platform Server process

    Code Guest OS Edge platform Server process Code Guest OS 5G platform Server process Code Guest OS Browser (JS, Service Worker, WebAssembly)
  18. 22 Server process Code Guest OS Cloud platform Server process

    Code Guest OS Edge platform Server process Code Guest OS 5G platform Server process Code Guest OS Browser (JS, Service Worker, WebAssembly) Core Edge ISP User 1 instance 100s of instances 10,000s of instances Millions of instances 500ms away 20ms away 3ms away Local
  19. 23

  20. 24 Code Lightweight process Lightweight memory Small source code Input

    From client Conclusion: This should be a client-side process. Markdown example properties Where should this code be run? Output To client
  21. 25 CMS template rendering How about this? Conclusion: This should

    be an edge process. Code Lightweight process Lightweight memory Large source code Shared local state Input From client Output To client CMS Dependency API call to CMS
  22. 26 Use cases for compute at the edge It's easy

    to move existing bits of our applications to edge platforms • Personalisation, localisation, authentication, authorisation – Personalised app shell – Template rendering • Beacon termination – RUM? Analytics? IoT telemetry? • Facades – Transforms & migrations – API gateways • Event-driven cache invalidation
  23. 27

  24. 28 Accept writes at the edge Figure it out later.

    Code at the edge Accepts the write and persists to a local state representation. Input From client Output To client Edge platform reconciles asynchronously with datastores in other locations. Datastore Datastore Datastore Datastore Datastore More on state at the edge Go read my colleague and mega-brain Peter Bourgon on how we are building this at Fastly: fastly.com/blog/state-at-the-edge
  25. 29 Accept writes at the edge Data collection edition Code

    at the edge Accepts the write and persists to a local state representation. Input From client Output To client Collect data in multiple instances within core infrastructure and cross check. Aggregator Aggregator
  26. 30 Let's manage everything ourselves! In one place! The world

    is big, maybe we should cache stuff in replicas at the edge! By embracing serverless, we can do actual processing at the edge! Maybe we can do everything at the edge!
  27. 33 LHR Count: 5 A global rate limiter? CDG Count:

    2 Requests 1-5 spread across 2 POPs do not trigger any thresholds and are counted locally CHI Count: 0 TYO Count: 0 The 4th request to arrive at LHR triggers this edge location to claim global control of counting for this IP Subsequent requests to any POP within the time window will forward the request to the counting location for this IP. ➊ ➋ ➌ If you need blocks to apply globally at the same moment
  28. 34 Chat relay End user submits a message with a

    destination user identified. Edge platform resolves the location of the destination user and forwards the request. Message streamed to the recipient ➊ ➋ ➌ Multiple users connected to different edge locations
  29. 35 12 factors Adam Wiggins' twelve principles of application design

    1. One codebase 2. Explicit dependencies 3. Store config in the environment 4. Other services as attached resources 5. Separate build and run stages 6. Stateless processes 7. Export services via port binding 8. Run processes concurrently 9. Allow for disposability 10. Maintain dev/prod parity 11. Treat logs as event streams 12. Run admin tasks as one-off processes
  30. 36 Edge app design factors Inherited from Heroku's 12 factors

    1. Stateless processes 2. Run processes concurrently 3. Allow for disposability 4. Other services as attached resources 5. Separate build and run stages
  31. 37 Edge app design factors Remote state An edge application

    assumes that persistent state is controlled remotely, but cached locally. It updates local representations of remote state, and makes use of mechanisms in the platform that reconcile updates to that state asynchronously.
  32. 38 Edge app design factors No single view An edge

    application does not need to have a complete and up to date understanding of the world, in order to operate correctly.
  33. 39 Edge app design factors The complete list 1. Stateless

    processes 2. Run processes concurrently 3. Allow for disposability 4. Other services as attached resources 5. Separate build and run stages 6. Remote state 7. No single view