Cloud Agnostic Design Patterns and Tips (for Serverless and Java)

You've probably seen how to create a Function-as-a-Service with one of the cloud providers, but if this is all you know about Serverless, prepare to have your mind blown! In this session we'll show you how to create a production-grade, cloud-agnostic, event-driven serverless solution with Quarkus, a Java stack optimized for fast startup and small footprint; and Knative, an open source community project for deploying, running and managing serverless applications on Kubernetes. Say goodbye to vendor lock-in and hello to Supersonic Subatomic Java-based Serverless bliss!

Transcript

1. @kevindubois Cloud Agnostic Design Patterns and Tips (for Serverless and Java) Kevin Dubois, Principal Developer Advocate, Red Hat
2. @kevindubois The Cloud
3. @kevindubois Kevin Dubois ★ Principal Developer Advocate at Red Hat ★ Java Champion ★ Based in Belgium 󰎐 ★ Speak English, Dutch, French, Italian 🤌 ★ Open Source Contributor (Quarkus, Camel, Knative, ..) ★ Community Member (BeJUG, BeCNCF) @kevindubois@mastodon.social youtube.com/@thekevindubois linkedin.com/in/kevindubois github.com/kdubois @kevindubois.com
4. @kevindubois Cloud Computing: Respond more quickly to demand No provisioning/managing of hardware High availability, Disaster Recovery, Resilience Grow your application in a manageable way Use only the resources you need ! €€ …
5. @kevindubois CI/CD GitOps Networking Container Registry (Some) Components of an Application Platform Developer Tools Monitoring Logging
6. @kevindubois
7. @kevindubois
8. @kevindubois
9. @kevindubois
10. @kevindubois But…
11. @kevindubois • Regulatory changes • Outages • Price changes, contract renegotiations • Other vendor offers better/newer services • New CIO/CTO • Shadow IT • … What if …
12. @kevindubois
13. @kevindubois So … ?
14. @kevindubois Hybrid / Multi Cloud!?
15. @kevindubois
16. @kevindubois
17. @kevindubois Open Source & CNCF ecosystem FTW!
18. @kevindubois What about Serverless?
19. @kevindubois Serverless “Serverless computing refers to the concept of building and running applications that do not require server management. It describes a finer-grained deployment model where applications, bundled as one or more functions are uploaded to a platform and then executed, scaled, and billed in response to the exact demand needed at the moment” -- CNCF Definition, https://www.cncf.io/blog/2018/02/14/cncf-takes-first-step-towards-serverless-computing/
20. @kevindubois OpenShift Sandbox: We changed the default deployment type to Serverless
21. @kevindubois Serverless Over provisioning Time in capacity planning IT cost of idle resources Under provisioning Lost business revenue Poor quality of service More applications Use & pay only for the resources you need NOT Serverless with Serverless
22. @kevindubois AWS Lambda, Functions... Built around the FaaS components and other services such as API Gateways. It enabled a variety of use cases but it is far from ideal for general computing and with room for improvements. 1.0 ➔ HTTP and other few Sources ➔ Functions only ➔ Limited execution time (5 min) ➔ No orchestration ➔ Limited local development experience FaaS
23. @kevindubois
24. @kevindubois
25. @kevindubois
26. @kevindubois Writing cloud agnostic functions with Java
27. @kevindubois github.com/serverless-java-in-action/examples
28. @kevindubois AWS Lambda, Functions... Built around the FaaS components and other services such as API Gateways. It enabled a variety of use cases but it is far from ideal for general computing and with room for improvements. 1.0 ➔ HTTP and other few Sources ➔ Functions only ➔ Limited execution time (5 min) ➔ No orchestration ➔ Limited local development experience Serverless Containers With the advent of containers & Kubernetes, many frameworks and solutions started to auto-scale containers. Cloud providers created offerings using managed services completely abstracting Kubernetes APIs. 1.5 ➔ Fargate, Cloud Run, Container Instances ➔ Knative, KEDA, etc ➔ Kubernetes based auto-scaling ➔ Microservices and Functions ➔ Easier to debug & test locally ➔ Polyglot & Portable Serverless is evolving...
29. @kevindubois
30. @kevindubois Knative https://github.com/knative
31. @kevindubois Immutable revisions Deploy new features: performing canary, A/B or blue-green testing with gradual traffic rollout with no sweat and following best practices. Any programming language Use any programming language or runtime of choice. From Java, Python, Go and JavaScript to Quarkus, SpringBoot or Node.js. No need to configure number of replicas, or idling. Scale to zero when not in use, auto scale to thousands during peak, with built-in reliability and fault-tolerance. Automatic scaling Simplified developer experience to deploy applications/code on serverless containers abstracting infrastructure & focusing on what matters. Containers made easy Ready for the Hybrid Cloud Truly portable serverless running anywhere Kubernetes runs, that is on-premises or on any public cloud. Leverage data locality and SaaS when needed. prem aws azur e Event Driven Architectures Build loosely coupled & distributed apps connecting with a variety of built-in or third-party event sources or connectors powered by Operators. Knative is an Open Source, Cloud Agnostic Solution to build Serverless and Event Driven Applications on Kubernetes Knative
32. @kevindubois $ kn func create -l quarkus myfunc $ kn func deploy $ kn service create myservice --image=xyz github.com/serverless-java-in-action/examples
33. @kevindubois AWS Lambda, Functions... Built around the FaaS components and other services such as API Gateways. It enabled a variety of use cases but it is far from ideal for general computing and with room for improvements. 1.0 ➔ HTTP and other few Sources ➔ Functions only ➔ Limited execution time (5 min) ➔ No orchestration ➔ Limited local development experience Serverless Containers With the advent of containers & Kubernetes, many frameworks and solutions started to auto-scale containers. Cloud providers created offerings using managed services completely abstracting Kubernetes APIs. 1.5 ➔ Fargate, Cloud Run, Container Instances ➔ Knative, KEDA, etc ➔ Kubernetes based auto-scaling ➔ Microservices and Functions ➔ Easier to debug & test locally ➔ Polyglot & Portable Integration & State The maturity and benefits of Serverless are recognized industry wide and it adds the missing parts to make pattern suitable for general purpose workloads and used on the enterprise. 2.0 ➔ Basic state handling ➔ Enterprise Integration Patterns ➔ Advanced Messaging Capabilities ➔ Blended with your PaaS ➔ Enterprise-ready event sources ➔ Solutions and outcome focused
34. @kevindubois
35. @kevindubois Knative Eventing Eventing is a set of APIs for routing events from Producers to Consumers (known as Sinks) CloudEvent specification allows for the creation of Serverless components that are driven by Event rather than Traffic
36. @kevindubois CloudEvents CNCF graduated project - https://cloudevents.io/ Provides a common event schema => Interoperability, portability Extensible through extension attributes SDKs for different programming languages Protocol-agnostic (HTTP, AMQP, MQTT, …) Wide adoption
37. @kevindubois Usage Patterns Source to Sink
38. @kevindubois Usage Patterns Channel and Subscription
39. @kevindubois Usage Patterns Broker and Trigger
40. @kevindubois Demo?
41. @kevindubois Demo
42. @kevindubois
43. @kevindubois github.com/kdubois/CamelQuarkusVoter
44. @kevindubois Serverless + AI ? https://knative.dev/docs/about/case-studies/deepc/
45. @kevindubois Wrapping it up… • Cloud providers offer a LOT of cool stuff • We need to be mindful of cloud lock-in • Serverless is much more than just FAAS • Use Open Source when you can, proprietary services when you must • If you find yourself limited by Open Source solutions, contribute and participate!
46. @kevindubois Free Developer e-Books & tutorials! developers.redhat.com/eventtutorials
47. @kevindubois github.com/serverless-java-in-action
48. @kevindubois github.com/kdubois/CamelQuarkusVoter
49. @kevindubois Thank you! @kevindubois@mastodon.social youtube.com/@thekevindubois linkedin.com/in/kevindubois github.com/kdubois @kevindubois.com