jChampions - Serverless Java in Action: Cloud Agnostic Design Patterns and Tips

Transcript

1. @kevindubois.com @danieloh30.bsky.social Serverless Java in Action: Cloud Agnostic Design Patterns and Tips
2. @kevindubois.com @danieloh30.bsky.social Who We Are! Daniel Oh Developer Advocate, Java Champion @danieloh30.bsky.social Kevin Dubois Developer Advocate, Java Champion @kevindubois.com
3. @kevindubois.com @danieloh30.bsky.social https://www.cncf.io/blog/2023/12/20/cncf-cloud-native-finops-cloud-financial-management-microsurvey/
4. @kevindubois.com @danieloh30.bsky.social Serverless “Serverless computing refers to the concept of building and running applications that do not require server management. It describes a finer-grained deployment model where applications, bundled as one or more functions are uploaded to a platform and then executed, scaled, and billed in response to the exact demand needed at the moment” -- CNCF Definition, https://www.cncf.io/blog/2018/02/14/cncf-takes-first-step-towards-serverless-computing/
5. @kevindubois.com @danieloh30.bsky.social overprovisioned & wasting resources underprovisioned & unhappy users! Traditional Deployments NOT Serverless
6. @kevindubois.com @danieloh30.bsky.social Serverless Use only what you need! with Serverless
7. @kevindubois.com @danieloh30.bsky.social with serverless workloads Efficient Node Utilization == Less Nodes == Energy + Cost Savings
8. @kevindubois.com @danieloh30.bsky.social Rapid increase in Serverless Adoption in the wild - DataDog Survey Source: https://www.datadoghq.com/state-of-serverless/
9. @kevindubois.com @danieloh30.bsky.social AWS Lambda, Functions... Built around the FaaS components and other services such as API Gateways. It enabled a variety of use cases but it is far from ideal for general computing and with room for improvements. 1.0 ➔ HTTP and other few Sources ➔ Functions only ➔ Limited execution time (5 min) ➔ No orchestration ➔ Limited local development experience FaaS
10. @kevindubois.com @danieloh30.bsky.social
11. @kevindubois.com @danieloh30.bsky.social • Regulatory changes • Outages • Price changes, contract renegotiations • Other vendor offers better services • New CIO/CTO • Shadow IT • … What if …
12. @kevindubois.com @danieloh30.bsky.social
13. @kevindubois.com @danieloh30.bsky.social Writing cloud agnostic functions
14. @kevindubois.com @danieloh30.bsky.social Example: Java & Serverless
15. @kevindubois.com @danieloh30.bsky.social Supersonic. Subatomic. Java
16. @kevindubois.com @danieloh30.bsky.social Quarkus + Native (via GraalVM) 0.016 Seconds Quarkus + JVM (via OpenJDK) 0.943 Seconds Traditional Cloud-Native Stack 4.3 Seconds Supersonic, Subatomic Java Quarkus + Native (via GraalVM) 12 MB Quarkus + JVM (via OpenJDK) 73 MB Traditional Cloud-Native Stack 136 MB
17. @kevindubois.com @danieloh30.bsky.social github.com/serverless-java-in-action/examples
18. @kevindubois.com @danieloh30.bsky.social quarkus create app myfunction \ -x funqy-amazon-lambda
19. @kevindubois.com @danieloh30.bsky.social DEMO
20. @kevindubois.com @danieloh30.bsky.social
21. @kevindubois.com @danieloh30.bsky.social AWS Lambda, Functions... Built around the FaaS components and other services such as API Gateways. It enabled a variety of use cases but it is far from ideal for general computing and with room for improvements. 1.0 ➔ HTTP and other few Sources ➔ Functions only ➔ Limited execution time (5 min) ➔ No orchestration ➔ Limited local development experience Serverless Containers With the advent of containers & Kubernetes, many frameworks and solutions started to auto-scale containers. Cloud providers created offerings using managed services completely abstracting Kubernetes APIs. 1.5 ➔ Fargate, Cloud Run, Container Instances ➔ Knative, KEDA, etc ➔ Kubernetes based auto-scaling ➔ Microservices and Functions ➔ Easier to debug & test locally ➔ Polyglot & Portable Serverless is evolving...
22. @kevindubois.com @danieloh30.bsky.social
23. @kevindubois.com @danieloh30.bsky.social Knative https://github.com/knative
24. @kevindubois.com @danieloh30.bsky.social Immutable revisions Deploy new features: performing canary, A/B or blue-green testing with gradual traffic rollout with no sweat and following best practices. Any programming language Use any programming language or runtime of choice. From Java, Python, Go and JavaScript to Quarkus, SpringBoot or Node.js. No need to configure number of replicas, or idling. Scale to zero when not in use, auto scale to thousands during peak, with built-in reliability and fault-tolerance. Automatic scaling Simplified developer experience to deploy applications/code on serverless containers abstracting infrastructure & focusing on what matters. Containers made easy Ready for the Hybrid Cloud Truly portable serverless running anywhere Kubernetes runs, that is on-premises or on any public cloud. Leverage data locality and SaaS when needed. prem aws azur e Event Driven Architectures Build loosely coupled & distributed apps connecting with a variety of built-in or third-party event sources or connectors powered by Operators. Knative is an Open Source, Cloud Agnostic Solution to build Serverless and Event Driven Applications on Kubernetes Knative
25. @kevindubois.com @danieloh30.bsky.social $ kn func create -l quarkus myfunc $ kn func deploy $ kn service create myservice --image=xyz github.com/serverless-java-in-action/examples
26. @kevindubois.com @danieloh30.bsky.social AWS Lambda, Functions... Built around the FaaS components and other services such as API Gateways. It enabled a variety of use cases but it is far from ideal for general computing and with room for improvements. 1.0 ➔ HTTP and other few Sources ➔ Functions only ➔ Limited execution time (5 min) ➔ No orchestration ➔ Limited local development experience Serverless Containers With the advent of containers & Kubernetes, many frameworks and solutions started to auto-scale containers. Cloud providers created offerings using managed services completely abstracting Kubernetes APIs. 1.5 ➔ Fargate, Cloud Run, Container Instances ➔ Knative, KEDA, etc ➔ Kubernetes based auto-scaling ➔ Microservices and Functions ➔ Easier to debug & test locally ➔ Polyglot & Portable Integration, State, Workflow Logic The maturity and benefits of Serverless are recognized industry wide and it adds the missing parts to make pattern suitable for general purpose workloads and used on the enterprise. 2.0 ➔ Basic state handling ➔ Enterprise Integration Patterns ➔ Serverless Logic Workflows ➔ Advanced Messaging Capabilities ➔ Blended with your PaaS ➔ Enterprise-ready event sources ➔ Solutions and outcome focused
27. @kevindubois.com @danieloh30.bsky.social
28. @kevindubois.com @danieloh30.bsky.social Knative Eventing Eventing is a set of APIs for routing events from Producers to Consumers (known as Sinks) CloudEvent specification allows for the creation of Serverless components that are driven by Event rather than Traffic
29. @kevindubois.com @danieloh30.bsky.social CloudEvents CNCF graduated project - https://cloudevents.io/ Provides a common event schema => Interoperability, portability Extensible through extension attributes SDKs for different programming languages Protocol-agnostic (HTTP, AMQP, MQTT, …) Wide adoption
30. @kevindubois.com @danieloh30.bsky.social Knative Eventing Usage Patterns Source to Sink
31. @kevindubois.com @danieloh30.bsky.social Knative Eventing Usage Patterns Channel and Subscription
32. @kevindubois.com @danieloh30.bsky.social Knative Eventing Usage Patterns Broker and Trigger
33. @kevindubois.com @danieloh30.bsky.social Who wants more demos?
34. @kevindubois.com @danieloh30.bsky.social
35. @kevindubois.com @danieloh30.bsky.social
36. @kevindubois.com @danieloh30.bsky.social github.com/kdubois/CamelQuarkusVoter
37. @kevindubois.com @danieloh30.bsky.social 37 Serverless Logic: Building an application by orchestrating services and events EXT. SERVICE MICRO SERVICE MICRO SERVICE MICRO SERVICE EXT. SERVICE MICRO SERVICE MICRO SERVICE EXT. SERVICE MICRO SERVICE MANAGED SERVICE MICRO SERVICE F F F F F F F F MICRO SERVICE +
38. @kevindubois.com @danieloh30.bsky.social Serverless + AI knative.dev/docs/about/case-studies/deepc/ github.com/kserve/kserve Model Context Protocol (MCP) quarkus.io/blog/mcp-server/
39. @kevindubois.com @danieloh30.bsky.social Free Developer e-Books & Tutorials! developers.redhat.com/eventtutorials
40. @kevindubois.com @danieloh30.bsky.social Thank you! youtube.com/@thekevindubois | bit.ly/danielohtv linkedin.com/in/kevindubois | @daniel-oh-083818112 github.com/kdubois | @danieloh30 @kevindubois.com | @danieloh30.bsky.social slides