Five (and a half) Cool Things You Can Do With Quarkus

1. Save the world.
2. Lightning-quick CLIs.
3. Embed WASM.
4. Run Spring code.
5. AI, for real.
5½. Use Minecraft as an observability client. Ok, this one isn’t cool, it’s stupid, but Holly’s
done it anyway.

In this demo-driven session, Holly will show some of her favorite Quarkus capabilities. Some are established and
important, some are less well-known, and some are plain silly. But they’re all cool. Whether you’re new to Quarkus or an
experienced user, you’ll discover something you didn’t know.

Transcript

1. 5 ½ cool things to do with Quarkus Holly Cummins IBM
2. save the world 1
3. 1 save the world
4. @holly_cummins #RedHat Sources: https://www.greenit.fr/wp-content/uploads/2019/11/GREENIT_EENM_etude_EN_accessible.pdf https://ourworldindata.org/ghg-emissions-by-sector the digital world creates more carbon emissions than aviation
5. @holly_cummins #RedHat Lighter area represents high and low estimates, where available. Sources: https://www.iea.org/fuels-and-technologies/data-centres-networks https://ourworldindata.org/grapher/electricity-demand?tab=table&country=USA~GBR~FRA~DEU~IND~BRA data centres use as much electricity as a medium country
6. how can quarkus help??
8. https://github.com/quarkusio/spring-quarkus-perf-comparison
9. here’s what we see in our controlled lab JVM Native Quarkus Spring Boot Ratio (Quarkus / SB) Spring Boot (w/AOT) Ratio (Quarkus / SB AOT) Ratio (SB AOT / SB) Quarkus Spring Boot Ratio (Quarkus / SB) Framework version 3.22.3 3.4.5 3.4.5 3.22.3 3.4.5 Build time (s) 13.15 7.60 172.95% 17.02 77.26% 223.85% 178.99 279.45 64.05% Av. RSS after startup (MB) 192.31 298.09 64.51% 290.40 66.22% 97.42% 71.22 205.74 34.62% Av. time to 1st req (ms) 4652.67 8770.33 53.05% 8180.67 56.87% 93.28% 135.67 916.67 14.80% Av. RSS after 1st req (MB) 244.61 339.52 27.05% 331.78 73.73% 97.72% 79.12 208.21 38.00% Av. throughput (req/sec) 30,397.95 6,495.20 468.01% 6,427.64 472.93% 98.96% 16,753.94 6,146.27 272.59% Max throughput density (req/sec/MB) 35.79 7.95 450.50% 7.89 453.88% 99.26% 59.82 15.94 375.27% Build RSS (GB) 5.62 157.04 57.92% Binary Size (MB) 90.95 157.04 57.92% https://github.com/edeandrea/quarkus-for-spring-devs-examples/tree/quarkus-for-spring-devs-talk-sb3 8 cores, 14GB RAM, GraalVM CE 21.0.2
10. was this an easy demo?
11. was this an easy demo? - i broke all the performance best practices :) - measuring on a laptop - generating load on the same machine
12. ?
13. it’s not really about throughput
14. it’s about hardware
15. … hardware is also money
16. we can simulate running in containers https://github.com/jponge/volcamp25-quarkus/
17. spring boot quarkus
18. spring boot quarkus 40 586 req/s
19. spring boot quarkus 40 586 req/s 17 209 req/s
20. spring boot quarkus 40 586 req/s 17 209 req/s 1 342 errors
21. spring boot quarkus 40 586 req/s 17 209 req/s 1 342 errors 2 vCPUs 0.5 GiB
22. spring boot quarkus t3.nano $0.0052 40 586 req/s 17 209 req/s 1 342 errors 2 vCPUs 0.5 GiB
23. spring boot quarkus t3.nano $0.0052 40 586 req/s 17 209 req/s 1 342 errors 2 vCPUs 2 GiB 2 vCPUs 0.5 GiB
24. spring boot quarkus t3.nano $0.0052 t3.small $0.0208 40 586 req/s 17 209 req/s 1 342 errors 2 vCPUs 2 GiB 2 vCPUs 0.5 GiB
25. spring boot quarkus t3.nano $0.0052 t3.small $0.0208 40 586 req/s 17 209 req/s 1 342 errors $3.87 a month 2 vCPUs 2 GiB 2 vCPUs 0.5 GiB
26. spring boot quarkus t3.nano $0.0052 t3.small $0.0208 40 586 req/s 17 209 req/s 1 342 errors $15.47 a month $3.87 a month 2 vCPUs 2 GiB 2 vCPUs 0.5 GiB
27. spring boot quarkus t3.nano $0.0052 t3.small $0.0208 40 586 req/s 17 209 req/s 1 342 errors $15.47 a month $3.87 a month x2 2 vCPUs 2 GiB 2 vCPUs 0.5 GiB
28. spring boot quarkus t3.nano $0.0052 t3.small $0.0208 40 586 req/s 17 209 req/s 1 342 errors $15.47 a month $3.87 a month $30.94 a month x2 2 vCPUs 2 GiB 2 vCPUs 0.5 GiB
29. spring boot quarkus t3.nano $0.0052 t3.small $0.0208 40 586 req/s 17 209 req/s 1 342 errors $15.47 a month $3.87 a month $30.94 a month x2 2 vCPUs 2 GiB 2 vCPUs 0.5 GiB
30. spring boot quarkus t3.nano $0.0052 t3.small $0.0208 40 586 req/s 17 209 req/s 1 342 errors $15.47 a month $3.87 a month $30.94 a month x2 2 vCPUs 2 GiB 2 vCPUs 0.5 GiB
31. tell your boss you learned… -quarkus uses 2 - 8x fewer compute resources than spring -quarkus is 2 - 8x cheaper to run than spring
32. ??
33. the economic model low costs correlate to low energy usage
34. the vrrrrooooom model high throughput correlates to low energy usage
37. t3.nano t3.small 2x t3.small Watts per hour 12.5 14 28
42. 9000 potatoes
43. 0.0007 W
44. t3.nano t3.small 2x t3.small Watts per hour 12.5 14 28
45. t3.nano t3.small 2x t3.small Watts per hour 12.5 14 28 Lemons per hour 17,857 20,000 40,000
46. spring boot 40,000 lemons/hour quarkus 17,857 lemons/hour
48. jbang wrk2@hyperfoil -t2 -c100 -d30s -R 200 --latency http:// localhost:8080/fruits jbang wrk@hyperfoil -t2 -c100 -d20s --timeout 1s http:// localhost:8080/fruits sudo powermetrics --samplers cpu_power,tasks --show-process- samp-norm --show-process-gpu --show-usage-summary -i 0 -o output.txt
49. tell your boss you learned… -lowering costs and hardware usage is good for the planet -quarkus helps :)
50. was this an easy demo?
51. was this an easy demo?
52. was this an easy demo? -bringing 77 ,857 lemons to malmö turned out to be hard
53. was this an easy demo? -bringing 77 ,857 lemons to malmö turned out to be hard -the energy measurement tooling is bleeding edge (still being written by christophe!)
54. 2 how quick can quarkus go?
56. thanks to markus eisele for the graphics code https://github.com/holly-cummins/meme-generator
57. was this an easy demo?
58. was this an easy demo?
59. was this an easy demo? -writing the cli was easy -native compilation was easy -native compilation + awt + mac is very hard
61. i tried:
62. i tried: native awt on mac
63. i tried: native awt on mac liberica vm on mac + tuning of build-time and runtime classes
64. i tried: native awt on mac liberica vm on mac + tuning of build-time and runtime classes graalvm community container
65. i tried: native awt on mac liberica vm on mac + tuning of build-time and runtime classes graalvm community container mandrel container
66. tell your boss you learned… •picocli + quarkus is a great combination •native is clever tech •…but native has dragons •only go native if you actually need it
67. wasm 3
69. java code
70. java code bytecode
71. java code bytecode javac
72. java runtime java code bytecode javac
73. java runtime java code bytecode interpreter javac
74. java runtime java code bytecode interpreter compiler javac jit
75. java runtime java code bytecode interpreter compiler javac jit
76. java runtime java code bytecode interpreter compiler javac jit kotlin
77. java runtime java code bytecode interpreter compiler javac jit kotlin groovy
79. wasm
80. wasm runtime wasm
81. wasm runtime wasm interpreter
82. wasm runtime wasm interpreter compiler
83. wasm runtime wasm interpreter compiler
84. wasm runtime wasm interpreter compiler c code
85. wasm runtime wasm interpreter compiler c code rust code
86. wasm runtime javascript code wasm interpreter compiler c code rust code
87. wasm runtime javascript code wasm interpreter compiler c code rust code js interpreter
88. wasm runtime wasm runtime wasm runtime javascript code wasm interpreter compiler c code rust code js interpreter
89. java runtime java code bytecode interpreter compiler kotlin groovy wasm c code rust code
90. java runtime java code bytecode interpreter compiler kotlin groovy wasm c code rust code wasm runtime
91. @holly_cummins
92. @holly_cummins
93. @holly_cummins
94. url: https://github.com/andreaTP/quarkus-photon-demo
95. was this an easy demo?
96. was this an easy demo? - running rust in a jvm is … easy? - live reload would be better with a quarkus extension
98. “Running JavaScript in a C runtime compiled to WebAssembly on the JVM is the new black.” - Andrea Peruffo
100. tell your boss you learned… -polyglot is here -language doesn’t need to be a barrier
101. but what if the code i want to run in quarkus is spring code? 4
104. https://github.com/quarkusio/spring-quarkus-perf-comparison
105. was this an easy demo?
106. was this an easy demo? - all the hard work was already done - … but notice we didn’t attempt the tests
107. tell your boss you learned… -you can get to quarkus from spring -compatibility libraries -migration tooling
108. ai for the rest of us 5
109. @holly_cummins #Quarkus #IBM #RedHat
110. @holly_cummins #Quarkus #IBM #RedHat
111. @holly_cummins #Quarkus #IBM #RedHat ai has most value when it is integrated
112. @holly_cummins #Quarkus #IBM #RedHat generative ai has a python problem
113. @holly_cummins #Quarkus #IBM #RedHat deploy to prod rest api train the model
114. @holly_cummins #Quarkus #IBM #RedHat deploy to prod rest api train the model use output in code standardize prompt structures switch from one LLM model to another memory (context)
115. @holly_cummins #Quarkus #IBM #RedHat deploy to prod rest api train the model use output in code standardize prompt structures switch from one LLM model to another memory (context) langchain
116. @holly_cummins #Quarkus #IBM #RedHat deploy to prod rest api train the model use output in code standardize prompt structures switch from one LLM model to another memory (context) langchain langchain4j
117. @holly_cummins #Quarkus #IBM #RedHat use output in code standardize prompt structures switch from one LLM model to another memory (context) langchain4j
118. @holly_cummins #Quarkus #IBM #RedHat use output in code standardize prompt structures switch from one LLM model to another memory (context) langchain4j easy access to data
119. @holly_cummins #Quarkus #IBM #RedHat use output in code standardize prompt structures switch from one LLM model to another memory (context) langchain4j easy access to data dependency injection
120. @holly_cummins #Quarkus #IBM #RedHat use output in code standardize prompt structures switch from one LLM model to another memory (context) langchain4j easy access to data dependency injection annotations
121. @holly_cummins #Quarkus #IBM #RedHat use output in code standardize prompt structures switch from one LLM model to another memory (context) langchain4j easy access to data dependency injection annotations live coding
122. @holly_cummins #Quarkus #IBM #RedHat use output in code standardize prompt structures switch from one LLM model to another memory (context) langchain4j easy access to data dependency injection annotations live coding failover
123. @holly_cummins #Quarkus #IBM #RedHat use output in code standardize prompt structures switch from one LLM model to another memory (context) langchain4j easy access to data dependency injection annotations live coding failover mockability
124. @holly_cummins #Quarkus #IBM #RedHat use output in code standardize prompt structures switch from one LLM model to another memory (context) langchain4j easy access to data dependency injection annotations live coding failover mockability observability
125. @holly_cummins #Quarkus #IBM #RedHat use output in code standardize prompt structures switch from one LLM model to another memory (context) quarkus langchain4j langchain4j easy access to data dependency injection annotations live coding failover mockability observability
127. @holly_cummins #Quarkus #IBM #RedHat https://github.com/holly-cummins/ quarkus-langchain4j-pet-adoption-demo
128. tell your boss you learned… -langchain4j + quarkus makes integrating gen ai easy -structured data is nice
129. minecraft observability 5½
130. observability
132. user code
133. user code quarkus framework
134. application user code quarkus framework
135. application user code quarkus framework extensions
136. application user code quarkus framework extensions
137. application user code quarkus framework client extensions
138. application user code quarkus framework client extensions
139. application user code quarkus framework client extensions
140. application user code quarkus framework client extensions
141. application user code quarkus framework client extensions observability stack
142. application user code quarkus framework client metrics extensions observability stack
143. application user code quarkus framework client metrics traces extensions observability stack
144. application user code quarkus framework client metrics traces logs extensions observability stack
145. application user code quarkus framework observability client client metrics traces logs extensions observability stack
146. application user code quarkus framework observability client client metrics traces logs extensions observability stack
147. application user code quarkus framework observability client client dev service (testcontainers) extensions observability stack
148. application user code quarkus framework client extensions
149. application user code quarkus framework client extensions
150. application user code quarkus framework client extensions minecraft server
151. application user code quarkus framework minecraft client client extensions minecraft server
152. application user code quarkus framework minecraft client client extensions minecraft server
153. application user code quarkus framework minecraft client client extensions minecraft server mod
154. application user code quarkus framework minecraft client client dev service (testcontainers) extensions minecraft server mod
157. https://github.com/quarkiverse/quarkus-observability-minecraft
158. tell your boss you learned… -you can do a lot with interceptors -dev services are awesome
159. but what about ai?
161. https://github.com/quarkiverse/quarkus-observability-minecraft
162. https://github.com/quarkiverse/quarkus-observability-minecraft
163. was this an easy demo?
164. was this an easy demo?
165. was this an easy demo? -extension was easy, minecraft mod was hard
166. was this an easy demo? -extension was easy, minecraft mod was hard -minecraft APIs
167. was this an easy demo? -extension was easy, minecraft mod was hard -minecraft APIs -lack documentation
168. was this an easy demo? -extension was easy, minecraft mod was hard -minecraft APIs -lack documentation -change between minor versions
169. was this an easy demo? -extension was easy, minecraft mod was hard -minecraft APIs -lack documentation -change between minor versions -client-server sync of injected behaviour is hard
170. tell your boss you learned… -typesafe objects are better than a chat box -… but small models may struggle with structured data -gen ai adds latency
171. what have we done?
172. what have we done? 1. seen quarkus uses half as much energy as spring boot
173. what have we done? 1. seen quarkus uses half as much energy as spring boot 2. made a cli that starts really fast
174. what have we done? 1. seen quarkus uses half as much energy as spring boot 2. made a cli that starts really fast 3. used wasm in a quarkus app
175. what have we done? 1. seen quarkus uses half as much energy as spring boot 2. made a cli that starts really fast 3. used wasm in a quarkus app 4. converted a spring app to quarkus
176. what have we done? 1. seen quarkus uses half as much energy as spring boot 2. made a cli that starts really fast 3. used wasm in a quarkus app 4. converted a spring app to quarkus 5. deeply integrated ai
177. what have we done? 1. seen quarkus uses half as much energy as spring boot 2. made a cli that starts really fast 3. used wasm in a quarkus app 4. converted a spring app to quarkus 5. deeply integrated ai 6. used minecraft for observability 5½.
178. https://hollycummins.com/quarkus-cool-things/ 45% off all Manning products: Oredev25