"No collector" approach to monitor GraalVM Native Image applications

JCON OpenBlend Slovenia 2025

Transcript

1. "No collector" approach to monitor GraalVM Native Image applications NISHIKAWA, Akihiro (Aki) Cloud Solution Architect, Microsoft @logico-jp.dev linkedin.com/in/anishi1222/
2. Živijo! こんにちは! Hello! { "name": "Akihiro Nishikawa", "country": "Japan", "workFor": "Microsoft", "favourites": [ "JVM", "GraalVM", "Azure" ], "expertise": [ "Application integration", "Container", "Serverless" ] }
3. Why this topic?
4. We often use Java agents for instrumentation. 1) How do we improve startup time of CPU restricted pods? 2) Can we use the same agent for GraalVM Native Image?
5. Framework auto-instrumentation What I want to share with you in this talk
6. Agenda  Why this topic?  Observability  OpenTelemetry  Zero-code Instrumentation  GraalVM  Zero-code instrumentation for native image  Agent, or...?  Spring Boot  Quarkus  Conclusion
7. Observability
8. Monitoring large number of components (microservices) is quite hard and difficult. Image: “Mastering Distributed Tracing” by Yuri Shkuro
9. Observability is the ability to understand the internal state of a system by examining its outputs. In the context of software, this means being able to understand the internal state of a system by examining its telemetry data, which includes traces, metrics, and logs. https://opentelemetry.io/docs/what-is-opentelemetry/#what-is-observability
10. tells us what’s happening, why it’s happening and how to fix it. Monitoring vs. Observability Two ways to identify the underlying cause of problems Traces Metrics Logs Profiles Events Monitoring Observability tells us when something is wrong. “proactive” “reactive”
11. OpenTelemetry (OTel)  An Observability framework and toolkit designed to create and manage telemetry data such as traces, metrics, and logs.  Profiler signal is under progress.  Vendor and tool agnostic.  Not an observability backend like Jaeger, Prometheus, or other commercial vendors.  Focused on the generation, collection, management, and export of telemetry. Documentation | OpenTelemetry
12. The 2nd most active CNCF project https://all.devstats.cncf.io/d/1/activity-repository-groups?orgId=1&var- period=d7&var-repogroups=All
13. Objectives [1] Focuses solely on collecting and delivering telemetry data. [2] Generating actionable insights and storing telemetry data are out of scope.  An observability backend like Jaeger, Prometheus, or other commercial vendors. A major goal of OpenTelemetry is that you can easily instrument your applications or systems[1], no matter their language, infrastructure, or runtime environment. The storage and visualization of telemetry is intentionally left to other tools[2]. https://opentelemetry.io/docs/what-is-opentelemetry/
14. Java apps/libraries Collector (vendor agnostic) Receiver Processor Exporter Java Instr. APIs OTel SDK OTLP Transport telemetry data (1) Agent
15. Java apps/libraries Exporter Java Instr. APIs OTel SDK Transport telemetry data (2) No collector
16. Java apps/libraries Collector (vendor agnostic) Receiver Processor Exporter Java Instr. APIs OTel SDK OTLP Transport telemetry data (3) Gateway Load balancer Receiver Processor Exporter Receiver Processor Exporter
17. Zero-code instrumentation
18. Signal instrumentation and export input output application Signals (telemetry data) (logs, memory/CPU usages, etc.) export dashboard (Grafana, Prometheus, etc.) Instrumentation
19. Zero-code instrumentation  Add monitoring and telemetry capabilities to an app without modifying its source code.  Java program runs normally, but an attached instrumentation agent monitors its behavior (e.g. HTTP requests, database calls) without any changes to your codebase.
20. Why zero-code instrumentation? Makes observability easier to adopt.  No additional code for observability is needed.  Covers standard telemetry out-of-the-box, including in areas developers might overlook.
21. Several ways to achieve zero-code instrumentation Type Description Example JVM Agent (Auto-Instrumentation) Attaches to the JVM at runtime and uses the Java Instrumentation API to modify bytecode and collect telemetry data. OTel Java Agent Vendor APM Agents Framework Auto- Instrumentation Java applications using certain frameworks can use instrumentation without custom code. Spring Boot Starter Quarkus extension Service Mesh (sidecar proxy) Service meshes (Istio, Linkerd, etc.), which work as a proxy, provide zero-code observability at the network Istio (Envoy) Linkerd eBPF-Based Instrumentation eBPF programs can safely hook into kernel and system calls to monitor application behavior. Pixie Cilium Hybrid Approaches Use a mix of the above.
22. GraalVM
23. GraalVM An advanced JDK with ahead-of-time Native Image compilation Hotspot based JIT compiler (Graal compiler) Native Image Ahead-of-time compilation Other features Polyglot runtime (Truffle) based Python, Node.js, Ruby, WASM, etc.
24. GraalVM Native Image Fast start and scale Lower resource usage Predictable performance Improved security Compact packaging Several frameworks and platforms supported
25. How to generate Native Image Input Application Substrate VM JDK Dependencies (libraries)
26. How to generate Native Image Iterative analysis until reaching fixed point. Points-to Analysis Run initializations Input Application Substrate VM JDK Dependencies (Libraries) Heap snapshotting
27. Iterative analysis until reaching fixed point. How to generate Native Image Points-to Analysis Run initializations Input Application Substrate VM JDK Dependencies (Libraries) Heap snapshotting Output Native executable Data section Image heap Text section AOT compiled code (specific to OS)
28. Can use the same tools to solve issues with native image and Java apps. Tools Collected information • JDK Mission Control • Visual VM • jvmstat • jmx etc. • GC logs • Thread dumps • Heap dumps • Profiling • Error report • Core dump • JDK Flight Recorder etc.
29. Zero-code instrumentation for native image
30. Which type can be achievable? Type Description Example JVM Agent (Auto-Instrumentation) Attaches to the JVM at runtime and uses the Java Instrumentation API to modify bytecode and collect telemetry data. OTel Java Agent Vendor APM Agents Framework Auto- Instrumentation Java applications using certain frameworks can use instrumentation without custom code. Spring Boot Starter Quarkus extension Service Mesh (sidecar proxy) Service meshes (Istio, Linkerd, etc.), which work as a proxy, provide zero-code observability at the network Istio (Envoy) Linkerd eBPF-Based Instrumentation eBPF programs can safely hook into kernel and system calls to monitor application behavior. Pixie Cilium Hybrid Approaches Use a mix of the above.
31. How do we instrument GraalVM Native Image applications ? Back to the motivation
32. JVM myapp.jar agent OS JVM?? Native app agent OS Where does the agent run and attach? Normal Java apps Native lmage apps
33. As of now, agents are not supported. [GR-55707] Java Agents Support in Native Image · Issue #8177 · oracle/graal
34. Precisely speaking... Welcome, GraalVM for JDK 24! by Alina Yurenko | Medium  Native Image supports static agents in premain phase, but not yet in runtime.  GraalVM team is working hard to support agents in GraalVM...  GraalVM for JDK 25 (September 16, 2025) Milestone (github.com)  Feasibility study using Java agents with Native Image has started, but configuration is complicated.  Performance Improvement by 10 Times, GraalVM Application Observability Practice - Alibaba Cloud Community
35. Any alternatives for zero-code instrumentation which works for GraalVM Native Image?
36. Java apps/libraries Exporter Java Instr. APIs OTel SDK JVM myapp.jar agent OS Agents can work well with normal Java applications. Agents
37. Java apps/libraries Exporter Java Instr. APIs OTel SDK JVM?? myapp agent OS But currently agents cannot work well with native image applications.
38. Java apps/libraries Exporter Java Instr. APIs OTel SDK How about building native apps with exporter functionality, instead of using agents? Self-contained application
39. Java apps/libraries Exporter Java Instr. APIs OTel SDK myapp dependencies OS Package all dependencies into a JAR and create a binary executable with it.
40. Framework auto-instrumentation Type Example Native Image Support JVM Agent (Auto-Instrumentation) OTel Java Agent Vendor APM Agents (as of May 30, 2025) Framework Auto-Instrumentation Spring Boot Starter Quarkus extension Service Mesh (side-car proxy) Istio (Envoy) Linkerd (network level instrumentation) eBPF-Based Instrumentation Pixie Cilium (This is not aware of high-level context.) Hybrid Approaches It depends.
41. Why framework auto-instrumentation? Applicable to Spring Boot Starter and Quarkus OpenTelemetry, etc. Spring Boot starter | OpenTelemetry Smaller startup overhead than OTel Java agent In CPU-restricted environments such as k8s, agents take longer to start up. Framework auto-instrumentation can co-exist along with a Java monitoring agent which has been already used. In the case of OTel Java agent, it might not work with the other agent. Can use configuration files (application.properties, application.yml) as well as environment variables. Configuration files does not work with OTel Java agent. Supports JVM metrics Agent is not the only option.
42. Configuration 1) Spring Boot
43. <dependency> <groupId>io.opentelemetry</groupId> <artifactId>opentelemetry-bom</artifactId> </dependency> <dependency> <groupId>io.opentelemetry.instrumentation</groupId> <artifactId>opentelemetry-instrumentation-bom</artifactId> </dependency> <!-- The OTel Spring Boot starter: https://tinyurl.com/otel-starter --> <dependency> <groupId>io.opentelemetry.instrumentation</groupId> <artifactId>opentelemetry-spring-boot-starter</artifactId> </dependency> <!-- for Azure --> <dependency> <groupId>com.azure.spring</groupId> <artifactId>spring-cloud-azure-starter-monitor</artifactId> </dependency> Dependencies (1/2)
44. Dependencies (2/2) Additional settings are needed with signed JAR. ... <plugin> <groupId>org.graalvm.buildtools</groupId> <artifactId>native-maven-plugin</artifactId> <configuration> <buildArgs> <buildArg>--libc=musl</buildArg> <jvmArgs>-Djava.security.properties=src/main/resources/custom.security</jvmArgs> </buildArgs> </configuration> </plugin> Disabling signature verification is needed when generating native apps with signed JARs.
45. # e.g. when using Azure Application Insights applicationinsights.connection.string =InstrumentationKey=000000-0000-0000-0000-0000000000 Configuration application.properties (application.yml) APPLICATIONINSIGHTS_CONNECTION_STRING="InstrumentationKey=000000-0000-0000- 0000-0000000000" azure-sdk-for-java/sdk/spring/spring-cloud-azure-starter-monitor at main · Azure/azure-sdk-for-java Environment variables  We can configure settings in either config files or environment variables. Config file (application.properties)
46. Configuration 1) Quarkus
47. Quarkus  Since 3.13, OTel support has been enhanced.  But MicroMeter is now recommended.  Quarkus provides dependencies around OpenTelemetry.  No dependency provided from OpenTelemetry is required.  Several platform specific dependencies are also provided.  Using OpenTelemetry - Quarkus  Quarkus OpenTelemetry Exporter :: Quarkiverse Documentation  Maven Repository: io.quarkiverse.opentelemetry.exporter
48. Enhancement to support OTel in Quarkus 3.13 Quarkus 3.13 - OpenTelemetry Metrics, OpenTelemetry 1.39, TLS registry improvements and more... - Quarkus
49. <!-- Quarkus OpenTelemetry extension --> <dependency> <groupId>io.quarkus</groupId> <artifactId>quarkus-opentelemetry</artifactId> </dependency> <!-- if JDBC telemetry is needed --> <dependency> <groupId>io.opentelemetry.instrumentation</groupId> <artifactId>opentelemetry-jdbc</artifactId> </dependency> <!-- Azure exporters --> <dependency> <groupId>io.quarkiverse.opentelemetry.exporter</groupId> <artifactId>quarkus-opentelemetry-exporter-azure</artifactId> </dependency> Dependencies
50. quarkus.application.name=myservice quarkus.otel.exporter.otlp.endpoint=http://localhost:4317 quarkus.otel.exporter.otlp.headers=authorization=Bearer my_secret quarkus.log.console.format=%d{HH:mm:ss} %-5p traceId=%X{traceId}, parentId=%X{parentId}, spanId=%X{spanId}, sampled=%X{sampled} [%c{2.}] (%t) %s%e%n quarkus.datasource.jdbc.telemetry=true # When using Azure Application Insights quarkus.otel.azure.applicationinsights.connection.string =InstrumentationKey=00000000-0000-0000-0000-000000000000 Configuration application.properties (application.yml) QUARKUS_OTEL_AZURE_APPLICATIONINSIGHTS_CONNECTION_STRING="InstrumentationKey=00 0000-0000-0000-0000-0000000000" Can use environment variables to set configuration.
51. Demo
52. Environment No intention of promotion, of course! Observability backend Application Insights Database Database for PostgreSQL Flexible Server Container platform Container Apps
53. Each container Spring Boot Quarkus
54. Collect telemetry data from polyglot apps
57. I'm worried that this works on Azure only... W, wait!
58. How about using Grafana Cloud?
59. Also works with other OTel backgrounds, of course Dependencies should be modified, though… Spring Boot Starter × Grafana Cloud <dependency> <groupId>io.opentelemetry.instrumentation</groupId> <artifactId>opentelemetry-spring-boot-starter</artifactId> </dependency> <!-- Optional dependencies --> <dependency> <groupId>io.opentelemetry.instrumentation</groupId> <artifactId>opentelemetry-jdbc</artifactId> </dependency>
60. Also works with other OTel backgrounds, of course Dependencies should be modified, though… Quarkus × Grafana Cloud <dependency> <groupId>io.quarkus</groupId> <artifactId>quarkus-opentelemetry</artifactId> </dependency> <!-- Optional dependencies --> <dependency> <groupId>io.opentelemetry.instrumentation</groupId> <artifactId>opentelemetry-jdbc</artifactId> </dependency>
62. Conclusion
63. Takeaways  No-collector approach is not just for agent but also for framework auto-instrumentation.  Java agents don’t work with GraalVM Native Image apps as of now.  Framework auto-instrumentation has several advantages over Java agent.
64. Resources OpenTelemetry https://opentelemetry.io/ GraalVM https://graalvm.org/ Spring https://spring.io/ Quarkus https://quarkus.io/ Sample repo https://github.com/Azure-Samples/java-native-telemetry
65. Hvala! ありがとう! Thank you!