Micronaut AOT: optimiser vos application pour le JIT et GraalVM

Transcript

1. Micronaut AOT Optimizing your apps for the JIT and GraalVM Cédric Champeau Micronaut Developer Oracle Labs
2. • Working at Oracle Labs on Micronaut • Main focus on build plugins and dev productivitity • Formerly working at Gradle Inc • Author of static compiler of Groovy • Amateur astronomer • @CedricChampeau • https://www.astrobin.com/users/melix/ About me Copyright © 2021, Oracle and/or its affiliates micronaut.io github.com/micronaut-projects/micronaut-core
3. • Micronaut is focused on modern architectures like Serverless and Microservices • Also a complete framework for any type of application • Lightweight, reactive (HTTP Client/Server based on Netty) • Annotation processor to compute framework infrastructure at compile time Micronaut Copyright © 2021, Oracle and/or its affiliates micronaut.io github.com/micronaut-projects/micronaut-core
4. Micronaut = Build Time Framework Infrastructure Copyright © 2021, Oracle and/or its affiliates Micronaut computes: • All dependency & configuration injection • Annotation metadata, meta-annotations • AOP proxies • Bean introspections • And all other framework infrastructure • Reflection, runtime proxy, and dynamic classloader free
5. GraalVM Copyright © 2021, Oracle and/or its affiliates • High-performance JDK distribution • Increases application throughput, reduces latency, reduces memory use • Graal just-in-time (JIT) compiler that runs on top of HotSpot, written in Java • native-image ahead-of-time (AoT) compiler compiles Java applications into small self- contained native binaries graalvm.org github.com/graalvm/graalvm-demos oracle.com/graalvm
6. Micronaut GraalVM ♥️ Copyright © 2021, Oracle and/or its affiliates • Micronaut + GraalVM Native Image are a match made in heaven • Less work to configure Native Image because Micronaut eliminates reflection, runtime proxies, bytecode generation and dynamic classloading • Startup time 20ms and Memory Consumption 18MB! ♥️
7. Demo: your first Micronaut app Copyright © 2022 8
8. Copyright © 2022, Oracle and/or its affiliates 9
9. Copyright © 2022, Oracle and/or its affiliates 10
10. Copyright © 2022, Oracle and/or its affiliates 11
11. Micronaut AOT Copyright © 2021, Oracle and/or its affiliates 12
12.  Optional extension to the Micronaut framework  Available via build tool plugins (Gradle, Maven or CLI invocation)  Performs deployment optimizations  Generates an application which is tailored to a particular deployment environment  Generates distinct optimizations for the “regular” JVM (aka “JIT mode”) or native (aka “GraalVM”)  Can optimize  CLI applications  HTTP applications  Functions (currently tested with AWS Lambda and Oracle Cloud Functions, Azure coming) Micronaut AOT Copyright © 2022, Oracle and/or its affiliates 13
13. Demo: optimizing your Micronaut app Copyright © 2022, Oracle and/or its affiliates 14
14. Copyright © 2022, Oracle and/or its affiliates 15 Add the Micronaut AOT plugin Configure optimizations
15. Copyright © 2022, Oracle and/or its affiliates 16
16. Copyright © 2022, Oracle and/or its affiliates 17
17. Copyright © 2022, Oracle and/or its affiliates 18
18. Micronaut AOT Copyright © 2022, Oracle and/or its affiliates 19
19. Building an application without Micronaut AOT Copyright © 2022, Oracle and/or its affiliates 20 Sources (.java, .groovy, .kt) class files javac + Annotation processing Resources (.yaml, .properties) Jar file packaging packaging Native binary native-image
20. Building an application with Micronaut AOT Copyright © 2022, Oracle and/or its affiliates 21 jar file (or classes + resources) class files AOT jar file Native AOT binary native-image Resource files Source files Metadata filtering AOT analysis
21.  Optimizing service loading  pre-scans META-INF/service files (for some core types) and generates classes which avoid the use of service loader and permits parallel loading  Generated loaders are different in JIT and native!  Converting YAML files to Java  Avoids parsing YAML files at application startup  Reduces the size of the generated native binary  Caching the environment  Once the application is started, all environment variables and system properties are deemed immutable  Pre-computing bean requirements  Evaluates @Requires conditions at build time instead of runtime  Reduces the size of the generated native binary Micronaut AOT Core Optimizations Copyright © 2022, Oracle and/or its affiliates 22
22. public class StaticServicesLoader implements StaticOptimizations.Loader<SoftServiceLoader.Optimizations> { @Override public SoftServiceLoader.Optimizations load() { Map<String, SoftServiceLoader.StaticServiceLoader<?>> staticServices = new HashMap<String, SoftServiceLoader.StaticServiceLoader<?>>(); staticServices.put("io.micronaut.context.env.PropertySourceLoader", new PropertySourceLoaderFactory()); staticServices.put("io.micronaut.http.HttpResponseFactory", new HttpResponseFactoryFactory()); staticServices.put("io.micronaut.inject.BeanDefinitionReference", new BeanDefinitionReferenceFactory()); staticServices.put("io.micronaut.core.beans.BeanIntrospectionReference", new BeanIntrospectionReferenceFactory()); staticServices.put("io.micronaut.inject.BeanConfiguration", new BeanConfigurationFactory()); staticServices.put("io.micronaut.http.HttpRequestFactory", new HttpRequestFactoryFactory()); return new SoftServiceLoader.Optimizations(staticServices); } } Micronaut AOT: Code generation Copyright © 2022, Oracle and/or its affiliates 23
23.  Optimizing classloading  Performs Class#forName at build time to avoid ClassNotFoundException at run time  Deducing the environment at build time  Performs the “environment deduction” (AWS, Google Cloud, …) at build time instead of run time  Precomputing “expensive operations”  Pre-computes some constants at build-time instead of run time  For example, the mapping between environment variable names and Micronaut properties  (Experimental) Converting logback.xml to Java configuration  Avoids loading the XML parsing library at application startup Micronaut AOT Core Optimizations Copyright © 2022, Oracle and/or its affiliates 24
24.  Faster startup time  10% faster, sometimes more depending on your context  Smaller native images  By substitution, some classes are not reachable anymore  Results depend on the transitive dependency graph  Improved time to first request  Module specific optimizations can access resources at build time Micronaut AOT: what benefits to expect? Copyright © 2022, Oracle and/or its affiliates 25
25. graalvmNative { binaries.all { // profiling buildArgs.add("-H:-DeleteLocalSymbols") buildArgs.add("-H:+PreserveFramePointer") } } Micronaut AOT: profiling native applications Copyright © 2022, Oracle and/or its affiliates 26
26. Micronaut AOT: example impact on native Copyright © 2022, Oracle and/or its affiliates 27
27. Micronaut AOT: example impact on native Copyright © 2022, Oracle and/or its affiliates 28
28.  Micronaut Serialization  Provides compile-time databinding  Replacement for Jackson Databind  Runtime can use Jackson, BSON or JSON-P Impact on image size Copyright © 2022, Oracle and/or its affiliates 29
29.  Micronaut AOT supports plugins  Plugins are “source generators” which get access to the application context  Generated code can inject optimizations into Micronaut via dedicated API  Plugins contribute new optimizations  Eg: Micronaut Security can fetch OpenID metadata configuration from remote at build time. Can save up to 1s at the first request!  Code generators execute within the context of the target application! Micronaut AOT extensibility Copyright © 2022, Oracle and/or its affiliates 30
30. Micronaut AOT extensibility Copyright © 2022, Oracle and/or its affiliates 31 @Override public void generate(@NonNull AOTContext context) { context.registerStaticOptimization("KnownMissingTypesOptimizationLoader", ClassUtils.Optimizations.class, body -> { List<String> classNames = context.getConfiguration().stringList(OPTION.key()); body.addStatement("$T knownMissingTypes = new $T()", ParameterizedTypeName.get(Set.class, String.class), for (String knownMissingClass : findMissingClasses(classNames)) { body.addStatement("knownMissingTypes.add($S)", knownMissingClass); } body.addStatement("return new $T(knownMissingTypes)", ClassUtils.Optimizations.class); }); } private List<String> findMissingClasses(List<String> classNames) { List<String> knownMissingClasses = new ArrayList<>(); ClassLoader cl = this.getClass().getClassLoader(); for (String name : classNames) { try { cl.loadClass(name); } catch (ClassNotFoundException | NoClassDefFoundError e) { knownMissingClasses.add(name); } } return knownMissingClasses; } This happens in user application context
31.  Micronaut is a modern framework which uses build-time optimizations • Use of annotation processing for generating metadata, avoiding reflection, …  Micronaut AOT complements the approach • Not everything can be done by annotation processing • Substitution of classes/resources • Parsing configuration files • Sensitive to the build environment and therefore sensitive to the deployment environment Conclusion Copyright © 2022, Oracle and/or its affiliates 32
32.  Micronaut Website • https://micronaut.io  Micronaut Launch • Bootstrap your Micronaut apps: https://micronaut.io/launch  Micronaut AOT • Documentation: https://micronaut-projects.github.io/micronaut-aot/latest/ • Gradle plugin: https://micronaut-projects.github.io/micronaut-gradle-plugin/latest/#_micronaut_aot_plugin • Maven plugin: https://micronaut-projects.github.io/micronaut-maven-plugin/latest/examples/aot.html  GraalVM Community Edition • https://www.graalvm.org/ Links Copyright © 2022, Oracle and/or its affiliates 33
33. Copyright © 2022, Oracle and/or its affiliates 34 Thank you! Slides coming at @CedricChampeau