Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Spring Native Applications - Combining Spring a...

Spring Native Applications - Combining Spring and GraalVM Native Image Technology

Martin Lippert

November 05, 2020
Tweet

More Decks by Martin Lippert

Other Decks in Programming

Transcript

  1. ©2020 VMware, Inc. Spring Native Applications Combining Spring and GraalVM

    native image technology Martin Lippert Spring Tools Lead, MAPBU, VMware November 2020 (based on work by Sébastien Deleuze, Andy Clement, and others)
  2. ©2020 VMware, Inc. https://graalvm.org/: High-performance polyglot VM Basic idea: •

    One virtual machine that can execute all languages (Java, JavaScript, R, Ruby, Python, C, C++, Kotlin, Scala, etc.) • You can run all those languages without any boundaries between them 2 What is GraalVM ?
  3. ©2020 VMware, Inc. 3 GraalVM overview Java Scala Kotlin JavaScript

    Ruby R Python C++ WebAssembly OpenJDK NodeJS Oracle Database MySQL Native GraalVM
  4. ©2020 VMware, Inc. 4 GraalVM overview Java Scala Kotlin JavaScript

    Ruby R Python C++ WebAssembly OpenJDK NodeJS Oracle Database MySQL Native GraalVM 4 GraalVM overview This piece of the project is our focus here
  5. ©2020 VMware, Inc. 5 What is GraalVM Native Image technology?

    static analysis AOT compilation + snapshotting intermediate model Your Java code JDK SubstrateVM Binary Compiled Code Initial Heap
  6. ©2020 VMware, Inc. 7 Two main benefits Reduced memory consumption

    Instant startup Scale to zero You only pay when your application is used Serverless for any kind of workload including regular web applications Good fit with platforms like Knative 3x to 5x memory reduction (RSS) Cheaper cloud instances Critical with systems split into multiple microservices
  7. ©2020 VMware, Inc. 8 Trace-offs 0 20 40 60 80

    100 Startup Memory footprint Latency / Throughput Maturity Build JVM Native
  8. ©2020 VMware, Inc. • Static analysis of your application from

    the main entry point • Configuration required for: • Reflection • Proxies • Resources • Classpath fixed at build time • No class lazy loading • Some code will run at build time 9 Key differences between JVM and Native
  9. ©2020 VMware, Inc. Compiling your application to a native executable

    requires configuration (reflection/proxy/resources) 16
  10. ©2020 VMware, Inc. Our goal is to support compilation of

    existing or new Spring Boot applications to native executables. Unchanged. 18
  11. ©2020 VMware, Inc. “We are excited about the great partnership

    between the Spring and GraalVM engineering teams to support native ahead-of-time compilation for millions of Spring Boot applications. This is a game changer enabling low memory footprint and instant startup for these workloads.” Thomas Wuerthinger, GraalVM founder & project lead 19 Collaboration between the Spring and GraalVM teams
  12. ©2020 VMware, Inc. 20 Leverage the Spring Boot container image

    support > mvn spring-boot:build-image or > gradle bootBuildImage
  13. ©2020 VMware, Inc. @SpringBootApplication(proxyBeanMethods = false) public class DemoApplication {

    public static void main(String[] args) { SpringApplication.run(DemoApplication.class, args); } } 26 Update configuration to avoid using proxies
  14. ©2020 VMware, Inc. <plugin> <groupId>org.springframework.boot</groupId> <artifactId>spring-boot-maven-plugin</artifactId> <configuration> <image> <builder>paketobuildpacks/builder:tiny</builder> <env>

    <BP_BOOT_NATIVE_IMAGE>1</BP_BOOT_NATIVE_IMAGE> <BP_BOOT_NATIVE_IMAGE_BUILD_ARGUMENTS> -Dspring.native.remove-yaml-support=true -Dspring.spel.ignore=true </BP_BOOT_NATIVE_IMAGE_BUILD_ARGUMENTS> </env> </image> </configuration> </plugin> 27 Configure Maven plugin
  15. ©2020 VMware, Inc. > mvn spring-boot:build-image Successfully built image 'docker.io/library/demo:0.0.1-

    SNAPSHOT' Total time: 60 s 29 Build the native application • No need for a GraalVM native local install • Build happens in a container • And produces a container
  16. ©2020 VMware, Inc. > docker run -p 8080:8080 docker.io/library/demo:0.0.1-SNAPSHOT .

    ____ _ __ _ _ /\\ / ___'_ __ _ _(_)_ __ __ _ \ \ \ \ ( ( )\___ | '_ | '_| | '_ \/ _` | \ \ \ \ \\/ ___)| |_)| | | | | || (_| | ) ) ) ) ' |____| .__|_| |_|_| |_\__, | / / / / =========|_|==============|___/=/_/_/_/ :: Spring Boot :: Started application in 0.05 seconds (JVM running for 0.009) 30 Run the native application
  17. ©2020 VMware, Inc. <plugin> <groupId>org.graalvm.nativeimage</groupId> <artifactId>native-image-maven-plugin</artifactId> <version>20.2.0</version> <configuration> <mainClass>com.example.demo.DemoApplication</mainClass> <buildArgs>-Dspring.native.remove-yaml-support=true

    -Dspring.spel.ignore=true</buildArgs> </configuration> <executions> <execution> <goals> <goal>native-image</goal> </goals> <phase>package</phase> </execution> </executions> </plugin> <plugin> <groupId>org.springframework.boot</groupId> <artifactId>spring-boot-maven-plugin</artifactId> </plugin> 32 Configure Maven plugin in a native profile
  18. ©2020 VMware, Inc. > mvn -Pnative clean package Total time:

    60 s 33 Build the native application • Need for a GraalVM native local install • Build happens directly on your host (Linux, Mac and Windows are supported) • Produces a native executable • No cross compilation
  19. ©2020 VMware, Inc. > target/com.example.demo.demoapplication . ____ _ __ _

    _ /\\ / ___'_ __ _ _(_)_ __ __ _ \ \ \ \ ( ( )\___ | '_ | '_| | '_ \/ _` | \ \ \ \ \\/ ___)| |_)| | | | | || (_| | ) ) ) ) ' |____| .__|_| |_|_| |_\__, | / / / / =========|_|==============|___/=/_/_/_/ :: Spring Boot :: Started application in 0.05 seconds (JVM running for 0.009) 34 Run the native application
  20. ©2020 VMware, Inc. 35 Petclinic Sample On the JDK Native

    application petclinic- jdbc Build: Memory(RSS): Startup time: 9s 417M 2.6s Build: Memory(RSS): Startup time: 194s 101M 0.158s +2050% -75% -94%
  21. ©2020 VMware, Inc. 36 More progress being made… Sample SpringOne

    2019 SpringOne 2020 commandlinerunner Build: Exec. size: Memory(RSS): 90s 48M 29M Build: Exec. size: Memory(RSS): 50s 22M 24M -45% -55% -17% webflux-netty Build: Exec. size: Memory(RSS): 193s 81M 95M Build: Exec. size: Memory(RSS): 79s 43M 47M -60% -47% -50% webmvc-tomcat Build: Exec size: Memory(RSS): 203s 105M 70M Build: Exec. size: Memory(RSS): 67s 42M 51M -67% -60% -27%
  22. ©2020 VMware, Inc. • Create a META-INF/native-image/resource-config.json file • Wildcard

    patterns can be used • Similar config for reflection and proxies • See GraalVM documentation for more details 38 For example additional resources { "resources": [ { "pattern": "myresource.*" } ], "bundles": [ { "name": "your.pkg.Bundle" } ] }
  23. ©2020 VMware, Inc. • An agent can assist in generating

    these files, available with GraalVM java -Dorg.graalvm.nativeimage.imagecode=agent -agentlib:native-image-agent=config-output-dir=META-INF/native-image Demo • Agent has improved greatly during 2020, thanks to the GraalVM team • Run application with agent attached to produce .json files • Exercise all code paths (manually or via tests) - producing (merging) many of these collected configurations 39 Tracing agent to collect necessary information
  24. ©2020 VMware, Inc. 43 Incubator for GraalVM native support in

    Spring https://github.com/spring-projects-experimental/spring-graalvm-native
  25. ©2020 VMware, Inc. • Incubating Spring Boot native application support

    • It includes a plugin for the GraalVM native image builder • Analyses the Spring Boot application at build time • Computes the most optimal native image configuration • Challenge is doing that with static analysis • Also perform some build time transformation for: • Optimized footprint • Compatibility 44 spring-graalvm-native
  26. ©2020 VMware, Inc. • GraalVM 20.2 baseline • Use Spring

    Boot 2.4.0 latest milestone (2.4.0-RC1) • Significant footprint improvements • Wider range of supported technology • New experimental functional mode • Spring Boot lightweight container integration • Maven • Gradle 45 We have just released 0.8.2
  27. ©2020 VMware, Inc. • Actuator • Cache • Data JPA,

    MongoDB, R2DBC, Redis • JDBC • Logging (Logback) • Thymeleaf • Validation • Web (Spring MVC with Tomcat) • Webflux (Netty) • Wavefront • Spring Cloud Function 46 Starters supported in 0.8.x
  28. ©2020 VMware, Inc. 48 Timeline GraalVM fixes and improvements Spring

    Boot support Incubating support in spring-graalvm- native We are here
  29. ©2020 VMware, Inc. • First release with beta support •

    Spring Boot 2.4.0 and GraalVM 20.3 baseline • Subset of starters supported • Breaking change will happen (with upgrade paths) • Wider support • Spring Security • Spring Batch • Development-oriented container image 50 spring-graalvm-native 0.9.0 (December 2020)
  30. ©2020 VMware, Inc. Spring Boot 3, based on Spring Framework

    6, is expected to provide first-class support for native application deployment, as well as an optimized footprint on the JVM. 52