GOING AOT WITH GRAALVM FOR JAVA - JAVAZONE
Download as PPTX, PDF0 likes198 views
GOING AOT WITH GRAALVM FOR JAVA - JAVAZONE
More Related Content
Similar to GOING AOT WITH GRAALVM FOR JAVA - JAVAZONE (20)
Recently uploaded (20)
GOING AOT WITH GRAALVM FOR JAVA - JAVAZONE
- 1. Alina Yurenko Developer Advocate for GraalVM Oracle JavaZone Going AOT: Everything you need to know about GraalVM for Java applications Photo by Andrea Brataas on Unsplash
- 2. ? Alina Yurenko / @alina_yurenko ? Developer Advocate for GraalVM at Oracle ? Love open source and communities ? ? Love both programming ?? ? & natural languages ? ?? About me @alina_yurenko
- 3. GRAALVM
- 4. An advanced JDK with ahead-of-time Native Image compilation
- 5. native-image MyMainClass ./mymainclass JIT AOT java MyMainClass
- 6. 2017 Year 2018 2019 2020 2021 2022 2023 2005 2011 ... ... Sun Labs¡¯ Maxine Java JVM initial release December Native Image open sourced April Twitter uses Graal JIT for core microservices October Micronaut 1.0 with Native Image support April GraalVM 1.0 released April Thomas Wuerthinger joins Oracle and starts Graal compiler project March Spring Native goes beta November Quarkus 1.0 with Native Image support May GraalVM goes GA (19.0 release) September MicroDoc announces GraalVM for embedded July Alibaba deploys Native Image in production July Facebook deploys GraalVM in production May AWS SDK support for Native Image November Spring Boot 3 with Native Image support December OpenJDK Galahad project proposed July Google Cloud Platform SDK support for Native Image June GraalVM Free Terms and Conditions license September GraalOS & Layered Native Image announced March Azure SDK support for Native Image September Oracle Cloud runs services on GraalVM Graal History ? ? ? ? @alina_yurenko
- 7. GraalVM Native Image AOT Compilation Ahead-of-Time Compilation Application Libraries JDK Substrate VM Points-to Analysis Run Initializations Heap Snapshotting Input: All classes from application, libraries, and VM Code in Text Section Image Heap in Data Section Image Heap Writing Output: Native executable @alina_yurenko
- 8. DEMO ?
- 9. GraalVM Native Image¡ªFast Start Up and Much More Improved Security Fast Start & Scale Lower Resource Usage Compact Packaging Predictable Performance Supported Azure AWS GCP OCI @alina_yurenko
- 11. NATIVE IMAGE BUILD-TIME DISCOVERY AND CONFIGURATION SPRING BOOT RUN-TIME DISCOVERY AND CONFIGURATION
- 12. SPRING BOOT NATIVE IMAGE SPRING AOT
- 13. SPRING AOT
- 14. SPRING AOT JAVA SOURCE FILES BYTECODE HINT FILES
- 15. MORE DEMOS:)
- 16. Libraries, dynamic Java features, and Native Image ? Libraries might be Native-Image friendly out of the box ? twitter.com/YunaMorgenstern/status/1729039787351536084 ? Libraries might include config for Native Image: ? github.com/h2database/h2database/blob/master/h2/src/main/META-INF/native-image/ ? Libraries might contain config in the Reachability Metadata Repository ? github.com/oracle/graalvm-reachability-metadata/tree/master/metadata/io.netty ? You can use framework support to produce custom ¡°hints¡± for Native Image runtimeHints.resources().registerPattern(¡°config/app.properties¡±); ? You can use the Tracing Agent to produce the necessary config automatically ? graalvm.org/latest/reference-manual/native-image/metadata/AutomaticMetadataCollection/ ? You can provide/extend config for reflection, JNI, resources, serialization, and predefined classes manually in JSON: ? graalvm.org/latest/reference-manual/native-image/metadata/#specifying-metadata-with-json Happy path; most of the cases Custom code/ libraries @alina_yurenko
- 17. Ready for GraalVM Native Image graalvm.org/native-image/libraries-and-frameworks @alina_yurenko
- 18. PERFORMANCE
- 19. AOT at the speed of JIT ? ? Profile-guided optimizations Collect and use profiles at build time to optimize for the specific runtime behaviour of your application ? ML-enabled PGO Use a ML model to automatically predict the profile of the application ? G1 GC Optimize GC for peak throughput ? `-march=native` Optimize for the specific hardware features of the machine you¡¯ll be running on @alina_yurenko
- 20. Spring PetClinic: Peak throughput @alina_yurenko
- 21. Spring PetClinic: Memory Efficiency @alina_yurenko
- 22. Spring PetClinic Performance on Oracle GraalVM GraalVM CE with C2 JIT Oracle GraalVM Native Image Memory Usage (max RSS) 1,029 MB 641 MB Peak throughput 11,066 req/s 11,902 req/s Throughput per memory 12,488 req/(GB*s) 18,569 req/(GB*s) Tail latency (P99) 7.2ms 5.15ms Startup 7,090ms 210ms -38% lower +8% higher +49% better -28% lower 34x faster @alina_yurenko
- 23. BEST PRACTICES
- 24. Cross-Platform Builds on GitHub Actions Windows Executable macOS Executable Linux Executable .class .jar .class .jar GraalVM GitHub Action ? ?? @alina_yurenko
- 25. ? Reduced attack surface area due to dead code removal¡ª unused classes, methods, and fields not included in executable Improved Security ? Not vulnerable to JIT compiler attacks all code is AOT compiled ? SBOM supporting industry standards Embedded in executables CycloneDX format ? Not vulnerable to deserialization attacks via class loading¡ªexecutable includes only required and specified classes Reduced Attack Surface ? ?? @alina_yurenko
- 26. ? Migrate ? ? Add Native Build Tools ? Alternatively, use recent versions of frameworks ? Evaluate libraries: graalvm.org/native-image/libraries-and-frameworks ? Build and deploy ? ¡â? ? ? ? ¡â? ? ¡â? ? ¡â? ? ¡â? ? ¡â? ? ¡â? ? ¡â? ? ¡â? ? ¡â? ? ¡â? ? ¡â? ? ¡â? ? ¡â? ? Build and test on GraalVM as the JVM, build with Native Image closer to the deployment ? Quick build mode with `-Ob` ? Use CI/CD systems (e.g. GitHub actions) for deployment and cross-platform builds ? Run faster ? ? PGO ? ML-enabled PGO ? G1 GC ? `-march=native` Recommendations @alina_yurenko
- 27. WHAT¡¯S NEXT?
- 28. ? Java 22 features ? The fastest GraalVM yet :) ? Developer experience improvements Learn more: medium.com/graalvm GraalVM for JDK 22 ? @alina_yurenko
- 29. cwiki.apache.org/confluence/display/KAFKA/KIP-974%3A+Docker+Image+for+GraalVM+based+Native+Kafka+Broker Native Kafka Broker ? ? Average startup time is ~130ms; ? No CPU spike is observed for GraalVM; the JVM broker had sudden spikes when the broker started and also when the load testing started; ? For JVM broker the max memory usage went up to ~1GB. For GraalVM is was ~500MB with G1GC and ~250MB with serial GC.
- 30. Layered Native Images Micronaut base Micronaut extensions (Web, Data, Test) Spring base App 1 App 2 App 3 Deployment: resources sharing ?? JDK base Application code Development: fast recompilation ? JDK base + Micronaut base+ all extensions App 4 @alina_yurenko
- 31. GraalOS¡ªAdvanced cloud native application deployment platform Fast Start GraalOS applications start fast with virtually no cold start cost Low Latency Excellent 99th percentile latency makes GraalOS applications highly responsive Run On Demand GraalOS applications are automatically suspended and resumed on demand ¡ªwith no idle cost Applications, not Containers GraalOS uses the latest advances in x86 and AArch64 processor architectures for hardware enforced application isolation without containers Reduced Memory GraalOS applications require significantly less memory resulting in reduced operating costs Cloud Native With support for stateful and stateless services and functions, GraalOS is ideal for cloud native applications Runs applications as small, fast GraalVM Native Image compiled machine executables @alina_yurenko
- 32. Compact Packaging GraalVM Native Image¡ªIdeal for Cloud Native Applications Improved Security Fast Start & Scale Lower Resource Usage Predictable Performance Supported Azure AWS GCP OCI @alina_yurenko
- 33. graalvm.org sdk install java 22.0.1-graal Get started with GraalVM ? github.com/ graalvm/graalvm- demos docker pull container- registry.oracle.com/gr aalvm/jdk:22 @alina_yurenko
- 34. Questions & let¡¯s connect! Demos ? @alina_yurenko
- 35. Please rate this session!:) ?
Editor's Notes
- #37: What is GraalOS? ? GraalOS is a high performance serverless Java-based application deployment platform. It uses GraalVM Native Image to run your application as a native machine executable¡ªtaking full advantage of the latest x64 and AArch64 processor features available on Oracle Cloud Infrastructure (OCI). An application deployed to GraalOS will be less expensive to operate and help reduce your cloud costs. Fast Start A GraalOS application starts fast with virtually no ¡°cold start¡± cost. Unlike container-based platforms that suffer from significant cold start costs, a GraalOS application is a small native Linux executable that starts in 10s of milliseconds. Reduced Memory A GraalOS application requires significantly less memory thanks to GraalVM Native Image ahead-of-time (AOT) compilation. In turn, lower memory usage has a direct impact on your operating costs: pricing structures for most cloud services, including OCI Functions, have a significant memory usage element. GraalOS can typically reduce your application memory by at least 50%. Run On Demand A GraalOS application is automatically suspended and resumed when called¡ªwith no idle cost. Applications and functions that are not receiving requests are terminated on most serverless platforms after a timeout period has been exceeded. An application that is subsequently invoked is subject to a cold start cost. GraalOS¡¯s ability to suspend and rapidly resume your idle applications means no cold start. Applications, not Containers GraalOS runs native Linux executables directly¡ªtaking advantage of the latest advances in hardware-enforced application isolation. This approach removes the need to package your application into a container, which eliminates challenges such as selecting a secure container image and ensuring that the latest security patches are in place and updated regularly. Cloud Native With support for stateful and stateless microservices and functions, GraalOS is ideal for cloud native applications. Both short-lived functions and long-running microservices will benefit from GraalOS features such as virtually no cold start, transparent suspend and resume, and no cost idle. OCI Functions Powered by GraalOS? The first use of GraalOS is in OCI Functions: it will add a new ¡°Graal Function¡± type that will start much faster and require less memory than existing OCI functions. Thanks to the built-in OCI Functions triggers provided by OCI services such as Events, Connector Hub, Data Integration, API Gateway, and Notifications, all these services will be able to take advantage of GraalOS-powered functions with no changes. To learn more, see Rishikesh Palve¡¯s blog ¡°Ultra-fast Serverless Functions Powered by GraalOS¡±.