Virtual Threads, Structured Concurrency and Scoped Values: Putting it all together

Transcript

1. Balkrishna Rawool Virtual Threads, Structured Concurrency and Scoped Values: Putting it all together 22 May 2025
3. 3 Balkrishna Rawool IT Chapter Lead, ING Bank @BalaRawool
4. 4 Project Loom Purpose: Ø Supporting easy-to-use, high-throughput lightweight concurrency and new programming models for it Features: Ø Virtual Threads – Final in JDK 21 Ø Structured Concurrency – Preview Ø Scoped Values – Final in JDK 25
5. Virtual Threads
6. 6 Platform Threads and Virtual Threads JVM OS Platform Threads Platform Threads: Ø Thin wrapper over OS threads Ø One-to-one mapping with OS threads Ø Thread pools Virtual Threads Virtual Threads: Ø Lightweight user threads Ø Highly scalable Ø No need for pooling
7. 7 Virtual Thread Scheduler Platform/ Carrier Thread Virtual Threads
8. A simple web-app with virtual threads
9. 9 A simple web-app with virtual threads Ø SpringBoot App Ø SpringBoot 3.4 Ø JDK 25 (Project Loom early access build) Ø Domain: Banking Ø Name: A Bank
10. Structured Concurrency
11. 11 Virtual threads enable Structured Concurrency
12. 12 Programs à Structured Programming Concurrent programs à Structured Concurrency
13. 13 Structured Concurrency: Examples All these examples can be implemented using StructuredTaskScope API.
14. 14 Structured Concurrency: Continued Principle: Ø When flow of execution splits into multiple concurrent flows, they rejoin in the same code block Benefits: Ø Error handling with short-circuiting Ø Cancellation propagation Ø Clarity Ø Observability
15. Structured Concurrency API
16. 16 Feature: Loan application Ø Customer applies for loan Ø Get customer details Ø Using customer details Ø Get accounts Ø Get loans Ø Get external credit scores Ø Two services provide this score Ø Response from one is enough Ø Aggregate all this info and send to offer-calculation service
17. 17 Feature: Loan application Get Customer Details Get Account Details Get Loan Details Get Credit Score Calculate Offer Get Credit Score Get Credit Score 1 Get Credit Score 2
18. Scoped Values
19. ThreadLocal 19 Ø Each thread gets its own copy of the object. Ø Useful for Ø Request/session-specific data Ø Resource management (of non-thread-safe objects) Ø Caching Ø Observability (e.g. CorrelationID) Ø VirtualThread-s support ThreadLocal-s. Ø Problems Ø Unconstrained mutability Ø Unbounded lifetime Ø Expensive inheritance (with InheritableThreadLocal)
20. Scoped Values 20 Ø Immutable Ø All (allowed) threads use the same copy Ø Inherited through the StructuredTaskScope to the child-virtual-threads Ø Bounded by the scope ScopedValue VALUE = ScopedValue.newInstance(); ScopedValue.where(VALUE, someValue) .run(() -> {...});
21. Scoped Values API
22. 22 Source code and contact @balarawool.bsky.social /balkrishnarawool Please rate the talk :)
23. www.ing.com Thank you!