Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Real-World AI Patterns with Spring AI and Vaadin

Real-World AI Patterns with Spring AI and Vaadin

For the past few years, we have been experimenting with large language models (LLMs) and have discovered effective ways to integrate AI capabilities into Java applications. But how do we transition from experimentation to actual production adoption?
This talk will analyze the most common AI patterns used in real-world applications, complemented by live demos showcasing their implementation with Spring AI and Vaadin. You will learn how to:
Provide short-term and long-term memory to a large language model (LLM).
Integrate LLMs with your APIs through tool calling and build advanced agents.
Protect your AI workflows from prompt injection attacks and sensitive data leaks using guardrails.
Interact with models via text, image, audio, and video through multimodality.
Enhance the context provided to LLMs from your data using advanced retrieval techniques.
You will gain practical insights into how these patterns can be effectively integrated into your projects, with examples you can implement in your existing applications immediately, whether you are running your workloads on-premises or in the cloud.

Avatar for Thomas Vitale

Thomas Vitale

May 27, 2025
Tweet

More Decks by Thomas Vitale

Other Decks in Technology

Transcript

  1. Marcus Hellberg & Thomas Vitale Spring I/O 22nd May 2025

    Real-World AI Patterns With and @thomasvitale.com @marcushellberg.dev
  2. LLM Security Risks OWASP Top 10 for LLM 2025 OWASP

    Top 10 LLM Applications and Generative AI https://genai.owasp.org/ @marcushellberg.dev @thomasvitale.com Prompt Injection 1 Sensitive Information Disclosure 2 Insecure Output Handling 4
  3. Context Inference Service Request Response Retrieval Augmented Generation @marcushellberg.dev @thomasvitale.com

    Question Answer Application Augment with Context Vector Store Semantic Search
  4. Multimodality Inference Service Request Response Modalities and Structured Output @marcushellberg.dev

    @thomasvitale.com Question Answer Application Format Instructions Output Converter
  5. Structured Data Extraction Unstructured Text Application Inference Service Structured JSON

    Application Image/Audio/Video Model Structured JSON @marcushellberg.dev @thomasvitale.com
  6. Context Inference Service Request Tool Calling @marcushellberg.dev @thomasvitale.com Question Response

    Answer Application API Tool Call Tool Execution Tool Call Request Tool Call Response
  7. API MCP Server MCP Inference Service Request Tools @marcushellberg.dev @thomasvitale.com

    Question Response Answer Application Tool Call MCP Client Tool Call Request Tool Call Response