Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Improve LLM-based Applications with Fallback Me...

Improve LLM-based Applications with Fallback Mechanisms

While RAG addresses the common LLM pitfalls, challenges like handling out-of-domain queries still persist. Learn the significance of fallback mechanisms to tackle these issues gracefully, incorporating strategies like web searches and alternative data sources to improve the user experience of your system. In this session, we’ll discover various fallback techniques and practical implementation using Haystack, empowering you to develop resilient LLM-based systems for diverse scenarios without human intervention.

Talk details: https://pretalx.com/pyconde-pydata-2024/talk/QCNXLW/

Bilge Yücel

April 24, 2024
Tweet

More Decks by Bilge Yücel

Other Decks in Technology

Transcript

  1. About me •🥑 Developer Relations Engineer at deepset •🏗 Open

    source LLM Framework: Haystack •📍 Istanbul, Turkey •💃 Latin music/dances Bilge Yücel @bilgeycl Bilge Yücel
  2. • Haystack is an open source framework for building production-ready

    LLM applications • It lets you quickly try out the latest AI models while being flexible and easy to use
  3. • Haystack is an open source framework for building production-ready

    LLM applications • It lets you quickly try out the latest AI models while being flexible and easy to use • Building blocks: Components & Pipelines
  4. RAG Pipeline When is Taylor Swift’s next concert? The documents

    do not provide any information about Taylor Swift's upcoming concert.
  5. Fallback to Web When is Taylor Swift’s next concert? Based

    on the documents retrieved, Taylor Swift's upcoming concert is on May 9-12 in Paris at the Paris La Defense arena.
  6. • Events lu.ma/haystack • X (Twitter) @Haystack_AI • YouTube @Haystack_AI

    @bilgeycl Bilge Yücel 🔗Haystack GitHub 🔗Haystack Website 🔗Discord community