apidays Paris 2024 - Scaling LLM APIs: Integrating Load Testing Into Your CI/CD Pipeline, Samir Akarioh, Gatling

Scaling LLM APIs: Integrating Load Testing Into Your CI/CD Pipeline
Samir Akarioh, Developer Advocate at Gatling

apidays Paris 2024 - The Future API Stack for Mass Innovation
December 3 - 5, 2024

------

Check out our conferences at https://www.apidays.global/

Do you want to sponsor or talk at one of our conferences?
https://apidays.typeform.com/to/ILJeAaV8

Learn more on APIscene, the global media made by the community for the community:
https://www.apiscene.io

Explore the API ecosystem with the API Landscape:
https://apilandscape.apiscene.io/

Transcript

1. Scaling LLM APIs: Integrating Load Testing Into Your CI/CD Pipeline By Samir Akarioh Developer Advocate @Gatling 4 December, 2024 - ApiDays Paris
2. Ever experienced an overload subway?
3. It’s the same for your apps!
4. What we do at Gatling Demo Open-source version created in 2011 200,000+ businesses using us 20 millions+ downloads Empowering every teams to achieve reliable performance at scale Built in Developer-friendly SDKs in: Our singular approach: load-test-as-code It empowers developers to write, version, and automate load tests using code, bringing a level of flexibility, collaboration, and precision that traditional tools can’t match.
5. 2 steps of load testing with Gatling Demo A powerful interface with advanced features for realistic traffic simulation Our Enterprise edition Our Open-source solution to test your simulation locally Our Community edition
6. Key types of Load Tests Demo CAPACITY TEST STRESS TEST SOAK TEST See how your system handles spikes of traffic Learn about your app breakpoints and max capacity Find degradations over extended high use
7. Let’s dive into LLM APIs Demo
8. SSE: AI's Secret Sauce Demo Source: bunny.net
12. Demo time Demo
13. How to support us? Demo Star us on Github Start a free trial & give us your feedback
14. Scan time Demo