The Query Fan-Out Session: Essentials for Server-side Query Fan-Out Tracking

A Query Fan-Out Session is a bundle of web requests from an LLM chat assistant that originated from a single user question.

My research analyzed the timing patterns of LLM bot requests, to find the ideal time window to group LLM requests of ChatGPT-user for better LLM activity reporting.

Transcript