Microsoft apps AI orchestration Your data Foundation models & AI toolchain AI infrastructure Microsoft Cloud Microsoft Copilot Architecture with TAS User prompt Data flow ( = all requests are encrypted via HTTPS and wss://) User prompts are sent to Copilot 1 Microsoft 365 Service Boundary 1 Pre-processing Grounding 2 Dataverse + Power Platform Services Bing Plug-ins Microsoft Graph Your context and content (emails, files, meetings, chats, calendars, and contacts) Customer Microsoft 365 Tenant Copilot accesses Graph + (optional) Web + Other services for grounding 2 Modified prompt 3 Large Language Model RAI is performed on input prompt and output results RAI Prompts, responses, and grounding data aren’t used to train foundation models Azure OpenAI Azure OpenAI instance is maintained by Microsoft. OpenAI has no access to the data or the model Copilot sends modified prompt to Large Language Model (LLM) 3 LLM response 4 Copilot receives LLM response 4 Copilot accesses Graph for Compliance and Purview 5 Compliance and Purview Post-processing 5 3 Copilot sends the response back to the user 6 Copilot response back to the user 6 Technosoft Automotive Solution