AI Chat App Hack: Continuous Deployment of your Chat App

Transcript

3. Continuous Deployment of RAG Chat Apps
4. RAG chat app aka.ms/ragchat https://github.com/Azure-Samples/azure-search-openai-demo/ Search results + Chat Completion = Answer with citations
5. Azure architecture for RAG chat app Azure Storage Document Intelligence Integrated vectorization or Local script Azure OpenAI Azure AI Search Uploads PDF pages Computes embeddings Stores in index Extracts data from PDFs DATA INGESTION Splits data into chunks Python Azure OpenAI Azure App Service or Local server Azure Storage CHAT APP Azure AI Search
6. Manual deployment
7. Deploying with azd Use azd command (Azure Developer CLI) to easily get an app up on Azure.
8. Project setup for azd azure.yamlto specify the azd project and app metadata app/ with web application code Bicep files to provision Azure resources
9. azd commands Provision resources azd provision Deploy application code: azd deploy Do both! azd up
10. Continuous deployment
11. Goal Deploy to Azure on push, using a CI platform like GitHub Actions or Azure DevOps https://github.com/Azure-Samples/azure-search-openai-demo/pull/1083 aka.ms/ragchat/workflow
12. Setting up a GitHub workflow Add workflow file for GitHub actions: azd pipeline config .github/workflows/azure-dev.yaml Run command to configure all necessary Actions variables: Make sure all necessary variables/secrets are declared in azure.yaml: pipeline: variables: - AZURE_OPENAI_SERVICE …
13. Customizing azd environment variables If you previously did… azd env set VAR_NAME value azure.yaml knows which ones to sync and azure-dev.yaml knows about existing environment variables. When you set any azd env variables, re-run to sync new values: azd pipeline config
14. Adding new azd environment variables env: AZURE_SUBSCRIPTION_ID: $(AZURE_SUBSCRIPTION_ID) NEW_VAR_NAME: $(NEW_VAR_NAME) Add them to your workflow env: Add to azure.yaml: When you change any azd env variables, re-run: azd pipeline config pipeline: variables: - NEW_VAR_NAME …
15. Using continuous deployment today Either merge this PR or wait for it to get merged next week: Then configure the workflow: azd pipeline config https://github.com/Azure-Samples/azure-search-openai-demo/pull/1083 aka.ms/ragchat/workflow
16. Next steps • Register for the hackathon → • Introduce yourself in our discussion forum • Deploy the repo with the sample data • See steps on low cost deployment → • Hack, hack, hack, hack! • Post in forum if you have any questions. • Submit your project before February 12th to win prizes! • Join tomorrow’s sessions from MVPs! aka.ms/hacktogether/chatapp aka.ms/ragchat/free