2025-02-20: Safety evaluations

This project now includes optional AI Safety evaluations, using an Azure AI Project and the Azure Azure AI evaluation SDK.
See documentation for instructons on running the evaluations.

What's Changed

• Upgrading openai and removing numpy dependency by @pamelafox in #2362
• Bump Azure/setup-azd from 2.0.0 to 2.1.0 in the github-actions group by @dependabot in #2366
• AI Safety evaluations (with AI Project provisioning) by @pamelafox in #2370

Full Changelog: 2025-02-13...2025-02-20

2025-02-13: Italian localization

The UI is now available in Italian, so the text will display in Italian if the user's browser is configured accordingly, or if the app has the language picker enabled and the user picks italian.

What's Changed

• Bump cryptography from 44.0.0 to 44.0.1 in /app/backend by @dependabot in #2354
• Improve locust test script by @tonybaloney in #2357
• Fix screenshot for Monitoring doc by @pamelafox in #2355
• Added support for italian language by @ivanvaccarics in #2356

New Contributors

• @ivanvaccarics made their first contribution in #2356

Full Changelog: 2025-02-11...2025-02-13

2025-02-11: Evaluation scripts and workflow

For a long time, we've directed developers to follow the steps in ai-rag-chat-evaluator to run evaluations on this app. To make it easier, we've now integrated evaluation directly into the repository, both as CLI scripts and GitHub Actions workflow.

Learn more from the evaluation guide or watch this video about evaluation.

What's Changed

• Make it easy to run evaluation directly from this repo by @pamelafox in #2233
• Use uv managed python in GHA workflows by @eifinger in #2342
• Evaluation workflow for GitHub Actions by @pamelafox in #2350

New Contributors

• @eifinger made their first contribution in #2342

Full Changelog: 2025-02-07...2025-02-11

2025-02-07: Upgrade gpt-35-turbo to 0125

Due to the impending deprecation of old gpt-35-turbo models, we upgraded our default version to 0125, the only remaining supported version. We will likely soon change the gpt-35-turbo to gpt-4o-mini, pending some evaluations.

What's Changed

• Default gpt-35-turbo to 0125 by @pamelafox in #2329

Full Changelog: 2025-01-29b...2025-02-07

2025-01-29b: New database schema for Cosmos DB

This release improves the database schema for the Cosmos DB chat history feature, based on discussions with the Cosmos DB team about avoiding excessively large document sizes. This is a breaking change, so if you already have the feature deployed, you'll need to do a full azd up to create the new container and deploy the new code, and users will not see past chat history.

If you want to migrate the past chat history to the new schema before deploying the change, please file an issue in the tracker, and we will write a migration script from the new container to the older container.

 ## What's Changed

• Improve schema of CosmosDB chat history to handle long conversations by @pamelafox in #2312

Full Changelog: 2025-01-29a...2025-01-29b

2025-01-29a: More options to customize OpenAI deployments

This release contains various bug fixes, plus two new environment variables for controlling Azure OpenAI deployments:

• AZURE_OPENAI_DISABLE_KEYS (which defaults to true, since this repository uses keyless authentication)
• AZURE_OPENAI_LOCATION for programmatically setting the OpenAI resource location, helpful for those of you using an existing Azure OpenAI resource.

See docs for more details.

What's Changed

• Fix ask prompts to allow prompt override/injection by @pamelafox in #2277
• Add environment variable to disable/enable keys by @pamelafox in #2280
• Fix cosmos Bicep configuration by @pamelafox in #2226
• Add content understanding to private endpoint by @pamelafox in #2225
• Adding a variable for OpenAI resource location by @pamelafox in #2292
• Clearer variables for image cropping code by @pamelafox in #2298
• Replace sparkle with app logo that's easier to replace by @pamelafox in #2299
• Note about ACA and app insights by @pamelafox in #2300
• Bump vite from 5.4.11 to 5.4.14 in /app/frontend by @dependabot in #2293
• Bump aiohappyeyeballs from 2.4.0 to 2.4.4 by @dependabot in #2288
• Bump pyjwt[crypto] from 2.9.0 to 2.10.1 by @dependabot in #2287
• Bump Azure/setup-azd from 2.0.0 to 2.1.0 in the github-actions group by @dependabot in #2310
• Bump i18next-browser-languagedetector from 8.0.0 to 8.0.2 in /app/frontend by @dependabot in #2271

Full Changelog: 2025-01-14...2025-01-29a

2025-01-14: Use Prompty for prompt management

This release uses Prompty (https://prompty.ai/) to store prompts, instead of storing them in Python strings.

All prompts are inside prompty files, stored in app/backend/approaches/prompts. The prompty file format has good support in the Microsoft ecosystem: you can use the VS Code Prompty extension to experiment with the prompts, and you can even upload the prompty files to the Chat playground in Azure AI Foundry.

This is a significant code change, so merge carefully. You will want to change your prompty files to match any customizations you made to your app's prompts.

Join us for tomorrow's live stream to learn more:
https://www.youtube.com/watch?v=D3slfMqydHc

What's Changed

• Use prompty to store prompts by @pamelafox in #2178

Full Changelog: 2025-01-13...2025-01-14

2025-01-13: Python 3.13 support

This release includes a number of dependency upgrades. Those upgrades mean you should now be able to use Python 3.13 for the local development environment on Mac, Windows, or Linux.

What's Changed

• Security Update with Bug Fixes by @john0isaac in #2232
• Update the docs and dev container based off recent feedback by @pamelafox in #2224
• Bump msgraph-sdk from 1.1.0 to 1.16.0 by @dependabot in #2254
• Bump the github-actions group with 2 updates by @dependabot in #2248
• Bump msgraph-core from 1.1.2 to 1.1.8 by @dependabot in #2245
• Bump cryptography from 43.0.1 to 44.0.0 by @dependabot in #2207
• Bump jinja2 from 3.1.4 to 3.1.5 in /app/backend by @dependabot in #2255
• Bump i18next from 23.16.5 to 24.2.0 in /app/frontend by @dependabot in #2247
• Update packages for better 3.13 support by @dependabot in #2238
• Bump azure-monitor-opentelemetry-exporter from 1.0.0b28 to 1.0.0b32 by @dependabot in #2169
• Bump @react-spring/web from 9.7.3 to 9.7.5 in /app/frontend by @dependabot in #2190
• Update README.md Resources with Learn article by @ms-johnalex in #2256
• Bump i18next-http-backend from 2.6.1 to 3.0.1 in /app/frontend by @dependabot in #2189
• Revert upgrade of msgraph-core SDK by @pamelafox in #2257
• Handle lack of support for docx/pptx/xlsx for media description by @pamelafox in #2260
• Bump mypy from 1.13.0 to 1.14.1 by @dependabot in #2267
• Bump regex from 2024.7.24 to 2024.11.6 by @dependabot in #2266
• Bump zipp from 3.20.0 to 3.21.0 by @dependabot in #2270

New Contributors

• @ms-johnalex made their first contribution in #2256

Full Changelog: 2024-12-09...2025-01-13

2024-12-09: Media description with Azure Content Understanding

This release adds a new optional feature for data ingestion that sends each figure in a document to Azure Content Understanding to generate a description. This is an alternative approach to our vision approach for handling documents with images, though it could even be used in conjunction with it.

For example, for this document:

The graph is replaced by this description:

The description is stored as HTML in the chunk, for maximal expressivity:

  <figure>
   <figcaption>Impact of Interest Rates, Inflation, and GDP Growth on Financial Markets<br>
   The line graph titled 'On Financial Markets' displays trends in Interest Rates, Inflation Data, and GDP Growth from 2018 to 2023. The x-axis represents the years, while the y-axis shows percentage values ranging from -5 to 5. Interest Rates start at 2% in 2018, dip to 1% in 2020, and rise to 2% by 2023. Inflation Data begins at 2%, peaks at 3% in 2022, and slightly decreases to 2.5% in 2023. GDP Growth shows a significant drop to -4% in 2020, recovers to 3% in 2021, and stabilizes at 2% by 2023.
    <table>
      <thead>
        <tr>
          <td>Year</td>
          <td>Interest Rates %</td>
          <td>Inflation Data %</td>
          <td>GDP Growth %</td>
        </tr>
      </thead>
      <tbody>
        <tr>
          <td>2018</td>
          <td>2</td>
          <td>2</td>
          <td>2</td>
        </tr>
        <tr>
          <td>2019</td>
          <td>2</td>
          <td>2.5</td>
          <td>1</td>
        </tr>
        <tr>
          <td>2020</td>
          <td>1</td>
          <td>1.5</td>
          <td>-4</td>
        </tr>
        <tr>
          <td>2021</td>
          <td>1.5</td>
          <td>2</td>
          <td>3</td>
        </tr>
        <tr>
          <td>2022</td>
          <td>2</td>
          <td>3</td>
          <td>2</td>
        </tr>
        <tr>
          <td>2023</td>
          <td>2</td>
          <td>2.</td>
        </tr>
      </tbody>
    </table></figure>

See the doc for enabling the feature:
https://github.com/Azure-Samples/azure-search-openai-demo/blob/main/docs/deploy_features.md#enabling-media-description-with-azure-content-understanding

Please try it out and give feedback.

What's Changed

• Add media description feature using Azure Content Understanding by @pamelafox in #2195

Full Changelog: 2024-12-02...2024-12-09

2024-12-02: Use built-in auth for Azure Container Apps

This release configures built-in auth for Azure Container Apps deployments when you enable the user login feature. Previously, we only supported built-in auth for App Service, so user login was handled entirely by the MSAL SDK for Azure Container Apps. Now, with built-in auth on ACA, the user will be prompted to login before they ever see the chat application, and the frontend will reuse the tokens from the built-in auth service.

If you have an already deployed app on Container Apps using the login feature, you may want to ask users to clear their localStorage and cookies to get the new login experience.

Here are screenshots of the new login experience-

Visiting the URL immediately redirects to the auth tenant login screen:

After successful login, it redirects back to the app, and the user sees their logged in email:

What's Changed

• let env var overrule .dot env setting by @cforce in #2136
• Lower case the ACA container registry name by @pamelafox in #2182
• Add support for symlinked files by @charris-msft in #2180
• Refactor the README to move advanced sections into docs by @pamelafox in #2165
• Fix Broken Links in azure_app_service.md by @jeannotdamoiseaux in #2186
• Bump astral-sh/setup-uv from 3 to 4 in the github-actions group by @dependabot in #2192
• Update path to chunking algorithm in data_ingestion.md by @cococ0j in #2204
• Configure built-in auth for Azure Container Apps by @pamelafox in #2205
• [Bugfix] The "send" button for chat should be enabled for logged in users by @jeannotdamoiseaux in #2202
• Remove empty origins for array version of CORS domains too by @pamelafox in #2210
• Move check for AZURE_PUBLIC_NETWORK_ACCESS by @pamelafox in #2209

New Contributors

• @cforce made their first contribution in #2136
• @cococ0j made their first contribution in #2204

Full Changelog: 2024-11-19b...2024-12-02