Copilot not updating values with the set_value tool

[OwainJ]

Which component is this issue related to?

Umbraco.AI (Core)

Which Umbraco AI version are you using? (Please write the exact version, example: 10.1.0)

1.10.0

Bug summary

When asking the Umbraco Copilot agent to update a field, it invokes the set_value tool but the property value is not changed.

Specifics

I first asked it to suggest a title for the page, then asked it to update the title field:

It invoked the set_value tool, but the property did not update.

So instead asked it to update the field by explicitly referencing the field's alias:

But again, the property did not update.

There are no errors in my browser console, and nothing seemingly useful in the Umbraco log (with Umbraco.AI set as Debug level)

I'm using Azure AI Foundry, and enabled all Allowed Tool Scopes and all Allowed Tools in the Umbraco AI Agent configuration.

My field is a property on a composition and has the alias heroBannerTitle with the label Title.

Steps to reproduce

1. Install Umbraco.AI, Umbraco.AI.MicrosoftFoundry, and Umbraco.AI.Agent.Copilot packages
2. Setup the connection, profile and an Agent
3. Navigate to a page and ask the Agent to update a field.

Expected result / actual result

No response

Dependencies

No response

[mattbrailsford]

Known issue that we are aiming to address once 17.4.0 is released See https://mattbrailsford.dev/why-umbraco-1740-is-a-big-deal-for-ai for more details.

I'll close this issue in the meantime.

[OwainJ]

Awesome, cheers Matt!