Error handling in agent service connected with Open Api tool

[lukaszkiszka]

Technical Feedback

I have agent connected to API by Open Api tools and I have problem with handle api errors correctly.

When API returns error response (http status 4XX, 5XX) in payground I see error message like:

But when I call agent by SDK and error occurs then I not see error in SDK - agent returns in response the same message as I passed in input.

When API error occurs In thread log I not seen "run" object under "thread":

In this case I can not use agent instructions for force better response when error occurs. I think cause of this is that run in thread was broken.

Next problem is with error body response - in output from openapi tool I see only http code, I not see whole response body:

output: "content_type='system_error' name='AzureAgentToolUserError' text='HTTP error 404: Not Found'"

Desired Outcome

1. Better error handling in Open API tool would not interrupt threads and in agent instruction I can force better answer when error occurs.
2. When API returns error (http status 4XX, 5XX) agent can see error response (not only http status).

Current Workaround

Create API, where return only HTTP status 200, and inside response use field status for control that response is correct or error.

Depend on field status returns one from fields: successResponse - only if response is correct, and errorResponse - only if response is error.

[lindazqli]

hey @lukaszkiszka thanks for the feedback. we are working to improve the error handling and surfacing on our side. is the OpenAPI spec issue resolved for you?

[lukaszkiszka]

I'm glad to hear that you are working on error handling.

I applied workaround - my system returns http status 200 for both: error and correct responses. In response body I have status flag with values: ERROR, OK.
Depends on flag status agent interpreted responses as correct or error response.