Skip to content

azure.ai.evaluation.evaluate Deserialization errors with azure_ai_project provided #39981

Open
@sebas-se

Description

@sebas-se
  • Package Name: azure-ai-evaluation
  • Package Version: 1.3.0
  • Operating System: macOS
  • Python Version: 3.11

Describe the bug
The bug occurs with a AI Foundry hub using a private endpoint connection. The call to azure.ai.evaluation.evaluate fails with a DeserializationError, as msrest.serialization.Deserialize is not initiated with the classes PrivateEndpointConnection, PrivateEndpoint, and PrivateLinkServiceConnectionState returned by LiteMLClient.workspace_get_info() during the evaluate() call.

To Reproduce
Steps to reproduce the behavior:

  1. Create an Azure AI Foundry Hub
  2. Create a private endpoint in the same rg
  3. Create a AI Foundry project
  4. Use this example to run a few evaluations and provide the AI project information to the AI project created previously

Expected behavior
The call to evaluate should succeed and the results should be uploaded to AI Foundry.

Screenshots

Image Image

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Labels

ClientThis issue points to a problem in the data-plane of the library.EvaluationIssues related to the client library for Azure AI EvaluationService AttentionWorkflow: This issue is responsible by Azure service team.bugThis issue requires a change to an existing behavior in the product in order to be resolved.needs-team-attentionWorkflow: This issue needs attention from Azure service team or SDK team

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions