Skip to content

AI Foundry Evaluations support tags but SDK does not #39862

Open
@marcjimz

Description

@marcjimz

Is your feature request related to a problem? Please describe.
Tags are hardcoded in the SDK:

"tags": [{"key": "mlflow.user", "value": "azure-ai-evaluation"}],

Describe the solution you'd like
Ability to use tags, so we can use the UI for reporting and visualization of evaluations. It would be helpful when I run the evaluate() function that I can pass in tags appropriately, will make LLMOps much more streamlined with the AI Foundry portal.

Describe alternatives you've considered
This is a missing feature in the SDK

Additional context

Image

Metadata

Metadata

Labels

AIClientThis issue points to a problem in the data-plane of the library.EvaluationIssues related to the client library for Azure AI EvaluationService AttentionWorkflow: This issue is responsible by Azure service team.customer-reportedIssues that are reported by GitHub users external to the Azure organization.feature-requestThis issue requires a new behavior in the product in order be resolved.needs-team-attentionWorkflow: This issue needs attention from Azure service team or SDK teamquestionThe issue doesn't require a change to the product in order to be resolved. Most issues start as that

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions