-
Notifications
You must be signed in to change notification settings - Fork 783
Issues: dotnet/extensions
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Author
Label
Projects
Milestones
Assignee
Sort
Issues list
Update html-reporting package dependencies
area-ai-eval
Microsoft.Extensions.AI.Evaluation and related
#6115
opened Mar 14, 2025 by
peterwald
Loading…
[AI Evaluation] Enable downloading data from the AI Evaluation report tab in Azure DevOps
area-ai-eval
Microsoft.Extensions.AI.Evaluation and related
#6044
opened Mar 6, 2025 by
peterwald
[AI Evaluation] Quality evaluators should exclude tool call messages by default
area-ai-eval
Microsoft.Extensions.AI.Evaluation and related
#6043
opened Mar 6, 2025 by
shyamnamboodiripad
[AI Evaluation] Introduce a mechanism to detect when evaluation scores drop below configured thresholds
area-ai-eval
Microsoft.Extensions.AI.Evaluation and related
#6038
opened Mar 5, 2025 by
shyamnamboodiripad
[AI Evaluation] Improve how chat history is displayed in reports
area-ai-eval
Microsoft.Extensions.AI.Evaluation and related
#6036
opened Mar 5, 2025 by
shyamnamboodiripad
2 of 3 tasks
[AI Evaluation] Add clarifying xml comments to indicate that the evaluators in the Quality package have mainly been tested against OpenAI models
area-ai-eval
Microsoft.Extensions.AI.Evaluation and related
#6035
opened Mar 5, 2025 by
shyamnamboodiripad
[AI Evaluation] Introduce tags / metadata concept for executions
area-ai-eval
Microsoft.Extensions.AI.Evaluation and related
#6034
opened Mar 5, 2025 by
shyamnamboodiripad
3 tasks
[AI Evaluation] Add EvaluationMetric property for contexts used in evaluation
area-ai-eval
Microsoft.Extensions.AI.Evaluation and related
#6033
opened Mar 5, 2025 by
shyamnamboodiripad
3 tasks
[AI Evaluation] GroundednessEvaluator does not return reason for score
area-ai-eval
Microsoft.Extensions.AI.Evaluation and related
#6028
opened Mar 4, 2025 by
Skleni
[AI Evaluation] Include reporting for token counts and latency
area-ai-eval
Microsoft.Extensions.AI.Evaluation and related
#5970
opened Feb 25, 2025 by
shyamnamboodiripad
[AI Evaluation] Explore GitHub Actions integration for reporting functionality
area-ai-eval
Microsoft.Extensions.AI.Evaluation and related
#5967
opened Feb 25, 2025 by
shyamnamboodiripad
[AI Evaluation] Update prompts for Quality evaluators
area-ai-eval
Microsoft.Extensions.AI.Evaluation and related
#5952
opened Feb 21, 2025 by
shyamnamboodiripad
[AI Evaluation] Create a package for math-based evaluations such as BLEU score, GLUE score, F1 score etc.
area-ai-eval
Microsoft.Extensions.AI.Evaluation and related
#5951
opened Feb 21, 2025 by
shyamnamboodiripad
[AI Evaluation] Create project templates for evaluation tests
area-ai-eval
Microsoft.Extensions.AI.Evaluation and related
area-ai-templates
Microsoft.Extensions.AI.Templates
#5944
opened Feb 19, 2025 by
shyamnamboodiripad
[AI Evaluation] Explore additional storage providers for reporting
area-ai-eval
Microsoft.Extensions.AI.Evaluation and related
#5943
opened Feb 19, 2025 by
shyamnamboodiripad
[AI Evaluation] Explore setting up a pipeline for integration tests that can actually invoke the LLM
area-ai-eval
Microsoft.Extensions.AI.Evaluation and related
area-infrastructure
#5940
opened Feb 19, 2025 by
shyamnamboodiripad
[AI Evaluation] Add SQLite provider for storing results and caching responses
area-ai-eval
Microsoft.Extensions.AI.Evaluation and related
#5939
opened Feb 19, 2025 by
shyamnamboodiripad
[AI Evaluation] Update AI.Evaluation tests to be runnable without Azure connection
area-ai-eval
Microsoft.Extensions.AI.Evaluation and related
#5938
opened Feb 19, 2025 by
peterwald
[AI Evaluation] Introduce RAI evaluators
area-ai-eval
Microsoft.Extensions.AI.Evaluation and related
#5937
opened Feb 19, 2025 by
shyamnamboodiripad
[AI Evaluation] Add filter and search capabilities to evaluation reports
area-ai-eval
Microsoft.Extensions.AI.Evaluation and related
#5935
opened Feb 19, 2025 by
shyamnamboodiripad
[AI Evaluation] Add trending to evaluation reports
area-ai-eval
Microsoft.Extensions.AI.Evaluation and related
#5934
opened Feb 19, 2025 by
shyamnamboodiripad
[TEST] enable build check
area-ai-eval
Microsoft.Extensions.AI.Evaluation and related
#5810
opened Jan 21, 2025 by
YuliiaKovalova
•
Draft
ProTip!
Type g i on any issue or pull request to go back to the issue listing page.