Skip to content

Issues: dotnet/extensions

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Clear current search query, filters, and sorts
22 Open 33 Closed
22 Open 33 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Update html-reporting package dependencies area-ai-eval Microsoft.Extensions.AI.Evaluation and related
#6115 opened Mar 14, 2025 by peterwald Loading…
@peterwald
[AI Evaluation] Enable downloading data from the AI Evaluation report tab in Azure DevOps area-ai-eval Microsoft.Extensions.AI.Evaluation and related
#6044 opened Mar 6, 2025 by peterwald
@peterwald
[AI Evaluation] Quality evaluators should exclude tool call messages by default area-ai-eval Microsoft.Extensions.AI.Evaluation and related
#6043 opened Mar 6, 2025 by shyamnamboodiripad
@shyamnamboodiripad
[AI Evaluation] Introduce a mechanism to detect when evaluation scores drop below configured thresholds area-ai-eval Microsoft.Extensions.AI.Evaluation and related
#6038 opened Mar 5, 2025 by shyamnamboodiripad
[AI Evaluation] Improve how chat history is displayed in reports area-ai-eval Microsoft.Extensions.AI.Evaluation and related
#6036 opened Mar 5, 2025 by shyamnamboodiripad
2 of 3 tasks
@peterwald
1
[AI Evaluation] Add clarifying xml comments to indicate that the evaluators in the Quality package have mainly been tested against OpenAI models area-ai-eval Microsoft.Extensions.AI.Evaluation and related
#6035 opened Mar 5, 2025 by shyamnamboodiripad
@shyamnamboodiripad
[AI Evaluation] Introduce tags / metadata concept for executions area-ai-eval Microsoft.Extensions.AI.Evaluation and related
#6034 opened Mar 5, 2025 by shyamnamboodiripad
3 tasks
@shyamnamboodiripad
1
[AI Evaluation] Add EvaluationMetric property for contexts used in evaluation area-ai-eval Microsoft.Extensions.AI.Evaluation and related
#6033 opened Mar 5, 2025 by shyamnamboodiripad
3 tasks
@shyamnamboodiripad
[AI Evaluation] GroundednessEvaluator does not return reason for score area-ai-eval Microsoft.Extensions.AI.Evaluation and related
#6028 opened Mar 4, 2025 by Skleni
2
[AI Evaluation] Include reporting for token counts and latency area-ai-eval Microsoft.Extensions.AI.Evaluation and related
#5970 opened Feb 25, 2025 by shyamnamboodiripad
[AI Evaluation] Explore GitHub Actions integration for reporting functionality area-ai-eval Microsoft.Extensions.AI.Evaluation and related
#5967 opened Feb 25, 2025 by shyamnamboodiripad
@peterwald
1
[AI Evaluation] Update prompts for Quality evaluators area-ai-eval Microsoft.Extensions.AI.Evaluation and related
#5952 opened Feb 21, 2025 by shyamnamboodiripad
@shyamnamboodiripad
1
[AI Evaluation] Create a package for math-based evaluations such as BLEU score, GLUE score, F1 score etc. area-ai-eval Microsoft.Extensions.AI.Evaluation and related
#5951 opened Feb 21, 2025 by shyamnamboodiripad
1
[AI Evaluation] Create project templates for evaluation tests area-ai-eval Microsoft.Extensions.AI.Evaluation and related area-ai-templates Microsoft.Extensions.AI.Templates
#5944 opened Feb 19, 2025 by shyamnamboodiripad
[AI Evaluation] Explore additional storage providers for reporting area-ai-eval Microsoft.Extensions.AI.Evaluation and related
#5943 opened Feb 19, 2025 by shyamnamboodiripad
1
[AI Evaluation] Explore setting up a pipeline for integration tests that can actually invoke the LLM area-ai-eval Microsoft.Extensions.AI.Evaluation and related area-infrastructure
#5940 opened Feb 19, 2025 by shyamnamboodiripad
[AI Evaluation] Add SQLite provider for storing results and caching responses area-ai-eval Microsoft.Extensions.AI.Evaluation and related
#5939 opened Feb 19, 2025 by shyamnamboodiripad
@shyamnamboodiripad
[AI Evaluation] Update AI.Evaluation tests to be runnable without Azure connection area-ai-eval Microsoft.Extensions.AI.Evaluation and related
#5938 opened Feb 19, 2025 by peterwald
@peterwald
[AI Evaluation] Introduce RAI evaluators area-ai-eval Microsoft.Extensions.AI.Evaluation and related
#5937 opened Feb 19, 2025 by shyamnamboodiripad
@shyamnamboodiripad
[AI Evaluation] Add filter and search capabilities to evaluation reports area-ai-eval Microsoft.Extensions.AI.Evaluation and related
#5935 opened Feb 19, 2025 by shyamnamboodiripad
@peterwald
[AI Evaluation] Add trending to evaluation reports area-ai-eval Microsoft.Extensions.AI.Evaluation and related
#5934 opened Feb 19, 2025 by shyamnamboodiripad
@peterwald
[TEST] enable build check area-ai-eval Microsoft.Extensions.AI.Evaluation and related
#5810 opened Jan 21, 2025 by YuliiaKovalova • Draft
@YuliiaKovalova
ProTip! Type g i on any issue or pull request to go back to the issue listing page.