Docs matching the actual values in the evaluators for thresholds (Azure#40722)

* aggregated binary threshold results for evaluators in metrics

* handle when the right columns do not exist

* Marking mypy, pylint, black as false

* Add to constatns

* typo

* Changes to default in the docs to match the values being used

* Update sdk/evaluation/azure-ai-evaluation/azure/ai/evaluation/_evaluators/_similarity/_similarity.py

Co-authored-by: Copilot <[email protected]>

---------

Co-authored-by: Nagkumar Arkalgud <[email protected]>
Co-authored-by: Nagkumar Arkalgud <[email protected]>
Co-authored-by: Waqas Javed <[email protected]>
Co-authored-by: Copilot <[email protected]>

Author: 5 people

sdk/evaluation/azure-ai-evaluation/azure/ai/evaluation/_evaluators/_fluency/_fluency.py

@@ -23,7 +23,7 @@ class FluencyEvaluator(PromptyEvaluatorBase[Union[str, float]]):
     :param model_config: Configuration for the Azure OpenAI model.
     :type model_config: Union[~azure.ai.evaluation.AzureOpenAIModelConfiguration,
         ~azure.ai.evaluation.OpenAIModelConfiguration]
-    :param threshold: The threshold for the fluency evaluator. Default is 5.
+    :param threshold: The threshold for the fluency evaluator. Default is 3.
     :type threshold: int
 
     .. admonition:: Example:

sdk/evaluation/azure-ai-evaluation/azure/ai/evaluation/_evaluators/_groundedness/_groundedness.py

@@ -33,7 +33,7 @@ class GroundednessEvaluator(PromptyEvaluatorBase[Union[str, float]]):
     :param model_config: Configuration for the Azure OpenAI model.
     :type model_config: Union[~azure.ai.evaluation.AzureOpenAIModelConfiguration,
         ~azure.ai.evaluation.OpenAIModelConfiguration]
-    :param threshold: The threshold for the groundedness evaluator. Default is 5.
+    :param threshold: The threshold for the groundedness evaluator. Default is 3.
     :type threshold: int
         
     .. admonition:: Example:

sdk/evaluation/azure-ai-evaluation/azure/ai/evaluation/_evaluators/_relevance/_relevance.py

@@ -27,7 +27,7 @@ class RelevanceEvaluator(PromptyEvaluatorBase):
     :param model_config: Configuration for the Azure OpenAI model.
     :type model_config: Union[~azure.ai.evaluation.AzureOpenAIModelConfiguration,
         ~azure.ai.evaluation.OpenAIModelConfiguration]
-    :param threshold: The threshold for the relevance evaluator. Default is 5.
+    :param threshold: The threshold for the relevance evaluator. Default is 3.
     :type threshold: int
 
     .. admonition:: Example:

sdk/evaluation/azure-ai-evaluation/azure/ai/evaluation/_evaluators/_similarity/_similarity.py

@@ -28,7 +28,7 @@ class SimilarityEvaluator(PromptyEvaluatorBase):
     :param model_config: Configuration for the Azure OpenAI model.
     :type model_config: Union[~azure.ai.evaluation.AzureOpenAIModelConfiguration,
         ~azure.ai.evaluation.OpenAIModelConfiguration]
-    :param threshold: The threshold for the similarity evaluator. Default is 5.
+    :param threshold: The threshold for the similarity evaluator. Default is 3.
     :type threshold: int
 
     .. admonition:: Example: