Update GPQA test to reflect the extract setting

cmpatino · cmpatino · commit 1b6354425b0f · 2025-09-30T12:17:58.000+02:00
diff --git a/tests/unit/metrics/test_cases/gpqa_instruct_metric.json b/tests/unit/metrics/test_cases/gpqa_instruct_metric.json
@@ -249,7 +249,7 @@
         ]
       },
       "expected_output": {
-        "extractive_match": 0.0
+        "extractive_match": 1.0
       },
       "tolerance": 0.01,
       "description": "Answer with quotes but still extractable"

Original file line number	Diff line number	Diff line change
`@@ -249,7 +249,7 @@`
`249`	`249`	`]`
`250`	`250`	`},`
`251`	`251`	`"expected_output": {`
`252`		`- "extractive_match": 0.0`
	`252`	`+ "extractive_match": 1.0`
`253`	`253`	`},`
`254`	`254`	`"tolerance": 0.01,`
`255`	`255`	`"description": "Answer with quotes but still extractable"`