Skip to content

Commit b61c65b

Browse files
author
Charles Parker
committed
Changed config case_category to group in minimal test.
1 parent 8727faa commit b61c65b

1 file changed

Lines changed: 2 additions & 2 deletions

File tree

project/literature_mcp_eval_config_test.yaml

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -36,7 +36,7 @@ server_combinations:
3636

3737
cases:
3838
- name: PMID_28027860_Full_Text
39-
case_category: Text extraction
39+
group: Text extraction
4040
metrics:
4141
- CorrectnessMetric
4242
input: 'What is the first sentence of section 2 in PMID: 28027860?'
@@ -48,7 +48,7 @@ cases:
4848
# like an extremely difficult case that even a good LLM + MCP might not pass. We've
4949
# made some edits to give the LLM + MCP a fair chance
5050
- name: PMC8086273_Retraction
51-
case_category: Summarization
51+
group: Summarization
5252
metrics:
5353
- CorrectnessMetric
5454
input: Based on PMID 33926573 do microbes from alkaline sulphidic tailings show oxidative stresses?

0 commit comments

Comments
 (0)