Skip to content

Commit f3eed01

Browse files
committed
fix(mmmu_pro): use post_prompt for vision-only doc_to_text
1 parent 9c7a55a commit f3eed01

1 file changed

Lines changed: 1 addition & 1 deletion

File tree

lmms_eval/tasks/mmmu_pro/utils.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -52,7 +52,7 @@ def mmmu_pro_doc_to_text(doc, lmms_eval_specific_kwargs=None):
5252
return mmmu_doc_to_text_qwen3vl(doc, lmms_eval_specific_kwargs)
5353

5454
post_prompt = lmms_eval_specific_kwargs["post_prompt"]
55-
question = doc.get("question", "")
55+
question = post_prompt # vision-only fallback: question and options are rendered in the image
5656
if "question" in doc and "options" in doc: # original operation
5757
question = construct_prompt(doc, post_prompt)
5858
if config["metadata"]["interleaved_format"]:

0 commit comments

Comments
 (0)