Skip to content

feat: add Unify real-dataset smoke pipelines#1201

Closed
Luodian wants to merge 2 commits into
dev/v0d8from
feat/lmm-311-unify-smoke
Closed

feat: add Unify real-dataset smoke pipelines#1201
Luodian wants to merge 2 commits into
dev/v0d8from
feat/lmm-311-unify-smoke

Conversation

@Luodian
Copy link
Copy Markdown
Contributor

@Luodian Luodian commented Feb 23, 2026

Summary

  • add OpenRouter image-generation backend and register it for Unify generation smoke usage
  • add realunify_gen_smoke task + fixture for local artifact-validation path
  • add two runnable scripts: image-generation smoke and real-dataset smoke (realunify_mental_tracking, uni_mmmu_jigsaw)

Verification

  • bash examples/models/openrouter_unify_real_smoke.sh
  • run passed on real datasets with refreshed HF token context
  • sample logs:
    • logs/openrouter_unify_real_smoke/openai__gpt-4.1-mini/20260224_000439_samples_realunify_mental_tracking.jsonl
    • logs/openrouter_unify_real_smoke/openai__gpt-4.1-mini/20260224_000439_samples_uni_mmmu_jigsaw.jsonl
  • additional image artifact smoke:
    • bash examples/models/openrouter_unify_image_smoke.sh
    • realunify_gen_smoke_success=1

Closes #1194

@Luodian
Copy link
Copy Markdown
Contributor Author

Luodian commented Feb 24, 2026

Closing: core openrouter_image_gen model backend already merged via #1198. The Unify task/script additions need a fresh PR without the duplicated model backend and formatting conflicts.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant