Skip to content

Add CambriansVSR/VSC/VSCStreaming model integrations#1268

Merged
Luodian merged 4 commits into
EvolvingLMMs-Lab:mainfrom
akawincent:model/cambrians_varients
Mar 26, 2026
Merged

Add CambriansVSR/VSC/VSCStreaming model integrations#1268
Luodian merged 4 commits into
EvolvingLMMs-Lab:mainfrom
akawincent:model/cambrians_varients

Conversation

@akawincent
Copy link
Copy Markdown
Contributor

@akawincent akawincent commented Mar 25, 2026

Summary

  • add cambrians_vsr as a new model integration
  • add cambrians_vsc and cambrians_vsc_streaming as new model integrations
  • add a Qwen2 cache-management monkey patch used by the Cambrian variants
  • The above models all belong to the Cambrians' predictive sensing paradigm for efficiently processing ultra-long videos understanding. Ref: Cambrians Tech Report

In scope

  • register cambrians_vsr, cambrians_vsc, and cambrians_vsc_streaming in lmms_eval.models
  • add the three model implementations under lmms_eval/models/simple/
  • add lmms_eval/models/model_utils/cambrians/qwen2_monkey_patch.py
  • apply black/isort formatting required by repo lint

Out of scope

  • benchmark/task additions
  • environment setup or dependency changes
  • evaluation script changes outside these model integrations

Validation

  • pre-commit run --files lmms_eval/models/init.py lmms_eval/models/model_utils/cambrians/qwen2_monkey_patch.py lmms_eval/models/simple/cambrians_vsc.py lmms_eval/models/simple/cambrians_vsc_streaming.py lmms_eval/models/simple/cambrians_vsr.py | result: pass
  • python -m lmms_eval models --aliases | rg cambrians(_vsc|_vsr|_vsc_streaming)? | result: pass

Risk / Compatibility

  • low to medium risk: this adds new model backends and patches Qwen2 attention/cache behavior used by these Cambrian variants
  • no intended behavior changes for unrelated model integrations

Type of Change

  • Bug fix (non-breaking change)
  • New feature
  • New benchmark/task
  • New model integration
  • Breaking change
  • Documentation update
  • Refactoring (no functional changes)

@akawincent akawincent changed the title Add Cambrian VSR, VSC, and streaming VSC model integrations Add CambriansVSR/VSC/VSCStreaming model integrations Mar 25, 2026
Copy link
Copy Markdown
Contributor

@Luodian Luodian left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM — monkey patch is scoped to Cambrians models only, no global side effects. Pairs with the already-merged VSI-SUPER benchmark (#1267).

@Luodian Luodian merged commit 2c08ee5 into EvolvingLMMs-Lab:main Mar 26, 2026
2 checks passed
@akawincent akawincent deleted the model/cambrians_varients branch March 27, 2026 08:02
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants