Skip to content

Commit a8d2fde

Browse files
committed
docs: reorganize results and add web demo preview
1 parent dad6168 commit a8d2fde

3 files changed

Lines changed: 42 additions & 26 deletions

File tree

README.md

Lines changed: 42 additions & 26 deletions
Original file line numberDiff line numberDiff line change
@@ -1,4 +1,4 @@
1-
# OmniAgent: Native Active Perception as Reasoning for Omni-Modal Understanding
1+
# Native Active Perception as Reasoning for Omni-Modal Understanding
22

33
<p align="center">
44
<a href="#citation"><img src="https://img.shields.io/badge/Conference-ICML%202026-8A2BE2" alt="ICML 2026"></a>
@@ -19,15 +19,17 @@
1919

2020
## Table of Contents
2121

22-
- [OmniAgent: Native Active Perception as Reasoning for Omni-Modal Understanding](#omniagent-native-active-perception-as-reasoning-for-omni-modal-understanding)
22+
- [Native Active Perception as Reasoning for Omni-Modal Understanding](#native-active-perception-as-reasoning-for-omni-modal-understanding)
2323
- [Table of Contents](#table-of-contents)
2424
- [News](#news)
2525
- [Overview](#overview)
2626
- [Highlights](#highlights)
2727
- [Method](#method)
2828
- [Results](#results)
2929
- [Main results](#main-results)
30+
- [Efficiency and Test-Time Scaling](#efficiency-and-test-time-scaling)
3031
- [Resources](#resources)
32+
- [Demo Preview](#demo-preview)
3133
- [Repository Structure](#repository-structure)
3234
- [Requirements](#requirements)
3335
- [Installation](#installation)
@@ -95,30 +97,7 @@ OmniAgent reframes video perception as reasoning: a single omni model iterativel
9597

9698
## Results
9799

98-
OmniAgent achieves **state-of-the-art performance among open-source models across all ten benchmarks**. The table below summarizes gains over the Qwen2.5-Omni-7B base model; see **Table 1 in the paper** for the full comparison against all baselines.
99-
100-
<table>
101-
<tr>
102-
<td width="50%">
103-
104-
**LVBench efficiency**
105-
106-
OmniAgent-7B outperforms Qwen2.5-VL-72B while using about 73% fewer frames (203 vs. 768).
107-
108-
<img src="assets/frames_lvbench_trendline.png" width="100%"/>
109-
110-
</td>
111-
<td width="50%">
112-
113-
**VideoMME-Long scaling**
114-
115-
Accuracy improves by +6.2% as the max turn budget increases, while actual turns saturate at about 11.7.
116-
117-
<img src="assets/test_time_scaling_mme_long.png" width="100%"/>
118-
119-
</td>
120-
</tr>
121-
</table>
100+
OmniAgent achieves **state-of-the-art performance among open-source models across all ten benchmarks**. We first summarize the main benchmark results across video understanding, audio-visual understanding, and temporal grounding, then highlight frame efficiency and test-time scaling behavior. See **Tables 1-3 in the paper** for the full comparison against all baselines.
122101

123102
### Main results
124103

@@ -248,6 +227,31 @@ All numbers compare OmniAgent-7B against its Qwen2.5-Omni-7B base model, evaluat
248227
</tbody>
249228
</table>
250229

230+
### Efficiency and Test-Time Scaling
231+
232+
<table>
233+
<tr>
234+
<td width="50%">
235+
236+
**Frame efficiency on LVBench**
237+
238+
OmniAgent-7B outperforms Qwen2.5-VL-72B while using about 73% fewer frames (203 vs. 768).
239+
240+
<img src="assets/frames_lvbench_trendline.png" width="100%"/>
241+
242+
</td>
243+
<td width="50%">
244+
245+
**Test-time scaling on VideoMME-Long**
246+
247+
Accuracy improves by +6.2% as the max turn budget increases, while actual turns saturate at about 11.7.
248+
249+
<img src="assets/test_time_scaling_mme_long.png" width="100%"/>
250+
251+
</td>
252+
</tr>
253+
</table>
254+
251255
**Takeaways**
252256

253257
- **Parameter and frame efficiency** — OmniAgent-7B outperforms Qwen2.5-VL-72B (a 10× larger model) on LVBench (50.5 vs. 47.3) while using about 73% fewer frames.
@@ -268,6 +272,18 @@ All numbers compare OmniAgent-7B against its Qwen2.5-Omni-7B base model, evaluat
268272

269273
---
270274

275+
## Demo Preview
276+
277+
<p align="center">
278+
<img src="assets/demo_inference.gif" width="92%" alt="OmniAgent web demo inference trace"/>
279+
</p>
280+
281+
<p align="center">
282+
<a href="assets/demo_inference.mp4">MP4 recording</a>
283+
</p>
284+
285+
---
286+
271287
## Repository Structure
272288

273289
```text

assets/demo_inference.gif

1.55 MB
Loading

assets/demo_inference.mp4

860 KB
Binary file not shown.

0 commit comments

Comments
 (0)