You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
-[OmniAgent: Native Active Perception as Reasoning for Omni-Modal Understanding](#omniagent-native-active-perception-as-reasoning-for-omni-modal-understanding)
22
+
-[Native Active Perception as Reasoning for Omni-Modal Understanding](#native-active-perception-as-reasoning-for-omni-modal-understanding)
23
23
-[Table of Contents](#table-of-contents)
24
24
-[News](#news)
25
25
-[Overview](#overview)
26
26
-[Highlights](#highlights)
27
27
-[Method](#method)
28
28
-[Results](#results)
29
29
-[Main results](#main-results)
30
+
-[Efficiency and Test-Time Scaling](#efficiency-and-test-time-scaling)
30
31
-[Resources](#resources)
32
+
-[Demo Preview](#demo-preview)
31
33
-[Repository Structure](#repository-structure)
32
34
-[Requirements](#requirements)
33
35
-[Installation](#installation)
@@ -95,30 +97,7 @@ OmniAgent reframes video perception as reasoning: a single omni model iterativel
95
97
96
98
## Results
97
99
98
-
OmniAgent achieves **state-of-the-art performance among open-source models across all ten benchmarks**. The table below summarizes gains over the Qwen2.5-Omni-7B base model; see **Table 1 in the paper** for the full comparison against all baselines.
99
-
100
-
<table>
101
-
<tr>
102
-
<tdwidth="50%">
103
-
104
-
**LVBench efficiency**
105
-
106
-
OmniAgent-7B outperforms Qwen2.5-VL-72B while using about 73% fewer frames (203 vs. 768).
OmniAgent achieves **state-of-the-art performance among open-source models across all ten benchmarks**. We first summarize the main benchmark results across video understanding, audio-visual understanding, and temporal grounding, then highlight frame efficiency and test-time scaling behavior. See **Tables 1-3 in the paper** for the full comparison against all baselines.
122
101
123
102
### Main results
124
103
@@ -248,6 +227,31 @@ All numbers compare OmniAgent-7B against its Qwen2.5-Omni-7B base model, evaluat
248
227
</tbody>
249
228
</table>
250
229
230
+
### Efficiency and Test-Time Scaling
231
+
232
+
<table>
233
+
<tr>
234
+
<tdwidth="50%">
235
+
236
+
**Frame efficiency on LVBench**
237
+
238
+
OmniAgent-7B outperforms Qwen2.5-VL-72B while using about 73% fewer frames (203 vs. 768).
-**Parameter and frame efficiency** — OmniAgent-7B outperforms Qwen2.5-VL-72B (a 10× larger model) on LVBench (50.5 vs. 47.3) while using about 73% fewer frames.
@@ -268,6 +272,18 @@ All numbers compare OmniAgent-7B against its Qwen2.5-Omni-7B base model, evaluat
268
272
269
273
---
270
274
275
+
## Demo Preview
276
+
277
+
<palign="center">
278
+
<imgsrc="assets/demo_inference.gif"width="92%"alt="OmniAgent web demo inference trace"/>
0 commit comments