Skip to content

Commit 0d8e61e

Browse files
committed
update
1 parent 11e12d6 commit 0d8e61e

4 files changed

Lines changed: 81 additions & 12 deletions

File tree

CapRL++/README.md

Lines changed: 25 additions & 6 deletions
Original file line numberDiff line numberDiff line change
@@ -1,8 +1,14 @@
1-
# CapRL++
1+
# CapRL++: Unified Reinforcement Learning with Verifiable Rewards for Dense Image and Video Captioning
22

3-
CapRL++ is an extension of CapRL for video caption reinforcement learning.
4-
While the original CapRL release focuses
5-
on dense image captioning, CapRL++ keeps the same central idea: train a caption
3+
[[Paper](https://arxiv.org/abs/2606.09393)] [[Project](https://github.com/InternLM/CapRL)] [[Model](https://huggingface.co/internlm/CapRL-Video-4B)] [[Dataset](https://huggingface.co/datasets/internlm/CapRL-Video-178K)]
4+
5+
**Authors:** Penghui Yang*, Long Xing*, Xiaoyi Dong, Yuhang Zang, Yuhang Cao,
6+
Yibin Wang, Yujie Zhou, Jiazi Bu, Jianze Liang, Qidong Huang, Jiaqi Wang,
7+
Feng Wu, Dahua Lin.
8+
9+
CapRL++ is a unified reinforcement learning framework for dense image and video
10+
captioning with verifiable rewards. While the original CapRL release focuses on
11+
dense image captioning, CapRL++ keeps the same central idea: train a caption
612
model with reward signals that measure whether the generated caption preserves
713
enough visual information for downstream question answering.
814

@@ -13,8 +19,10 @@ extension.
1319

1420
CapRL++ adds three practical components on top of CapRL:
1521

16-
- video caption RL training based on the bundled verl framework;
17-
- a remote reward service for QA-based or VLM-judge-based reward scoring;
22+
- unified image and video caption RL training based on the bundled verl
23+
framework;
24+
- a remote reward service for QA-based or VLM-judge-based verifiable reward
25+
scoring;
1826
- a video Prism evaluation pipeline that measures caption usefulness through
1927
downstream benchmark QA.
2028

@@ -106,3 +114,14 @@ question-answering feedback, but extends the workflow to video captioning and
106114
uses verl as the RL training backend. For image caption models, datasets, and
107115
the original CapRL training and evaluation pipeline, refer to the main
108116
repository README.
117+
118+
## Citation
119+
120+
```bibtex
121+
@article{yang2026caprlplusplus,
122+
title={CapRL++: Unified Reinforcement Learning with Verifiable Rewards for Dense Image and Video Captioning},
123+
author={Yang, Penghui and Xing, Long and Dong, Xiaoyi and Zang, Yuhang and Cao, Yuhang and Wang, Yibin and Zhou, Yujie and Bu, Jiazi and Liang, Jianze and Huang, Qidong and Wang, Jiaqi and Wu, Feng and Lin, Dahua},
124+
journal={arXiv preprint arXiv:2606.09393},
125+
year={2026}
126+
}
127+
```

README.md

Lines changed: 36 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -30,22 +30,30 @@
3030
·
3131
<a href="https://scholar.google.com/citations?user=sJkqsqkAAAAJ"><strong>Yuhang Cao</strong></a>
3232
·
33+
<strong>Yibin Wang</strong>
34+
·
35+
<strong>Yujie Zhou</strong>
36+
·
37+
<strong>Jiazi Bu</strong>
38+
·
3339
<a href="https://scholar.google.com/citations?user=P4yNnSkAAAAJ&hl=zh-TW"><strong>Jianze Liang</strong></a>
3440
·
3541
<a href="https://github.com/shikiw"><strong>Qidong Huang</strong></a>
3642
·
3743
<a href="https://myownskyw7.github.io/"><strong>Jiaqi Wang</strong></a>
3844
·
45+
<a href="https://scholar.google.com/citations?user=5bInRDEAAAAJ&hl=zh-CN"><strong>Feng Wu</strong></a>
46+
·
3947
<a href="http://dahua.site/"><strong>Dahua Lin</strong></a>
4048
</p>
4149

42-
📖<a href="https://arxiv.org/abs/2509.22647">Paper</a> | 🏠<a href="https://github.com/InternLM/CapRL">Github</a> | 🤗<a href="https://huggingface.co/collections/long-xing1/caprl-68d64ac32ded31596c36e189">CapRL Collection</a> | 🤗<a href="https://huggingface.co/papers/2509.22647">Daily Paper</a>
50+
📖<a href="https://arxiv.org/abs/2606.09393">CapRL++ Paper</a> | 📖<a href="https://arxiv.org/abs/2509.22647">CapRL Paper</a> | 🏠<a href="https://github.com/InternLM/CapRL">Github</a> | 🤗<a href="https://huggingface.co/collections/long-xing1/caprl-68d64ac32ded31596c36e189">CapRL Collection</a> | 🤗<a href="https://huggingface.co/papers/2606.09393">CapRL++ Daily Paper</a>
4351

4452

4553
#### CapRL Series Model & Dataset
4654
| Series | Models & Resources |
4755
| :--- | :--- |
48-
| **CapRL 3.0 Series (CapRL++)** | [🤗 CapRL-Video-4B](https://huggingface.co/internlm/CapRL-Video-4B) \|[📊 CapRL-Video-178K Dataset](https://huggingface.co/datasets/internlm/CapRL-Video-178K) \|
56+
| **CapRL 3.0 Series (CapRL++)** | [🤗 CapRL-Video-4B](https://huggingface.co/internlm/CapRL-Video-4B) \| [📊 CapRL-Video-178K Dataset](https://huggingface.co/datasets/internlm/CapRL-Video-178K) |
4957
| **CapRL 2.0 Series** | [🤗 CapRL-Qwen3VL-2B](https://huggingface.co/internlm/CapRL-Qwen3VL-2B) \| [🤗 CapRL-Qwen3VL-4B](https://huggingface.co/internlm/CapRL-Qwen3VL-4B) \| [📦 CapRL-Qwen3VL-2B-GGUF](https://huggingface.co/internlm/CapRL-Qwen3VL-2B-GGUF) \| [📦 CapRL-Qwen3VL-4B-GGUF](https://huggingface.co/internlm/CapRL-Qwen3VL-4B-GGUF) \| [🌈CapRL-Qwen3VL-4B Space](https://huggingface.co/spaces/yuhangzang/CapRL-Qwen3VL-4B)
5058
| **CapRL 1.0 Series** | [🤗 CapRL-Qwen2.5VL-3B](https://huggingface.co/internlm/CapRL-3B) \| [🤗 CapRL-InternVL3.5-8B](https://huggingface.co/yuhangzang/CapRL-InternVL3.5-8B) \| [📊 CapRL-2M Dataset](https://huggingface.co/datasets/internlm/CapRL-2M) \| [📦 CapRL-3B-GGUF](https://huggingface.co/mradermacher/CapRL-3B-GGUF) \| [📦 CapRL-3B-i1-GGUF](https://huggingface.co/mradermacher/CapRL-3B-i1-GGUF) \| [🌈CapRL-Qwen2.5VL-3B Space](https://huggingface.co/spaces/yuhangzang/caprl)
5159

@@ -69,10 +77,11 @@ Now you can try out CapRL with your own images🎨!&nbsp;&nbsp;&nbsp;&nbsp;➡
6977

7078
## 📢 News
7179
We are working on even stronger base models and upgrading our training recipe — stay tuned!
80+
- 🔥 [06/08/2026] **CapRL++** paper is available on arXiv: [CapRL++: Unified Reinforcement Learning with Verifiable Rewards for Dense Image and Video Captioning](https://arxiv.org/abs/2606.09393).
7281
- 🔥 [05/25/2026] We have released the training and evaluation code for CapRL++. See more in `CapRL++` folder.
7382
- 🔥 [05/22/2026] We have released the **[CapRL-Video-QA-20K](https://huggingface.co/datasets/internlm/CapRL-Video-QA-20K)** dataset for CapRL++ training and
7483
the **[CapRL-Video-178K](https://huggingface.co/datasets/internlm/CapRL-Video-178K)** dataset (recaptioned by **[CapRL-Video-4B](https://huggingface.co/internlm/CapRL-Video-4B)** from LLaVA-Video-178K)!
75-
- 🔥 [05/22/2026] **CapRL++** is coming! We have released the **[CapRL-Video-4B](https://huggingface.co/internlm/CapRL-Video-4B)** model (trained on Qwen3-VL-4B) designed for video captioning! Demo is [here](https://internlm.github.io/CapRL/demo/).
84+
- 🔥 [05/22/2026] We have released the **[CapRL-Video-4B](https://huggingface.co/internlm/CapRL-Video-4B)** model (trained on Qwen3-VL-4B) designed for video captioning! Demo is [here](https://internlm.github.io/CapRL/demo/).
7685
- 🔥 [04/16/2026] We have released the **[CapRL-QA-75K](https://huggingface.co/datasets/internlm/CapRL-QA-75K)** training dataset!
7786
- 🔥 [2/9/2026] We release the CapRL training code.
7887
- 🔥 [1/27/2026] CapRL is accepted by ICLR2026! We are working on cleaning training code, and will release everything as soon as possible!
@@ -400,6 +409,30 @@ You can specify `--reward-model-path` as the path to **CapRL-Eval-3B** in `Eval_
400409
**Usage and License Notices**: The data and code are intended and licensed for research use only.
401410
License: Attribution-NonCommercial 4.0 International It should abide by the policy of OpenAI: https://openai.com/policies/terms-of-use
402411

412+
## Citation
413+
414+
If you find CapRL++ useful for your research, please consider citing:
415+
416+
```bibtex
417+
@article{yang2026caprlplusplus,
418+
title={CapRL++: Unified Reinforcement Learning with Verifiable Rewards for Dense Image and Video Captioning},
419+
author={Yang, Penghui and Xing, Long and Dong, Xiaoyi and Zang, Yuhang and Cao, Yuhang and Wang, Yibin and Zhou, Yujie and Bu, Jiazi and Liang, Jianze and Huang, Qidong and Wang, Jiaqi and Wu, Feng and Lin, Dahua},
420+
journal={arXiv preprint arXiv:2606.09393},
421+
year={2026}
422+
}
423+
```
424+
425+
For the original CapRL paper:
426+
427+
```bibtex
428+
@article{xing2025caprl,
429+
title={CapRL: Stimulating Dense Image Caption Capabilities via Reinforcement Learning},
430+
author={Xing, Long and Dong, Xiaoyi and Zang, Yuhang and Cao, Yuhang and Liang, Jianze and Huang, Qidong and Wang, Jiaqi and Wu, Feng and Lin, Dahua},
431+
journal={arXiv preprint arXiv:2509.22647},
432+
year={2025}
433+
}
434+
```
435+
403436
## ❤️ Acknowledgments
404437
- [Open-LLaVA-NeXT](https://github.com/xiaoachen98/Open-LLaVA-NeXT): Thanks for the impressive open-source dataset.
405438
- [VLMEvalKit](https://github.com/open-compass/VLMEvalKit): the amazing open-sourced suit for evaluating various LMMs!

docs/demo/index.html

Lines changed: 8 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -16,9 +16,14 @@ <h1>Video Caption Demo</h1>
1616
Dense, chronological video captions generated by CapRL-Video-4B.
1717
</p>
1818
</div>
19-
<a class="repo-link" href="https://github.com/InternLM/CapRL" target="_blank" rel="noreferrer">
20-
GitHub
21-
</a>
19+
<div class="hero-actions" aria-label="Project links">
20+
<a class="repo-link" href="https://arxiv.org/abs/2606.09393" target="_blank" rel="noreferrer">
21+
Paper
22+
</a>
23+
<a class="repo-link repo-link-secondary" href="https://github.com/InternLM/CapRL" target="_blank" rel="noreferrer">
24+
GitHub
25+
</a>
26+
</div>
2227
</header>
2328

2429
<section class="demo-layout" aria-label="CapRL++ demo viewer">

docs/demo/style.css

Lines changed: 12 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -45,6 +45,13 @@ input {
4545
margin-bottom: 22px;
4646
}
4747

48+
.hero-actions {
49+
display: flex;
50+
flex-wrap: wrap;
51+
justify-content: flex-end;
52+
gap: 10px;
53+
}
54+
4855
.eyebrow {
4956
margin: 0 0 8px;
5057
color: var(--accent-strong);
@@ -107,6 +114,11 @@ h2 {
107114
background: var(--accent-strong);
108115
}
109116

117+
.repo-link-secondary {
118+
background: #fff;
119+
color: var(--accent-strong);
120+
}
121+
110122
.demo-layout {
111123
display: grid;
112124
grid-template-columns: 260px minmax(420px, 0.95fr) minmax(420px, 1.05fr);

0 commit comments

Comments
 (0)