You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
CapRL++ is a unified reinforcement learning framework for dense image and video
10
+
captioning with verifiable rewards. While the original CapRL release focuses on
11
+
dense image captioning, CapRL++ keeps the same central idea: train a caption
6
12
model with reward signals that measure whether the generated caption preserves
7
13
enough visual information for downstream question answering.
8
14
@@ -13,8 +19,10 @@ extension.
13
19
14
20
CapRL++ adds three practical components on top of CapRL:
15
21
16
-
- video caption RL training based on the bundled verl framework;
17
-
- a remote reward service for QA-based or VLM-judge-based reward scoring;
22
+
- unified image and video caption RL training based on the bundled verl
23
+
framework;
24
+
- a remote reward service for QA-based or VLM-judge-based verifiable reward
25
+
scoring;
18
26
- a video Prism evaluation pipeline that measures caption usefulness through
19
27
downstream benchmark QA.
20
28
@@ -106,3 +114,14 @@ question-answering feedback, but extends the workflow to video captioning and
106
114
uses verl as the RL training backend. For image caption models, datasets, and
107
115
the original CapRL training and evaluation pipeline, refer to the main
108
116
repository README.
117
+
118
+
## Citation
119
+
120
+
```bibtex
121
+
@article{yang2026caprlplusplus,
122
+
title={CapRL++: Unified Reinforcement Learning with Verifiable Rewards for Dense Image and Video Captioning},
123
+
author={Yang, Penghui and Xing, Long and Dong, Xiaoyi and Zang, Yuhang and Cao, Yuhang and Wang, Yibin and Zhou, Yujie and Bu, Jiazi and Liang, Jianze and Huang, Qidong and Wang, Jiaqi and Wu, Feng and Lin, Dahua},
@@ -69,10 +77,11 @@ Now you can try out CapRL with your own images🎨! ➡
69
77
70
78
## 📢 News
71
79
We are working on even stronger base models and upgrading our training recipe — stay tuned!
80
+
- 🔥 [06/08/2026]**CapRL++** paper is available on arXiv: [CapRL++: Unified Reinforcement Learning with Verifiable Rewards for Dense Image and Video Captioning](https://arxiv.org/abs/2606.09393).
72
81
- 🔥 [05/25/2026] We have released the training and evaluation code for CapRL++. See more in `CapRL++` folder.
73
82
- 🔥 [05/22/2026] We have released the **[CapRL-Video-QA-20K](https://huggingface.co/datasets/internlm/CapRL-Video-QA-20K)** dataset for CapRL++ training and
74
83
the **[CapRL-Video-178K](https://huggingface.co/datasets/internlm/CapRL-Video-178K)** dataset (recaptioned by **[CapRL-Video-4B](https://huggingface.co/internlm/CapRL-Video-4B)** from LLaVA-Video-178K)!
75
-
- 🔥 [05/22/2026]**CapRL++** is coming! We have released the **[CapRL-Video-4B](https://huggingface.co/internlm/CapRL-Video-4B)** model (trained on Qwen3-VL-4B) designed for video captioning! Demo is [here](https://internlm.github.io/CapRL/demo/).
84
+
- 🔥 [05/22/2026] We have released the **[CapRL-Video-4B](https://huggingface.co/internlm/CapRL-Video-4B)** model (trained on Qwen3-VL-4B) designed for video captioning! Demo is [here](https://internlm.github.io/CapRL/demo/).
76
85
- 🔥 [04/16/2026] We have released the **[CapRL-QA-75K](https://huggingface.co/datasets/internlm/CapRL-QA-75K)** training dataset!
77
86
- 🔥 [2/9/2026] We release the CapRL training code.
78
87
- 🔥 [1/27/2026] CapRL is accepted by ICLR2026! We are working on cleaning training code, and will release everything as soon as possible!
@@ -400,6 +409,30 @@ You can specify `--reward-model-path` as the path to **CapRL-Eval-3B** in `Eval_
400
409
**Usage and License Notices**: The data and code are intended and licensed for research use only.
401
410
License: Attribution-NonCommercial 4.0 International It should abide by the policy of OpenAI: https://openai.com/policies/terms-of-use
402
411
412
+
## Citation
413
+
414
+
If you find CapRL++ useful for your research, please consider citing:
415
+
416
+
```bibtex
417
+
@article{yang2026caprlplusplus,
418
+
title={CapRL++: Unified Reinforcement Learning with Verifiable Rewards for Dense Image and Video Captioning},
419
+
author={Yang, Penghui and Xing, Long and Dong, Xiaoyi and Zang, Yuhang and Cao, Yuhang and Wang, Yibin and Zhou, Yujie and Bu, Jiazi and Liang, Jianze and Huang, Qidong and Wang, Jiaqi and Wu, Feng and Lin, Dahua},
420
+
journal={arXiv preprint arXiv:2606.09393},
421
+
year={2026}
422
+
}
423
+
```
424
+
425
+
For the original CapRL paper:
426
+
427
+
```bibtex
428
+
@article{xing2025caprl,
429
+
title={CapRL: Stimulating Dense Image Caption Capabilities via Reinforcement Learning},
430
+
author={Xing, Long and Dong, Xiaoyi and Zang, Yuhang and Cao, Yuhang and Liang, Jianze and Huang, Qidong and Wang, Jiaqi and Wu, Feng and Lin, Dahua},
431
+
journal={arXiv preprint arXiv:2509.22647},
432
+
year={2025}
433
+
}
434
+
```
435
+
403
436
## ❤️ Acknowledgments
404
437
-[Open-LLaVA-NeXT](https://github.com/xiaoachen98/Open-LLaVA-NeXT): Thanks for the impressive open-source dataset.
405
438
-[VLMEvalKit](https://github.com/open-compass/VLMEvalKit): the amazing open-sourced suit for evaluating various LMMs!
0 commit comments