qwen2.5-vl 3B inference is OOM, but qwen2-vl 7B does not #7149

Unanswered

missTL asked this question in Q&A

missTL
Mar 3, 2025

Reminder

I have read the above rules and searched the existing issues.

System Info

qwen2.5-vl 3B inference is OOM, but qwen2-vl 7B does not

Reproduction

qwen2.5-vl 3B inference is OOM, but qwen2-vl 7B does not

Others

No response

Replies: 0 comments

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment