This repository was archived by the owner on Sep 1, 2025. It is now read-only.
Reserved tokens #53
Unanswered
francescortu
asked this question in
Q&A
Reserved tokens
#53
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
Hi all, I hope to be in the right place.
I've noticed that in the huggingface implementation of the Chameleon (huggingface/transformers#31534) the vocabulary has 8192 tokens in addition to the 8192 image tokens. What is the role of these tokens?
Thanks in advance for any clarifications :)
Beta Was this translation helpful? Give feedback.
All reactions