Question about FixedToken (insertion)? #73
Answered
by
mmoskal
JohnPeng47
asked this question in
Q&A
|
Is the fixedToken inserted into the transformer decoding stream after aici detects that a specified character has been generated? To clarify, because I'm very unfamiliar with transformer terminology, I understand that the auto encoder/decoder generates n tokens, where the m (<n)th token is conditioned on the previous m-1 tokens. So does fixedToken actually insert a token into the m+1 generation stream, after it has detected tokens generated in the previous [0, m] range? |
Answered by
mmoskal
Mar 13, 2024
Replies: 1 comment 1 reply
|
You can choose where you want to insert fixed tokens. They behave exactly like regular prompts, except you can insert them after some tokens have been generated. |
1 reply
Answer selected by
mmoskal
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
You can choose where you want to insert fixed tokens. They behave exactly like regular prompts, except you can insert them after some tokens have been generated.