what is the chat mode internal syntax/format? #739
-
|
I'm not sure what is happening internally using chat modes. What would be the syntax that chat modes use? I assume the cai-chat mode uses syntax that is the same as the way pilymon is trained, for best accurate results. It's not easy to see :( (I am wanting to auto-include |
Beta Was this translation helpful? Give feedback.
Replies: 1 comment
-
|
With Example.yaml the chat mode/cai-chat mode sends this text directly to the model. The UI doesn't add any special syntax unless you provide it in the YAML (though it does substitute {{user}} and {{char}} with the appropriate names). All of your chat responses are prefixed with {{user}}: internally. Note that I only checked this for llamacpp and am not sure if things are different for other models. |
Beta Was this translation helpful? Give feedback.
With Example.yaml the chat mode/cai-chat mode sends this text directly to the model. The UI doesn't add any special syntax unless you provide it in the YAML (though it does substitute {{user}} and {{char}} with the appropriate names). All of your chat responses are prefixed with {{user}}: internally.
Note that I only checked this for llamacpp and am not sure if things are different for other models.