v0.31.1 Llama 3 template

Edit: This is superseeded by v0.35.0

It's now possible to use Llama 3 and derivatives. There's some extra prompting needed:

Replace the USER_START and USER_END with this:

SYSTEM_START: '<|begin_of_text|><|eot_id|><|start_header_id|>system<|end_header_id|>\n\n'

USER_START: '<|eot_id|><|start_header_id|>user<|end_header_id|>\n\n'

USER_END: <|eot_id|><|start_header_id|>assistant<|end_header_id|>\n\n'

PROMPT_END: '<|eot_id|><|start_header_id|>assistant<|end_header_id|>\n\n'

And a few small fixes I noticed

What's Changed

• llama3 "template" by @neph1 in #87

Full Changelog: v0.31.0...v0.31.1