FastChat-T5 4K context #1711

Open

Assignees

Labels

opened

on Jun 15, 2023

lmsys.org states that FastChat-T5 supports a context size of 4K. How do I get it to work? I get an error as soon as I go above 2K.

to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Assignees

DachengLi1

Labels

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests