How can I control the number of rounds in load_state?

[Smile0524]

How can I control the number of rounds in load_state? Because as the number of conversation rounds increases, so does the historical state.LLM will run slower and slower.
Is there a function to delimit the window size of the state?

[ekzhu]

Work in #6227 will address this. We can have a MessageStore implementation that is similar to the BufferedChatCompletionContext which truncates historical messages.