RoundRobinGroupChat: As the number of messages increases, the agent takes significantly longer to respond

[iamchandanys]

Hello everyone,

I need assistance with this RoundRobinGroupChat team (https://github.com/iamchandanys/chatbot-az-autogen/blob/main/03-x-agent.py). As the number of messages increases, the agent takes significantly longer to respond, sometimes exceeding 30 seconds. Any suggestions for optimization would be greatly appreciated.

Thank you!

[ekzhu]

It might be your context length is getting too long.

Consider using BufferedChatCompletionContext instead of the default model context for AssistantAgent. See doc: https://microsoft.github.io/autogen/dev/reference/python/autogen_agentchat.agents.html#autogen_agentchat.agents.AssistantAgent: Example 5: agent with bounded model context

Or create your own implementation of ChatCompletionContext