Conversation Context/History Messages in Chat App using Autogen

[KanikaChoudhary1312]

Hi,

I have created a chat application using autogen latest version, in every session when we start asking question, every question run separate without remembering the previous question or context, how to make sure that the conversation is been related
if a question is been asked it should know the context of the answer to start the conversation in flow.
What should I use memory plugin or team state,
if we use memory, since the agents can do longer conversation, it runs out of token with the list of messages.

How do I deal? and If I use state - Can we use team_result from RUN table and use that as state for the sessions ?

[ekzhu]

Can you call run_stream orrun on the same team object across different session?

You can also call save_state and then load_state in a new session to regain the same state from the last session.

To address context overflow of the selector, we are working on a solution: #6301

For context overflow of each agent, you can simply use a custom model_context that use token or number of messages to truncate context. Or a work in progress that automatically summarize the context: #6217

[KanikaChoudhary1312]

yes, that works perfectly fine.

[ekzhu]

I updated my answer to reflect other considerations.

[KanikaChoudhary1312]

Could you please clarify, I'm a bit confused between - purpose of save_state and then load_state, Can it be used for context set within the same session? By context, I mean the history of conversation.

Do we have any example using - model_context, I tried using get_runs_from_session(session_id) which gives all the task_results to pass as list of messages, how to pass details of run in model_context

I tried using MultiModalOperator Web Surfer Agent Team - Every time it starts from Bing, even for the following queries in the same session.

Appreciate your time and response.

[victordibia]

Hi @KanikaChoudhary1312

It seems you are conflating both AutoGen framework level abstractions and AutoGen Studio.
Studio is a developer tool that is built on AutoGen studio - in theory, you do not have to integrate it into your final applications.
Also, in AutoGen studio today, the current implementation does not persist data across runs (that could be added/implemented).

Can you explain your current status? e.g.,

• You have built your own custom application with its own db and state management
• You are working with AutoGen Studio and would like to extend it in some way e.g., to make sessions resumable.

Once you clarify, we can try to suggest steps to go forward.

[KanikaChoudhary1312]

Hi @victordibia,
Thanks — you’re absolutely right, I kind of mixed things up.

Here’s my current scenario: I’ve extended AutoGen Studio into a new web app and implemented some feature- and functionality-level changes. Now, I’d like to understand how to ensure that each run maintains and shares history within the session — which, as far as I can tell, isn’t natively supported in AutoGen Studio yet. My Db Schema is similar to Autogen Studio, with some extra fields and feedback integrations.

Would love your thoughts or suggestions on how best to approach this!