-
Notifications
You must be signed in to change notification settings - Fork 93
Dynamic tool loading based on conversation context via memory #688
Copy link
Copy link
Open
Labels
agentconsumerBlocks consumer adoption — must ship for the v0.20.0 consumer launch windowBlocks consumer adoption — must ship for the v0.20.0 consumer launch windowdomain:agent-coreFramework, tools, registry, memory, skills, orchestrationFramework, tools, registry, memory, skills, orchestrationenhancementNew feature or requestNew feature or requestp0high priorityhigh priorityperformancePerformance-critical changesPerformance-critical changesspec-readyIssue has implementation spec adequate for coding-agent assignmentIssue has implementation spec adequate for coding-agent assignmenttrack:consumer-appHermes-competitor consumer product — mobile-first, voice + messaging + memory + skillsHermes-competitor consumer product — mobile-first, voice + messaging + memory + skills
Metadata
Metadata
Assignees
Labels
agentconsumerBlocks consumer adoption — must ship for the v0.20.0 consumer launch windowBlocks consumer adoption — must ship for the v0.20.0 consumer launch windowdomain:agent-coreFramework, tools, registry, memory, skills, orchestrationFramework, tools, registry, memory, skills, orchestrationenhancementNew feature or requestNew feature or requestp0high priorityhigh priorityperformancePerformance-critical changesPerformance-critical changesspec-readyIssue has implementation spec adequate for coding-agent assignmentIssue has implementation spec adequate for coding-agent assignmenttrack:consumer-appHermes-competitor consumer product — mobile-first, voice + messaging + memory + skillsHermes-competitor consumer product — mobile-first, voice + messaging + memory + skills
Problem
Current tool descriptions consume ~12K tokens (30 tools x ~400 tokens). On a 32K context model, that is 37% consumed by tool descriptions alone. Static compression is a hack.
Approach
Dynamically load tools based on conversation context using the memory system. Memory informs which tools to activate per session. Tools not relevant to the current conversation are not loaded into the prompt.
Design:
Dependencies
Acceptance Criteria