The bridge currently exposes four separate channel tools, all loaded up front, which costs roughly 400 tokens of always-on tool-definition overhead per session whether or not channels ever get used. whoami is its own tool too, even though its only real use is recovering identity after a failed join.
Sketch: fold the four channel tools into one channel(action=...) tool, and fold whoami into the join error path instead of keeping it standalone. Add a CAUCUS_TOOLS=minimal env mode that trims the tool surface further, saving roughly 1,000 tokens for sessions that don't need the full set.
This is a breaking change to the tool surface and needs a PROTOCOL_VERSION bump.
The bridge currently exposes four separate channel tools, all loaded up front, which costs roughly 400 tokens of always-on tool-definition overhead per session whether or not channels ever get used. whoami is its own tool too, even though its only real use is recovering identity after a failed join.
Sketch: fold the four channel tools into one channel(action=...) tool, and fold whoami into the join error path instead of keeping it standalone. Add a CAUCUS_TOOLS=minimal env mode that trims the tool surface further, saving roughly 1,000 tokens for sessions that don't need the full set.
This is a breaking change to the tool surface and needs a PROTOCOL_VERSION bump.