enhance: truncate long toolkit responses

[Wendong-Fan]

Description

Describe your changes in detail (optional if the linked issue already contains a detailed description of the changes).

Checklist

Go over all the following points, and put an x in all the boxes that apply.

• I have read the CONTRIBUTION guide (required)
• I have linked this PR to an issue using the Development section on the right sidebar or by adding Fixes #issue-number in the PR description (required)
• I have checked if any dependencies need to be added or updated in pyproject.toml and uv lock
• I have updated the tests accordingly (required for a bug fix or a new feature)
• I have updated the documentation if needed:
• I have added examples if this is a new feature

If you are unsure about any of these, don't hesitate to ask. We are here to help!

[coderabbitai]

Important

Review skipped

Auto reviews are disabled on this repository.

Please check the settings in the CodeRabbit UI or the .coderabbit.yaml file in this repository. To trigger a single review, invoke the @coderabbitai review command.

You can disable this status message by setting the reviews.review_status to false in the CodeRabbit configuration file.

✨ Finishing touches

🧪 Generate unit tests (beta)

• Create PR with unit tests
• Post copyable unit tests in a comment
• Commit unit tests in branch single_step_summary

---

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share

• X
• Mastodon
• Reddit
• LinkedIn

_{Comment @coderabbitai help to get the list of available commands and usage tips.}

[a7m-1st]

Works as expected thanks @Wendong-Fan. On the event the max_tokens is too small the model was able to recognize the limitation and adjust by calling the tool again to get relevant details.

{'role': 'tool', 'content': "\n\n[TRUNCATED] Tool 'shell_exec' output truncated (2463 > 450 tokens). Tool executed successfully.total 31M\ndrwxr-xr-x 1 root root   4.0K Dec 16 12:14 .\ndrwxr-xr-x 1 root root   4.0K Oct 13 14:02 ..\n-rwxr-xr-x 1 root root    
55K Jun 22 16:21 [\n-rwxr-xr-x 1 root root    15K Jun  5  2025 addpart\n-rwxr-xr-x 1 root root    19K Oct 22  2024 apt\n-rwxr-xr-x 1 root root    87K Oct 22  2024 apt-cache\n-rwxr-xr-x 1 root root    27K Oct 22  2024 apt-cdrom\n-rwxr-xr-x 1 root root    
31K Oct 22  2024 apt-config\n-rwxr-xr-x 1 root root    51K Oct 22  2024 apt-get\n-rwxr-xr-x 1 root root    28K Oct 22  2024 apt-key\n-rwxr-xr-x 1 root root    55K 
Oct 22  2024 apt-mark\n-rwxr-xr-x 1 root root    35K Jun 22 16:21 arch\nlrwxrwxrwx 1 root root     21 Apr  8  2024 awk -> /etc/alternatives/awk\n-rwxr-xr-x 1 root root    55K Jun 22 16:21 b2sum\n-rwx",
 'tool_call_id': 'tooluse_zMAPPTzDTT2zgqc2aSuI9g'}

[a7m-1st]

Here is the ChatAgent response:

Perfect! Now I can see everything clearly. \n\n
What I see as the tool response:
The tool is showing [TRUNCATED] Tool 'shell_exec' output truncated (2440 > 450 tokens) - meaning the output is being automatically truncated because it exceeds the token limit (2440 tokens being cut down to 450 tokens).\n\n

The solution I used:
To get the complete output, I ran: ls -lah /usr/bin | head -100 | tail -11
This shows me the last 11 lines (lines 90-100) of the output, and now I can see the complete, untruncated view of line 100