[Enhancement]: User UI Warning for File Truncation

[dvejsada]

What features would you like to see added?

Provide warning in UI when truncating the attached text content due to exceeding set fileTokenLimit.

More details

We have encountered a situation when user uploaded a 54 page PDF document as text (approx. 130 000 tokens). Due to having default fileTokenLimit to 100 000 tokens, the file was truncated (shows warning in logs), but the user is not informed on the truncation. Therefore, user believes that LLM received whole uploaded document and its answer is based on the whole document.

We would very much appreciate if some information in the UI will appear in case of such truncation, with the intention of warning the user that the LLM answer may be incomplete (and potentially suggesting using FileSearch).

Which components are impacted by your request?

UI

Pictures

No response

Code of Conduct

• I agree to follow this project's Code of Conduct

[casewalker]

I've seen this in the New Jersey setup: users don't know that their input files are being truncated but they assume that since their file was successfully attached, the full contents were sent to and processed by the model.

Worth noting - @Endroe implemented a solution for this in #13810