What features would you like to see added?
Provide warning in UI when truncating the attached text content due to exceeding set fileTokenLimit.
More details
We have encountered a situation when user uploaded a 54 page PDF document as text (approx. 130 000 tokens). Due to having default fileTokenLimit to 100 000 tokens, the file was truncated (shows warning in logs), but the user is not informed on the truncation. Therefore, user believes that LLM received whole uploaded document and its answer is based on the whole document.
We would very much appreciate if some information in the UI will appear in case of such truncation, with the intention of warning the user that the LLM answer may be incomplete (and potentially suggesting using FileSearch).
Which components are impacted by your request?
UI
Pictures
No response
Code of Conduct
What features would you like to see added?
Provide warning in UI when truncating the attached text content due to exceeding set fileTokenLimit.
More details
We have encountered a situation when user uploaded a 54 page PDF document as text (approx. 130 000 tokens). Due to having default fileTokenLimit to 100 000 tokens, the file was truncated (shows warning in logs), but the user is not informed on the truncation. Therefore, user believes that LLM received whole uploaded document and its answer is based on the whole document.
We would very much appreciate if some information in the UI will appear in case of such truncation, with the intention of warning the user that the LLM answer may be incomplete (and potentially suggesting using FileSearch).
Which components are impacted by your request?
UI
Pictures
No response
Code of Conduct