Skip to content

Prompt truncation#82

Merged
vhaldemar merged 9 commits intomasterfrom
prompt_truncation
Apr 8, 2025
Merged

Prompt truncation#82
vhaldemar merged 9 commits intomasterfrom
prompt_truncation

Conversation

@vhaldemar
Copy link
Copy Markdown
Collaborator

No description provided.

@vhaldemar vhaldemar force-pushed the prompt_truncation branch from c2bf065 to 8843028 Compare April 7, 2025 17:35
@vhaldemar vhaldemar force-pushed the prompt_truncation branch from 8843028 to aa0d79d Compare April 7, 2025 17:35

raise TypeError(
'prompt truncation strategy could be "auto", '
'integer as for LastMessagesPromptTruncationStrategy shortcut '
Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

звучит как какая-то сильная завязка UX на то, что int в качестве шортката обязательно относится к LastMessages
по идее нет уверенности, что тут не появится какой-то другой стратегии тоже с одним int'ом на входе
более того при наличии рядом int'а для max prompt tokens становится прям неочевидно

@vhaldemar vhaldemar merged commit ef23b5d into master Apr 8, 2025
10 checks passed
@vhaldemar vhaldemar deleted the prompt_truncation branch September 19, 2025 13:37
GBocharov pushed a commit that referenced this pull request Nov 28, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants