-
Notifications
You must be signed in to change notification settings - Fork 672
Open
Labels
enhancementNew feature or requestNew feature or request
Description
Is your feature request related to a problem? Please describe.
When utilizing SendStreaming, we noticed that our conversation will often terminate prematurely due to rate-limiting from Bedrock. There does not seem to be Retry support for SendStreaming as there is for Send.
Describe the solution you'd like
- Utilizing
RetryinSendStreamingas it is utilized inSend - Properly parsing any Bedrock converse errors in
bedrock.go, asDefaultIsRetryableErrorseems to be unable to detect a 429 Status Code in its current state - Only committing tool calls to the conversation history if they are successful (otherwise, the number of expected tool call results expected after the retry differs from the number of tools successfully made)
Describe alternatives you've considered
Any alternative solutions or features you’ve thought of.
Additional context
Add any other context, links, or screenshots here.
Reactions are currently unavailable
Metadata
Metadata
Assignees
Labels
enhancementNew feature or requestNew feature or request