Skip to content

Fix Claude 3.7 Sonnet model ID#208

Merged
jackbot merged 1 commit into
mainfrom
sonnet-cross-region-model-id
May 6, 2025
Merged

Fix Claude 3.7 Sonnet model ID#208
jackbot merged 1 commit into
mainfrom
sonnet-cross-region-model-id

Conversation

@jackbot
Copy link
Copy Markdown
Contributor

@jackbot jackbot commented May 6, 2025

We're using this model via Bedrock's cross region inference, meaning we
need to use the Inference profile ID rather than the generic model ID.

We're using this model via Bedrock's cross region inference, meaning we
need to use the Inference profile ID rather than the generic model ID.
@govuk-ci govuk-ci temporarily deployed to govuk-chat-sonnet-cross-74hjhk May 6, 2025 13:25 Inactive
Copy link
Copy Markdown
Member

@kevindew kevindew left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Nice, has it run ok locally?

@jackbot
Copy link
Copy Markdown
Contributor Author

jackbot commented May 6, 2025

Yep, tested all the classes that use this model (guardrails, rephrasing, question routing) and they're all running successfully.

@jackbot jackbot merged commit 2701c8b into main May 6, 2025
8 checks passed
@jackbot jackbot deleted the sonnet-cross-region-model-id branch May 6, 2025 13:27
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants