Skip to content

Fix the bedrock inference profile missing issue for sonnet 3.7#113

Open
wang2nd wants to merge 1 commit intoaws-samples:mainfrom
wang2nd:bug/inference_profile_fix
Open

Fix the bedrock inference profile missing issue for sonnet 3.7#113
wang2nd wants to merge 1 commit intoaws-samples:mainfrom
wang2nd:bug/inference_profile_fix

Conversation

@wang2nd
Copy link
Copy Markdown

@wang2nd wang2nd commented Feb 26, 2025

identify inference_profile type from the foundation model list response itself

Issue #, if available:

Description of changes:

By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of your choice.

identify inference_profile type from the foundation model list response itself
@daixba
Copy link
Copy Markdown
Contributor

daixba commented Feb 27, 2025

Thanks for the contribution. But I don't see any bugs so far using sonnet 3.7.

Can you please describe what issue (bug) you faced and why we need this fix?

@wang2nd
Copy link
Copy Markdown
Author

wang2nd commented Mar 3, 2025

I could not see sonnet 3.7 interference profile listed in the models api without changes, even after I checked out the main and rebuilt the server again.

@daixba
Copy link
Copy Markdown
Contributor

daixba commented Mar 7, 2025

You can try to redeploy this solution and you should be able to use the Sonnet 3.7.

If you just deployed recently, try run curl -s $OPENAI_BASE_URL/models -H "Authorization: Bearer $OPENAI_API_KEY" | jq .data to refresh the model list.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants