Skip to content

Commit 98b019a

Browse files
committed
RHAIENG-2046: Update Bedrock config to use AWS_BEARER_TOKEN_BEDROCK
Align with upstream llama-stack PR #4152. Signed-off-by: skamenan7 <skamenan@redhat.com>
1 parent c20784c commit 98b019a

File tree

1 file changed

+3
-11
lines changed

1 file changed

+3
-11
lines changed

distribution/run.yaml

Lines changed: 3 additions & 11 deletions
Original file line numberDiff line numberDiff line change
@@ -20,19 +20,11 @@ providers:
2020
max_tokens: ${env.VLLM_MAX_TOKENS:=4096}
2121
api_token: ${env.VLLM_API_TOKEN:=fake}
2222
tls_verify: ${env.VLLM_TLS_VERIFY:=true}
23-
- provider_id: ${env.AWS_ACCESS_KEY_ID:+bedrock}
23+
- provider_id: ${env.AWS_BEARER_TOKEN_BEDROCK:+bedrock}
2424
provider_type: remote::bedrock
2525
config:
26-
aws_access_key_id: ${env.AWS_ACCESS_KEY_ID:=}
27-
aws_secret_access_key: ${env.AWS_SECRET_ACCESS_KEY:=}
28-
aws_session_token: ${env.AWS_SESSION_TOKEN:=}
29-
region_name: ${env.AWS_DEFAULT_REGION:=}
30-
profile_name: ${env.AWS_PROFILE:=}
31-
total_max_attempts: ${env.AWS_MAX_ATTEMPTS:=}
32-
retry_mode: ${env.AWS_RETRY_MODE:=}
33-
connect_timeout: ${env.AWS_CONNECT_TIMEOUT:=60}
34-
read_timeout: ${env.AWS_READ_TIMEOUT:=60}
35-
session_ttl: ${env.AWS_SESSION_TTL:=3600}
26+
api_key: ${env.AWS_BEARER_TOKEN_BEDROCK:=}
27+
region_name: ${env.AWS_DEFAULT_REGION:=us-east-2}
3628
- provider_id: sentence-transformers
3729
provider_type: inline::sentence-transformers
3830
config: {}

0 commit comments

Comments
 (0)