You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
|`amazon.nova-lite-v1:0`| Multimodal, low-cost with fast processing |
18
-
|`amazon.nova-pro-v1:0`| Multimodal, balanced accuracy, speed, and cost |
19
-
|`amazon.nova-premier-v1:0`| Multimodal, best for complex tasks |
14
+
Providers include:
20
15
21
-
Cross-region inference profiles (e.g., `us.amazon.nova-lite-v1:0`) are also supported. See the [Amazon Bedrock model IDs documentation](https://docs.aws.amazon.com/bedrock/latest/userguide/model-ids.html) for details.
16
+
| Family | Example model IDs |
17
+
| ------ | ----------------- |
18
+
| Amazon Nova |`amazon.nova-micro-v1:0`, `amazon.nova-lite-v1:0`, `amazon.nova-pro-v1:0`, `amazon.nova-premier-v1:0`|
19
+
| Anthropic Claude |`anthropic.claude-3-5-haiku-20241022-v1:0`, `anthropic.claude-sonnet-4-20250514-v1:0`|
20
+
| Meta Llama |`meta.llama3-1-70b-instruct-v1:0`, `meta.llama3-2-90b-instruct-v1:0`|
Cross-region inference profiles (for example, `us.amazon.nova-lite-v1:0` or `us.meta.llama3-1-70b-instruct-v1:0`) are supported. See the [Amazon Bedrock model IDs documentation](https://docs.aws.amazon.com/bedrock/latest/userguide/model-ids.html) for the latest IDs and availability by region.
22
27
23
28
To request support for additional models, file a [GitHub Issue](https://github.com/spiceai/spiceai/issues).
24
29
@@ -101,6 +106,23 @@ models:
101
106
aws_region: us-east-1
102
107
```
103
108
109
+
### Inference Profile for Models Without On-Demand Throughput
110
+
111
+
Some models (for example, several Anthropic/Meta variants) require inference profile IDs:
|`amazon.nova-lite-v1:0`| Multimodal, low-cost with fast processing |
18
-
|`amazon.nova-pro-v1:0`| Multimodal, balanced accuracy, speed, and cost |
19
-
|`amazon.nova-premier-v1:0`| Multimodal, best for complex tasks |
14
+
Providers include:
20
15
21
-
Cross-region inference profiles (e.g., `us.amazon.nova-lite-v1:0`) are also supported. See the [Amazon Bedrock model IDs documentation](https://docs.aws.amazon.com/bedrock/latest/userguide/model-ids.html) for details.
16
+
| Family | Example model IDs |
17
+
| ------ | ----------------- |
18
+
| Amazon Nova |`amazon.nova-micro-v1:0`, `amazon.nova-lite-v1:0`, `amazon.nova-pro-v1:0`, `amazon.nova-premier-v1:0`|
19
+
| Anthropic Claude |`anthropic.claude-3-5-haiku-20241022-v1:0`, `anthropic.claude-sonnet-4-20250514-v1:0`|
20
+
| Meta Llama |`meta.llama3-1-70b-instruct-v1:0`, `meta.llama3-2-90b-instruct-v1:0`|
Cross-region inference profiles (for example, `us.amazon.nova-lite-v1:0` or `us.meta.llama3-1-70b-instruct-v1:0`) are supported. See the [Amazon Bedrock model IDs documentation](https://docs.aws.amazon.com/bedrock/latest/userguide/model-ids.html) for the latest IDs and availability by region.
22
27
23
28
To request support for additional models, file a [GitHub Issue](https://github.com/spiceai/spiceai/issues).
24
29
@@ -49,6 +54,7 @@ models:
49
54
| `aws_access_key_id` | AWS access key ID. If not provided, credentials load from environment variables or IAM roles. | - |
50
55
| `aws_secret_access_key` | AWS secret access key. If not provided, credentials load from environment variables or IAM roles. | - |
0 commit comments