Open
Description
AWS Bedrock has support for latency optimization that speeds up response times for certain models. Would love to be able to take advantage of this using Spring AI.
AWS Docs - https://docs.aws.amazon.com/bedrock/latest/userguide/latency-optimized-inference.html
Metadata
Metadata
Assignees
Labels
No labels