Skip to content

[feat] Add caching support for AWS Bedrock with Anthropic models #3251

@gurisko

Description

@gurisko

Product

BAML

Problem Statement / Use Case

Add support for AWS Bedrock's prompt caching in the aws-bedrock provider.

Caveat: aws-sdk-bedrockruntime is pinned to v1.106.0 where CachePointBlock only has a type field - ttl was added in v1.127.

Proposed Solution

Accept role metadata.

Alternative Solutions

No response

Additional Context

No response

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions