Add `cache_control` attribute to Message

[NexumIT]

Within Claude AI you can pass a attribute for caching.

$data = [
    "model" => "claude-3-5-sonnet-20240620",
    "max_tokens" => 1024,
    "messages" => [
        [
            "role" => "user",
            "content" => [
                [
                    "type" => "text",
                    "text" => $prompt,
                ]
            ]
        ],
        [
            "role" => "assistant",
            "content" => [
                [
                    "type" => "tool_use",
                    "id" => "tool_1",
                    "name" => "get_weather",
                    "input" => [
                        "location" => "Amsterdam"
                    ],
                    "cache_control" => ["type" => "ephemeral"] // Cache the tool call
                ]
            ]
        ],
        [
            "role" => "user",
            "content" => [
                [
                    "type" => "text",
                    "text" => $question
                ]
            ]
        ]
    ]
];

I can't find how to do this. Is this possible? If not, is it possible to add?
Thanks

[bjalt]

Thinking of it this should probably be an option of the Tool being called. Later this can then be handled when the MessageBag is serialized. I'm not sure though how the invalidation would take place since the time of the tool call during different API invocations is not known.
For Anthropic is is currently a minimum setting of 5 minutes (see Prompt caching - Limitation).

[chr-hertel]

I think it is not possible at this point, could be a good addition as tool or call option