feat: Support prompt caching

[Zephyroam]

Description

Describe your changes in detail (optional if the linked issue already contains a detailed description of the changes).

Closes #3586

Checklist

Go over all the following points, and put an x in all the boxes that apply.

• I have read the CONTRIBUTION guide (required)
• I have linked this PR to an issue using the Development section on the right sidebar or by adding Fixes #issue-number in the PR description (required)
• I have checked if any dependencies need to be added or updated in pyproject.toml and uv lock
• I have updated the tests accordingly (required for a bug fix or a new feature)
• I have updated the documentation if needed:
• I have added examples if this is a new feature

If you are unsure about any of these, don't hesitate to ask. We are here to help!

[coderabbitai]

Important

Review skipped

Auto reviews are disabled on this repository.

Please check the settings in the CodeRabbit UI or the .coderabbit.yaml file in this repository. To trigger a single review, invoke the @coderabbitai review command.

You can disable this status message by setting the reviews.review_status to false in the CodeRabbit configuration file.

✨ Finishing touches

🧪 Generate unit tests (beta)

• Create PR with unit tests
• Post copyable unit tests in a comment

---

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share

• X
• Mastodon
• Reddit
• LinkedIn

_{Comment @coderabbitai help to get the list of available commands and usage tips.}

[Wendong-Fan]

thanks @Zephyroam , left some comments below, love the optimize for current workforce prompt

[Wendong-Fan]

after the update i got error when tried to run examples/models/claude_model_example.py (case with tool calling)

[Zephyroam]

Yes, I encountered the same problem when testing, which is also the reason I introduced structured-outputs-2025-11-13.

The error is the parameters given to the tool are not complete. It seems due to the max_token limit. An easy fix is to enlarge the max_token to 8192.

[Zephyroam]

Fixed in the example.