v1.9.17

What's Changed

• chore: add anthropic_beta param by @b4s36t4 in #1060
• fix: azure content safety plugin with blocklist by @b4s36t4 in #1061
• feat: support bedrock prompt caching by @b4s36t4 in #1059
• add support for gemini thinking input params by @narengogi in #1058
• 1.9.17 by @VisargD in #1065

Full Changelog: v1.9.16...v1.9.17

v1.9.16

What's Changed

• Handle ping by @francescov1 in #1037
• Add usage to final chunk for deepinfra by @francescov1 in #1041
• fix: replace chat_completion by chat.completion in providers responses by @unsync in #1044
• feat: supports specific openrouter request parameters by @unsync in #1045
• fix: support custom mime type for vertex files by @sk-portkey in #1046
• feat: azure plugin support for pii and content safety by @b4s36t4 in #1048
• feat. add lepton ai by @Ajay-Satish-01 in #1034
• Exa plugin for online search by @roh26it in #1027
• Update pull_request_template.md by @code-crusher in #1032
• feat: passthrough oai embed response without opening body by @VisargD in #1053
• [FIX] remove /v1 from path for azure openai by @narengogi in #1056
• 1.9.16 by @VisargD in #1057

New Contributors

• @francescov1 made their first contribution in #1037

Full Changelog: v1.9.15...v1.9.16

v1.9.15

What's Changed

• fix: give preference to provider error code over hooks failure respon… by @VisargD in #1018
• Updated Markdown Files by @KPCOFGS in #1006
• feature: add openrouter tools support and handle error chunks by @unsync in #1024
• support search recency filter for perplexity by @narengogi in #1025
• Chore/return model in response by @narengogi in #982
• support responses endpoints as part of unified routes by @narengogi in #1021
• fix: handle model check for finetune/batches by @b4s36t4 in #1020
• feat: allow retry based on headers and skip expoential backoff by @b4s36t4 in #1030
• feat: update azure foundry provider by @b4s36t4 in #1029
• 1.9.14 by @VisargD in #1036
• update null check in provider config for bedrock by @narengogi in #1038
• fix: make patch package as part of main dep for docker builds & move … by @b4s36t4 in #1039
• 1.9.15 by @VisargD in #1040

New Contributors

• @KPCOFGS made their first contribution in #1006

Full Changelog: v1.9.13...v1.9.15

v1.9.13

What's Changed

• feat(guardrails): add lasso security guardrails by @raskanskyz-lasso in #971
• chore: add default status codes only when retry attempts are configured by @VisargD in #1010
• feat: add logprobs support for fireworks by @VisargD in #1009
• fix: handle 246 status code for stream responses by @VisargD in #1008
• Feat: anthropic thinking json to stream transform by @VisargD in #1014
• chore: add strict status code checks for mapping 246 response code by @VisargD in #1015
• 1.9.13 by @VisargD in #1016

New Contributors

• @raskanskyz-lasso made their first contribution in #971

Full Changelog: v1.9.12...v1.9.13

v1.9.12

What's Changed

• feat: Add Snowflake Cortex LLM API by @Ajay-Satish-01 in #988
• Feature: Changes for anthropic thinking by @narengogi in #1001
• 1.9.12 by @VisargD in #1004

Full Changelog: v1.9.11...v1.9.12

v1.9.11

What's Changed

• fix: use bedrock job_id and job_arn for response by @b4s36t4 in #958
• docs: add ec2 quicklaunch cloudformation template by @code-crusher in #978
• Add labels parameter in Vertex AI by @elentaure in #984
• fix: logging error with more than 1k characters by @urbanonymous in #970
• fix: bedrock guardrail handling update by @b4s36t4 in #990
• chore: vertex finetune and batches cleanup by @b4s36t4 in #989
• feat: kms key support for put requests in bedrock by @narengogi in #977
• handle thinking messages for anthropic by @narengogi in #987
• fix: remove conditional for bedrock list/get endpoints, date fixes by @b4s36t4 in #993
• Providers/ncompass by @vineye25 in #983
• fix: handle null content for tool use assistant message for bedrock by @VisargD in #992
• fix: add handling to detect all errors in retry handler by @VisargD in #991
• feat: add support for default guardrails by @VisargD in #986
• support passing image url for anthropic and vertex anthropic by @narengogi in #976
• support search mode param from pplx by @narengogi in #998
• changes to support cached streaming in grounding requests by @narengogi in #994
• 1.9.11 by @VisargD in #999

New Contributors

• @code-crusher made their first contribution in #978
• @urbanonymous made their first contribution in #970
• @vineye25 made their first contribution in #983

Full Changelog: v1.9.10...v1.9.11

v1.9.10

What's Changed

• add webm support for vertex prompting with images and videos by @narengogi in #967
• acuvity integration: fix guards and return data. by @abhijitherekar in #966
• chore: map usage object in openrouter stream chunk by @VisargD in #973
• 1.9.10 by @VisargD in #974

Full Changelog: v1.9.9...v1.9.10

v1.9.9

What's Changed

• chore: add acuvity scan handler in plugin mapping by @VisargD in #960
• chore: increase json to stream chunk size to avoid unnecessary extra … by @VisargD in #961
• 1.9.9 by @VisargD in #963

Full Changelog: v1.9.8...v1.9.9

v1.9.8

What's Changed

• fix: cleanups for batch & finetune by @b4s36t4 in #946
• Acuvity-portkey integration. by @abhijitherekar in #913
• Remove beta from Pangea AI-Guard path by @pangea-andrest in #948
• cache vertex generated token by @narengogi in #916
• fix: update logic for parsing errors while streaming in anthropic by @narengogi in #949
• Feat/finetune unified api by @sk-portkey in #943
• Added request json as params to conditional routing by @roh26it in #947
• fix: CVE-2024-21538 by @sk-portkey in #951
• fix: cleanup vertex batch output changes by @b4s36t4 in #956
• 1.9.8 by @VisargD in #957

New Contributors

• @abhijitherekar made their first contribution in #913

Full Changelog: v1.9.7...v1.9.8

v1.9.7

What's Changed

• feat: allow mutations in webhook plugin by @VisargD in #938
• feat: make timeout configurable for plugins by @VisargD in #940
• chore: add stream options param mapping for azure by @VisargD in #941
• 1.9.7 by @VisargD in #942

Full Changelog: v1.9.6...v1.9.7