Skip to content

Bug: Anthropic default models deprecated and no longer accept both temperature and p val. #392

@rhianelaine

Description

@rhianelaine

Expected Behaviour

When using the Anthropic Agent, the default model Sonnet-3-5 is deprecated as of October 28th, and the newer models do not accept both temperature AND top_p value.

Current Behaviour

The Anthropic default model should be non-deprecated and only pass the temperature or top_p value by default.

Code snippet

default_inference_config = {"maxTokens": 1000, "temperature": 0.1, "topP": 0.9, "stopSequences": []}

        if options.inference_config:
            self.inference_config = {**default_inference_config, **options.inference_config}
        else:
            self.inference_config = default_inference_config

Possible Solution

The Anthropic default model should be non-deprecated and only pass the temperature or top_p value by default.

Steps to Reproduce

You can try running one of your Anthropic examples.

Metadata

Metadata

Assignees

No one assigned

    Labels

    bugSomething isn't workingtriage

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions