Skip to content

Advanced custom parameters for models (custom OpenAI protocol) #1127

@sapphirepro

Description

@sapphirepro

Describe the need of your request

Hello.

It's implemented to add custom parameters to header and body of json requests, but problem that is some need nested params, which is impossible with current implementation.

For example to make Grok search possible (coding references to grab online, documentation etc) it's needed to enable this

https://docs.x.ai/docs/guides/live-search#enabling-search

as for example
"search_parameters": { "mode": "auto", "max_search_results": 10 },

Proposed solution

Please add support for nested parameters to body of json of models. Thanks a lot in advance!

Additional context

No response

Metadata

Metadata

Assignees

No one assigned

    Labels

    enhancementNew feature or request

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions