-
Notifications
You must be signed in to change notification settings - Fork 242
Open
Labels
enhancementNew feature or requestNew feature or request
Description
The model API configuration page does not support setting additional parameters, such as extra_headers and extra_body.
In the OpenAI SDK, there is an extra_body parameter available in the Completions.create method, which allows users to add additional JSON properties to the request body. This feature can be very useful in various scenarios, especially when needing to send extra data that is not covered by the predefined parameters.
Besides, I often use OpenRouter api and need to configure the provider router along with specific quantization settings to reduce model size and achieve the best model performance.
Please consider adding this feature.
Metadata
Metadata
Assignees
Labels
enhancementNew feature or requestNew feature or request