The Feature
Currently, If the model version is not supported Gateway will return 500.
Instead it should try to call the target API and log what it can. Maybe a special flag/parameter could turn this behavior on/off.
Motivation, pitch
- this is not good proxy behaviour
- many model versions has zero changes but can't be used because of this limitation
- lower the integration barrier, the first priority is keeping old behavior and only then adding tracking and other features provided by Helicone
Twitter / LinkedIn details
No response