Skip to content

[Other] Cannot connect to a custom model endpoint that is behind Azure API Management #2739

@pressslav

Description

@pressslav

Good morning!

My team is trying to use Chatbox to connect to our Azure OpenAI deployments in the cloud. When we connect to the deployment directly with its API key it works, but when we enter the API Management URL it doesn't work because it expects a to receive a subscription key in the format 'api-key' in the header of the incoming request from Chatbox.

We're using the the 'Add Custom Provider' option in Chatbox but for some reason it just won't connect and gives a 'missing subscription key' error. I've tried to do the same using the platform for custom endpoint serving on Databrics and with their setup it all works fine. We would really prefer to use Chatbox in the future as it's open source, do you have any ideas how do I set up the API Host and API Key in the custom endpoint section to make it send the API key properly?
Otherwise could you help me understand the format of the outgoing request from Chatbox? How is the api key formatted in the request to the model endpoint?

Thank you in advance!

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions