Add 2024-08-01-preview to AzureAIInferenceClientOptions #48894
Conversation
Supports 2024-08-01-preview in AzureAIInferenceClientOptions
makazeu
requested review from
trangevi,
dargilco,
jhakulin and
glharper
as code owners
github-actions
bot
added
AI Model Inference
AI Projects
Community Contribution
|
Thank you for your contribution @makazeu! We will review the pull request and get back to you soon. |
|
API change check APIView has identified API level changes in this PR and created following API reviews. |
There was a problem hiding this comment.
This change is being made to autogenerated code and will just be overwritten at the next generation.
The current way to handle a new api-version is by using a pipeline policy. We have a sample which shows use of a pipeline policy here: https://github.com/Azure/azure-sdk-for-net/blob/main/sdk/ai/Azure.AI.Inference/samples/Sample2_ChatCompletionsWithAoai.md
While it's not showing an api-version modification, it shows the general structure. The api-key handling can be replaced with the following line: message.Request.Uri.Query = $"?api-version={ApiVersion}"; to properly override the query parameter for api-version.
We have a work item to allow passing of api-version to the options object and this behavior will be handled for the user. But in the meantime it must be done manually.
Supports 2024-08-01-preview in AzureAIInferenceClientOptions
Should fix the issue dotnet/extensions#6130