Python: azure ai service model invoke fails with no_model_name error code in sk python

[PurnaChandraPanda]

Code snippet

import os
import asyncio
from semantic_kernel.contents.chat_history import ChatHistory
from semantic_kernel.connectors.ai.prompt_execution_settings import PromptExecutionSettings
from semantic_kernel.connectors.ai.azure_ai_inference import AzureAIInferenceChatCompletion
from semantic_kernel.connectors.ai.azure_ai_inference import AzureAIInferenceChatPromptExecutionSettings
from azure.ai.inference import ChatCompletionsClient
from azure.core.credentials import AzureKeyCredential
from dotenv import load_dotenv

load_dotenv("../.env")

llm = AzureAIInferenceChatCompletion(
    endpoint=os.getenv("AZUREAI_INFERENCE_ENDPOINT"), # "https://{myresource}.services.ai.azure.com/models"
    api_key=os.getenv("AZUREAI_ENDPOINT_KEY"),
    ai_model_id="phi-4",
    service_id="phi-4",
)

# execution_settings = AzureAIInferenceChatPromptExecutionSettings(
#     max_tokens=100,
#     temperature=0.5,
#     top_p=0.9,
#     service_id="phi-4",
#     model_id="phi-4",
#     # extra_parameters={...},    # model-specific parameters
# )

execution_settings = PromptExecutionSettings(model="phi-4")

async def main():
    chat_history = ChatHistory(messages=[{"role": "user", "content": "Hello"}])
    
    response = await llm.get_chat_message_content(chat_history, 
                                                  execution_settings,
                                                  headers={"x-ms-model-mesh-model-name": "phi-4"},
                                                  )
    print(response)

if __name__ == "__main__":
    asyncio.run(main())

Error details

Traceback (most recent call last):
  File "/afh/projects/aiproj01-ea1be05d-2ca9-4751-94bd-64549ebf820f/shared/Users/pupanda/ai-foundation-models/ai-inference/phi/phi4-sk.py", line 41, in <module>
    asyncio.run(main())
  File "/anaconda/envs/azureml_py310_sdkv2/lib/python3.10/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/anaconda/envs/azureml_py310_sdkv2/lib/python3.10/asyncio/base_events.py", line 649, in run_until_complete
    return future.result()
  File "/afh/projects/aiproj01-ea1be05d-2ca9-4751-94bd-64549ebf820f/shared/Users/pupanda/ai-foundation-models/ai-inference/phi/phi4-sk.py", line 34, in main
    response = await llm.get_chat_message_content(chat_history,
  File "/anaconda/envs/azureml_py310_sdkv2/lib/python3.10/site-packages/semantic_kernel/connectors/ai/chat_completion_client_base.py", line 197, in get_chat_message_content
    results = await self.get_chat_message_contents(chat_history=chat_history, settings=settings, **kwargs)
  File "/anaconda/envs/azureml_py310_sdkv2/lib/python3.10/site-packages/semantic_kernel/connectors/ai/chat_completion_client_base.py", line 142, in get_chat_message_contents
    return await self._inner_get_chat_message_contents(chat_history, settings)
  File "/anaconda/envs/azureml_py310_sdkv2/lib/python3.10/site-packages/semantic_kernel/connectors/ai/azure_ai_inference/services/azure_ai_inference_chat_completion.py", line 127, in _inner_get_chat_message_contents
    response: ChatCompletions = await self.client.complete(
  File "/anaconda/envs/azureml_py310_sdkv2/lib/python3.10/site-packages/azure/ai/inference/aio/_patch.py", line 670, in complete
    raise HttpResponseError(response=response)
azure.core.exceptions.HttpResponseError: (no_model_name) No model specified in request. Please provide a model name in the request body or as a x-ms-model-mesh-model-name header.
Code: no_model_name
Message: No model specified in request. Please provide a model name in the request body or as a x-ms-model-mesh-model-name header.
Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7fb32ae6c850>
Unclosed connector
connections: ['deque([(<aiohttp.client_proto.ResponseHandler object at 0x7fb322838640>, 2558.922774265)])']
connector: <aiohttp.connector.TCPConnector object at 0x7fb32ae6c9a0>

This error of no_model_name comes from azure-ai-inference in SK. SK wrapper is not able to pass model vaue to ChatcompletionClient. So, when client.complete() tried, it just says model name info is missing.

It looks like a bug. Does anyone have any insights if thing can be addressed from client side?

[moonbox3]

@TaoChenOSU any thoughts on this?

[TaoChenOSU]

Hi @PurnaChandraPanda,

The ai_model_id doesn't point the connector to the specified model. The ai_model_id is a parameter users can use for identifying what model the connector is created with in the case of AzureAIInference.

For Azure AI Inference, your endpoint should point directly to your model. It should look something like this: https://Phi-4-xxxxx.southcentralus.models.ai.azure.com if you're using serverless compute.

[PurnaChandraPanda]

Hello @TaoChenOSU, @moonbox3

Thank you for the response.

I am using the "azure ai model service endpoint" in ai foundry - https://learn.microsoft.com/en-us/azure/ai-foundry/model-inference/how-to/inference?tabs=python#using-the-routing-capability-in-the-azure-ai-model-inference-endpoint. As per which, the base_url would appear as https://{myresource}.services.ai.azure.com/models.

Could you please try the same in your end? You would notice the same error as me.

On ai-model-id, i just passed the model name here, which is phi-4 in my case. Shall i pass a different value here otherwise?

[amphitekne]

Hello,

I'm experiencing the same issue as @PurnaChandraPanda, I am following the instructions mentioned in the url, in my case I am using DeepSeek-R1.

Has there been any update on this?

thanks!

[koreyspace]

Hi, also having this issue with the AI Inference SDK.

I a puliing the model endpoint directly from the Azue AI Foundry using the "Get Endpoint". I think ideally this should be the endpoint I need for the connector vs a different URL endpoint.

[koreyspace]

Tried an older version without of the Azure Inference SDK - azure-ai-inference==1.0.0b5 without any luck.

The inference endpoint structure that @TaoChenOSU suggested looks different now as @PurnaChandraPanda suggested.

When using AI Foundry - https://.services.ai.azure.com/models and this when using GH Models: https://models.inference.ai.azure.com/ .

I can't seem to find where the "https://model-name.region.models.ai.azure.com/" endpoint comes from. W

When I try to use that structure I get - Content: {"status": "Serverless endpoint not found"}.

[TaoChenOSU]

Hi,

There are multiple model deployment methods on AI Foundry.

I was referring to the model-as-a-service deployment type (a.k.a serverless endpoint). You can read more about it here. This deployment type doesn't require a model id in the request as the endpoint itself only serves one model.

What @PurnaChandraPanda is using is a relatively new deployment type. In fact, it's still a preview feature on AI Foundry. It allows developers to link an Azure AI Service resource to an AI Foundry project. Once linked, future model deployments will be accessible from the AI service resource via an endpoint and a model id: https://learn.microsoft.com/en-us/azure/ai-foundry/model-inference/how-to/inference?tabs=python#using-the-routing-capability-in-the-azure-ai-model-inference-endpoint.

This PR addresses the issue: #10427

When using a serverless endpoint, the ai_model_id is not used. When using an AI service endpoint, the ai_model_id will be used to route the request to the specified model.