How to use Azure based embedding model for redis semantic cache?

[ianaware]

I am trying to set up redis semantic cache.

It says 'Setting cache on proxy' and then errors upon start up.

Setting Cache on Proxy LiteLLM WARNING   litellm.set_verboseis deprecated. Please setos.environ['LITELLM_LOG'] = 'DEBUG'` for debug logs.

ERROR: Traceback (most recent call last):
File "/usr/lib/python3.13/site-packages/litellm/llms/openai/openai.py", line 1243, in embedding
headers, sync_embedding_response = self.make_sync_openai_embedding_request(...)
File "/usr/lib/python3.13/site-packages/openai/resources/embeddings.py", line 132, in create
return self._post("/embeddings", ...)
File "/usr/lib/python3.13/site-packages/openai/_base_client.py", line 1047, in request
raise self._make_status_error_from_response(err.response) from None
openai.AuthenticationError: Error code: 401 - {'error': {'message': 'Incorrect API key provided: **************. You can find your API key at https://platform.openai.com/account/api-keys.', 'type': 'invalid_request_error', 'code': 'invalid_api_key'}}

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File "/usr/lib/python3.13/site-packages/litellm/main.py", line 4810, in embedding
raise exception_type(...)
litellm.exceptions.AuthenticationError: litellm.AuthenticationError: AuthenticationError: OpenAIException - Error code: 401 - {'error': {'message': 'Incorrect API key provided: **************', 'type': 'invalid_request_error', 'code': 'invalid_api_key'}}

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File "/usr/lib/python3.13/site-packages/redisvl/utils/vectorize/text/custom.py", line 114, in init
raise ValueError(f"Failed to validate embed method: {e}")
ValueError: Failed to validate embed method: litellm.AuthenticationError: AuthenticationError: OpenAIException - Error code: 401 - {'error': {'message': 'Incorrect API key provided: **************', 'type': 'invalid_request_error', 'code': 'invalid_api_key'}}

ERROR: Application startup failed. Exiting.

In my yaml file I have an embedding model from Azure:

model_list:
     - model_name: text-embedding-3-small
       litellm_params:
         model: azure/text-embedding-3-small
         api_base: os.environ/AZURE_API_BASE
         api_key: os.environ/AZURE_API_KEY
         api_version: "2024-02-01"
         azure_deployment: text-embedding-3-small
         azure_api_type: azure

and I set this to use it:

redis_semantic_cache_embedding_model: text-embedding-3-small

Can anyone kindly help me with this or is the use of non-OpenAI embedding models not supported?

[Jithendra0001]

Hey, I’m also getting the same issue. Has it been resolved?