Missing citation / reference from time to time

[florentsbd]

Hi Everyone,

Firstly, This web app works great most of the time !
However, from to time, I see that the citation / reference are missing despite the fact that the answer is going from our indexed content (which I was able to figure out asking follow up questions).

Another example :

Have you experienced the same ?

When using Azure AI Studio, I have no problem :

Thanks.

Regards,
Florent

[florentsbd]

I actually figured out this issue.
This web app is doing a all-in-one call to Azure OpenAI using extension with extra parameters for the search query.
See here https://learn.microsoft.com/en-us/azure/ai-services/openai/reference#completions-extensions.
That Azure Open AI extension has a bug and doesn't always include references (adding [docx] tag) in the response which lead to missing citation (AnswerParser.tsx needs some [docx] tags to display those citations).
So conclusion, it is not a bug in the web app but in the Azure Open AI Extension API endpoint.
I fixed that issue by doing 2 different calls changing the logic in the app.py where I first do a call to the Azure AI Search index to fetch all relevant documents and then do a call to Azure Open AI / LLM to get my completion augmenting the prompt with relevant retrieved document. I then make sure my completion include all the [docx] tags. That way it works perfectly and I have much better control on what is retrieved from the search too.
Hope it will help others.

[reminegrier]

Hi Florent,

Thank you for posting your solution. I'd like to implement this logic (by 2 steps) to enhance all the process and keep control at each step.

Would it be possible, please, to share with us the exact way you made it by sharing your app.py ?

I really would appreciate to see the best way about implementing this solution,

Regards