Tool Usage via Prompting

[NecatiErenYildiz]

I have a sql mcp server deployed. When I use an LLM with tool usage "prompt" selected, no matter what I do, the LLM usually first generate a fake response before seeing the result of the query. After fake response, it then generates the query and return real results. How can I stop LLM doing this?