The rerank_id parameter is not functioning properly #12021
Replies: 3 comments 1 reply
-
|
The most common reason rerank_id doesn't trigger the rerank model is that the value must exactly match the model name registered and authorized for your tenant, including any required provider suffix (like If you're using vllm, try using the key rerank_model instead of rerank_id, and use the vendor suffix format (e.g., Check backend logs for any "Model(xxx) not authorized" errors when you make the API call. If you see no errors, compare your API request payload with a working UI request to spot hidden differences. If you recently added or changed the rerank model, make sure there are no stale or conflicting records in your backend configuration or tenant_llm table, and restart RAGFlow if you updated config files (reference). If the issue persists, capturing and comparing the full request payloads from both SDK and UI can help identify hidden differences or errors (reference). To reply, just mention @dosu. How did I do? Good | Irrelevant | Incorrect | Verbose | Hallucination | Report 🐛 | Other |
Beta Was this translation helpful? Give feedback.
-
Beta Was this translation helpful? Give feedback.
-
|
[retriever-http] HTTP POST http://127.0.0.1:9380/api/v1/retrieval Still not working: ( |
Beta Was this translation helpful? Give feedback.


Uh oh!
There was an error while loading. Please reload this page.
-
[retriever-http] HTTP POST http://127.0.0.1:9380/api/v1/retrieval
[retriever-http] headers: {"Authorization": "Bearer ragf...8Tis", "Content-Type": "application/json"}
[retriever-http] payload: {"question": "test", "dataset_ids": ["c54559cad7ac11f098d31dbfcf0"], "page": 1, "page_size": 15, "top_k": 25, "vector_similarity_weight": 0.32, "rerank_id": "BAAI/bge-reranker-v2-m3@SILICONFLOW", "keyword": false, "highlight": false}
[retriever-http] HTTP POST http://127.0.0.1:9380/api/v1/retrieval
[retriever-http] headers: {"Authorization": "Bearer ragf...8Tis", "Content-Type": "application/json"}
[retriever-http] payload: {"question": "test", "dataset_ids": ["c54559cad7ac11f098d31dbfcf0"], "page": 1, "page_size": 15, "top_k": 25, "vector_similarity_weight": 0.32, "rerank_id": "BAAI/bge-reranker-v2-m3", "keyword": false, "highlight": false}
When I call the retrieval interface and pass the rerank_id parameter, the rerank model is not actually invoked. I have already configured it correctly.How can I troubleshoot where the issue might be?
Beta Was this translation helpful? Give feedback.
All reactions