Skip to content

Rerankers and llama-cpp-python version issue #113

Open
@ThomasDelsart

Description

@ThomasDelsart

Rerankers package issue

I am using the Cohere API inside Raglite.
During the process and with correct configuration of the reranker, the rerankers package throws an error.
We are using as part of raglite the version 0.8.0 for the rerankers package (see uv.lock). This issue from the rerankers package is the one that happened for me: AnswerDotAI/rerankers#59. It was issued 1 month ago and it is worked on currently.

The immediate solution is to downgrade rerankers from 0.8.0 to 0.6.1 (tested successfully with Cohere) such that API-based rerankers work smoothly inside Raglite. This should be done inside pyproject.toml.

Note: I ran the following commands to list all versions of the package: $ pip index versions rerankers
Available versions: 0.8.0, 0.7.1, 0.7.0, 0.6.1, 0.6.0, 0.5.3, 0.5.2.post1, 0.5.2, 0.5.1, 0.5.0, 0.4.0, 0.3.1, 0.3.0, 0.2.0, 0.1.2.post1, 0.1.2, 0.1.1, 0.1.0.post1, 0.1.0, 0.0.2.post1, 0.0.2, 0.0.1.post2, 0.0.1.post1, 0.0.1

0.8.0, 0.7.1, 0.7.0 all have the issues mentioned above, so 0.6.1 is the first we can use.

Llama-cpp-python package issue

When installing everything automatically via uv, it tries to install llama-cpp-python versin 0.3.8. It raises issues on my project. Installing version 0.3.2 worked for me. This should be done inside pyproject.toml.

Metadata

Metadata

Assignees

Labels

bugSomething isn't working

Type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions