Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: support bi-encoder models in TransformerSimilarityRanker #8245

Open
Amnah199 opened this issue Aug 16, 2024 · 1 comment
Open

feat: support bi-encoder models in TransformerSimilarityRanker #8245

Amnah199 opened this issue Aug 16, 2024 · 1 comment
Labels
2.x Related to Haystack v2.0 P3 Low priority, leave it in the backlog type:feature New feature or request

Comments

@Amnah199
Copy link
Contributor

Is your feature request related to a problem? Please describe.
The current implementation of TransformerSimilarityRanker only supports cross-encoder models, which limits the use of bi-encoder models like ColBERT v2.0.

Related discussion: Colbert as reranker

Describe the solution you'd like
Update the TransformerSimilarityRanker or creating a new component to support bi-encoder models like ColBERT.

Describe alternatives you've considered
Leave the current implementation as is.

Additional context
Similar implementation: Llama ColbertRerank

@Amnah199 Amnah199 added type:feature New feature or request 2.x Related to Haystack v2.0 labels Aug 16, 2024
@julian-risch julian-risch added the P3 Low priority, leave it in the backlog label Aug 16, 2024
@peteriz
Copy link

peteriz commented Aug 19, 2024

fastRAG is an extension of Haystack and has a Bi-encoder similarity ranker. You're invited to check it out here.
And also ColBERT and PLAID support ..

@julian-risch We will be happy to contribute the bi-encoder ranker upstream to Haystack.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
2.x Related to Haystack v2.0 P3 Low priority, leave it in the backlog type:feature New feature or request
Projects
Development

No branches or pull requests

3 participants