Skip to content

feat: add LLMReranker #443

Open
Open
@micpst

Description

@micpst

Feature description

Add a new reranker that will use LLM to rerank elements. There is a nice implementation by OpenAI, this cookbook can be used as a referance - https://cookbook.openai.com/examples/search_reranking_with_cross-encoders

Motivation

Most RAGs require some sort of reranking, setting up external provider in most cases is impossible due to clients constraints and setting up local model requires more effort than just adding a new LLM call. This reranker should speed up development process since some projects are already using similar implementations based on ragbits.

Additional context

No response

Metadata

Metadata

Assignees

Labels

featureNew feature or request

Type

No type

Projects

Status

In Progress

Relationships

None yet

Development

No branches or pull requests

Issue actions