Skip to content

Expose max retrieved document chunks in the UI/task processing provider #134

@kyteinsky

Description

@kyteinsky

Describe the feature you'd like to request

Add a field ctxLimit in the main ContextChat task processing task type to allow adjusting the no. of document chunks that are retrieved and packed into the query.
This change also needs to be done in the Assistant app.

Describe the solution you'd like

Describe alternatives you've considered

Increasing the default ctxLimit and context length of the queries in context_chat_backend.

Metadata

Metadata

Assignees

No one assigned

    Labels

    enhancementNew feature or request

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions