This repository was archived by the owner on Feb 3, 2025. It is now read-only.
This repository was archived by the owner on Feb 3, 2025. It is now read-only.
[FEATURE REQUEST] Add progress bar when indexing #59
Open
Description
Is your feature request related to a problem? Please describe.
Indexing (especially local) can take a long time, which causes users to give up.
Describe the solution you'd like
We should display a progress bar (e.g. via tqdm).
Additional context
Each embedder will have a different way of calculating progress. For instance, with the OpenAIBatchEmbedder, we could have two bars: the first one for chunking + issuing indexing jobs, and the second one based on the status of indexing jobs. For the other synchronous embedders (e.g. Voyage, Gemini, Marqo), we'd just have one.