Removing a document from KB

[bolenti]

How to remove a document from KB.
To add a local document we have the command: leet kb add-local -e .env.ollama -k testkb -p MY_DOC.pdf

But how can I remove a document from the KB?

[pengfeng]

Hi, thanks for checking us out and reporting the issue.

We are working on a web UI for better knowledge base operations. Before that is ready, let us add a CLI command to support document removal.

[bolenti]

Having a web UI would be nice, but in my opinion having a complete CLI is more flexible as it would allow automating tasks.
For instance, I would like to to able to schedule a cron job to delete some documents and add other documents to a KB, then ask a couple of questions ideally using different models, feed the answers back to a model to summarise what's in common and then send this summary to somewhere else.

[pengfeng]

That's a great point and exactly why we provided the program as a CLI in the first place. We feel that LLM in the current form is still not clever or stable enough to do complex flows efficiently by themselves, but frameworks like langchain or low code tools like n8n are not flexible enough. We are on the same page and I hope leettools can achieve its goal to automate a lot of our work. Thanks for the feedback! Really appreciate it.

[pengfeng]

Just merged the PR. After you update to the latest version, you can now do

leet doc list -k testkb

to see the documents in the KB. Then for the document you want to remove, copy its document_uuid column:

leet doc remove -k testkb -i <document_uuid>

This will remove the document from the KB.

[bolenti]

Thanks, this command works.
Here's the command line I have used to remove all documents from testkb:

leet doc list -k testkb | cut -d ' ' -f1 | tail -n +2 | xargs -I {} leet doc remove -k testkb -i {}

[pengfeng]

Cool, we will add one command to delete a list. But that's some bash-fu there:-)