Skip to content

Separate FAISS index creation from init#59

Merged
luciaquirke merged 1 commit intomainfrom
update-faiss
Nov 7, 2025
Merged

Separate FAISS index creation from init#59
luciaquirke merged 1 commit intomainfrom
update-faiss

Conversation

@luciaquirke
Copy link
Collaborator

@luciaquirke luciaquirke commented Nov 7, 2025

  • Write a config to the faiss directory
  • Separate create from init
  • Require sufficient RAM upfront
  • Enable calculating full scores with FAISS
    • FAISS is optimized for the TopK use case but it's good for convenience. We probably want to provide a separate utility for calculating full scores straight from the mmap in the long term because building the index seems unlikely to be worth it for just scoring (?)

@luciaquirke luciaquirke requested a review from LouisYRYJ November 7, 2025 00:48
@luciaquirke luciaquirke merged commit 49fea35 into main Nov 7, 2025
3 checks passed
@luciaquirke luciaquirke deleted the update-faiss branch November 17, 2025 07:16
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants