Skip to content

Latest commit

 

History

History
26 lines (18 loc) · 514 Bytes

File metadata and controls

26 lines (18 loc) · 514 Bytes

faiss-s3

On-demand Faiss vector search from S3. Lazy-loads clusters without fetching entire index. Original implementation: https://github.com/at15/faiss/tree/at15/faiss-on-s3/demos/s3_ivf

TODO

  • implement filter on metadata
  • benchmark using larger dataset

Usage

  • Add how to build server
python3.13 -m venv .venv
source .venv/bin/activate
# Brings in boto3 and faiss-cpu
pip install -e ./client
# Generate embeddings
pip install sentence-transformers pandas

License

MIT