Skip to content

Guard vector store initialization when no documents are loaded #52

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
Sasyamerugu wants to merge 1 commit into
base: main
Choose a base branch
from
Open

Guard vector store initialization when no documents are loaded #52

Changes from all commits
Commits
Show all changes
1 commit
Select commit
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
6 changes: 5 additions & 1 deletion app/ai.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -3,6 +3,7 @@
"""
import os
import torch
import logging
from transformers import pipeline
from langchain_community.vectorstores import FAISS
from langchain_huggingface import HuggingFaceEmbeddings
Expand All @@ -11,6 +12,7 @@
from langchain_core.prompts import ChatPromptTemplate
from typing import Optional, List
import app.prompts as prompts
logger = logging.getLogger("sugar-ai")

def format_docs(docs):
"""Return document content separated by newlines"""
Expand Down Expand Up @@ -116,7 +118,9 @@ def setup_vectorstore(self, file_paths: List[str]) -> Optional[FAISS]:
loader = TextLoader(file_path)
documents = loader.load()
all_documents.extend(documents)

if not all_documents:
logger.warning("No documents loaded. Retriever will not be initialized.")
return None
embeddings = HuggingFaceEmbeddings(
model_name="sentence-transformers/all-MiniLM-L6-v2"
)
Expand Down