Skip to content

[Backend] Containerize the Full Stack (Docker Compose) #75

@cnu1812

Description

@cnu1812

Currently, using llama.cpp for local hardware and a "Release Process". To make it easier for enterprise users to deploy, we need a containerized version.

Create a docker-compose.yml that spins up:

  • The FastAPI Backend.

  • The Frontend (served via Nginx).

  • A vector store container if migrating away from local FAISS. Constraint: Must handle the llama.cpp model loading inside the container efficiently.

Metadata

Metadata

Labels

Type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions