The development LLM proxy container has no memory limit and can consume all available RAM on low-memory machines, causing the OS to kill other services. Add resource limits appropriate for the minimum supported hardware.
Relevant files:
Estimated effort: 2–4 hours
The development LLM proxy container has no memory limit and can consume all available RAM on low-memory machines, causing the OS to kill other services. Add resource limits appropriate for the minimum supported hardware.
Relevant files:
docker-compose.ymlEstimated effort: 2–4 hours