LLM service enters restart loop due to insufficient memory

[Harshavardhanchary]

Bug Report

Tested on: main branch
Environment: Docker compose
(Observed on latest main as of deployment)

Symptom

The LLM service repeatedly restarts when using docker-compose.yaml with a memory limit of 50M. The container enters a restart loop and the service does not become available.

A clear and concise description of what the bug is.

The LLM service should start successfully and remain stable using the default resource configuration defined in docker-compose.yaml.

What is the actual behavior?
When the memory limit in docker-compose.yaml is set to 50M:
The LLM service container restarts continuously

The service never becomes ready

Logs indicate failure during startup

Increasing the memory limit to 100M in docker-compose.yaml allows the container to start and run normally without restarts.

Additional Context

This issue occurs specifically when running the demo using Docker Compose.

Increasing the memory limit from 50M to 100M consistently resolves the restart loop.

Screenshots showing container restarts have been attached for reference.