Missing files from container

[anfredette]

When testing pr #45, /scripts/schema.sql and /app/scripts/load_benchmarks.py were missing from the container.

See errors:

gaston2:~/go/src/github.com/compass$ docker-compose exec postgres psql -U compass -d compass -f /scripts/schema.sql
psql: error: /scripts/schema.sql: No such file or directory

gaston2:~/go/src/github.com/compass$ docker-compose exec backend python scripts/load_benchmarks.py
python: can't open file '/app/scripts/load_benchmarks.py': [Errno 2] No such file or directory

The following was a workaround:

docker-compose exec -T postgres psql -U compass -d compass < scripts/schema.sql
DATABASE_URL=postgresql://compass:compass_dev_password@localhost:5432/compass uv run python scripts/load_benchmarks.py data/benchmarks_BLIS.json

Can these files be added to the container in make docker-build?

Also, it would be good to add make docker equivalents for the needed make postgress commands.

[amito]

Hi Andre,
I missed load_benchmarks.py - will upload.
Regarding schema.sql - I'll upload it and resolve the issue, but first I'll explain what my intention was here:
I didn't upload the schema as in the dev environment (see: make docker-up-dev) I set up a startup script in the postgres container which restores the DB from a previous pg_dump. See the script in scripts/01-restore-db.sh. The dump needs to be located in scripts/init-db.dump (I used the one you sent @yuvalluria a while ago).
I do think we need to discuss whether a DB is needed here for what is basically read-only operations (?)
IMHO the data structure is pretty straightforward and can be loaded directly into memory (if small enough) or into a simpler store (e.g., Redis?) without the need to reserialize the data and handle schemas.
Thanks

[anfredette]

The db load now uses yaml files across the board. We can also discuss the design issues.

In the mean time, with the compass -> neuralnav renaming, the following commands will load the db now:

docker-compose exec -T postgres psql -U neuralnav -d neuralnav < scripts/schema.sql
DATABASE_URL=postgresql://neuralnav:neuralnav_dev_password@localhost:5432/neuralnav uv run python scripts/load_benchmarks.py data/benchmarks_BLIS.json