Run unit, integration tests and builds in a container

[acardace]

Run unit, integration tests and build in a container

Add Dockerfile.builder with required dependencies and update Makefile
targets to run tests and builds inside a container, eliminating host
dependency requirements.

Notable changes:

• latest stable Fedora as base image

• add builder image (Dockerfile.builder)

• if pinned python modules deps cannot be found then the latest ones will be used

• containerized test-unit, test-integration, and build targets

• simplified Makefile by removing host-based Python/tokenizer setup

• integrate linting and typos in the llm-d-builder image

  Fixes Installation of build dependencies via Makefile is broken #470

[acardace]

@elevran as a follow up I can also do the same thing for building other than just testing, so we can have a fixed image for building as well.

[evacchi]

FWIW the venv+Makefile flow makes it easy to attach a local debugger even on macOS (although it should be feasible to spin that flow off to its own Makefile/script if necessary)

[acardace]

FWIW the venv+Makefile flow makes it easy to attach a local debugger even on macOS (although it should be feasible to spin that flow off to its own Makefile/script if necessary)

That's fair but I think we should converge on containerized workflows for ease of use and reproducibility.

[acardace]

I've completely reworked this to use the container image for building, linting and running the typos tool as well, this let me get rid of a lot of the Makefile.

[elevran]

Container build fails:

docker build --quiet \
	-f Dockerfile.builder \
	-t ghcr.io/llm-d/llm-d-builder:dev
ERROR: docker: 'docker buildx build' requires 1 argument

Usage:  docker buildx build [OPTIONS] PATH | URL | -

Run 'docker buildx build --help' for more information
make: *** [Makefile:135: image-build-builder] Error 1
Error: Process completed with exit code 2.```

[acardace]

Container build fails:

docker build --quiet \
	-f Dockerfile.builder \
	-t ghcr.io/llm-d/llm-d-builder:dev
ERROR: docker: 'docker buildx build' requires 1 argument

Usage:  docker buildx build [OPTIONS] PATH | URL | -

Run 'docker buildx build --help' for more information
make: *** [Makefile:135: image-build-builder] Error 1
Error: Process completed with exit code 2.```

I'll take a look, the issue is I only use podman locally.

[elevran]

CICD runs Ubuntu with docker by default so that would be needed

[github-actions]

This PR is marked as stale after 21d of inactivity. After an additional 14d of inactivity (7d to become rotten, then 7d more), it will be closed. To prevent this PR from being closed, add a comment or remove the lifecycle/stale label.