-
Notifications
You must be signed in to change notification settings - Fork 3
Open
Labels
good first issueGood for newcomersGood for newcomershelp wantedExtra attention is neededExtra attention is needed
Description
It would be great to add a provisioner for score-compose supporting the new Docker Model Runner (this requires Docker Desktop as far as I understand):
- https://docs.docker.com/compose/how-tos/model-runner/
- https://docs.docker.com/desktop/features/model-runner/
The generated compose.yaml file will look like something like this:
services:
chat:
image: my-chat-app
depends_on:
- ai-runner
ai-runner:
provider:
type: model
options:
model: ai/smollm2More examples:
- https://github.com/docker/hello-genai/tree/main
- https://k33g.hashnode.dev/first-contact-with-docker-model-runner-in-golang
- https://github.com/spurin/devwhisperer/tree/main
Knowing that this is deprecated https://docs.docker.com/ai/compose/models-and-compose/#alternative-configuration-with-provider-services but that's the only way to achieve that today via score-compose. The top level models will need to be supported.
Metadata
Metadata
Assignees
Labels
good first issueGood for newcomersGood for newcomershelp wantedExtra attention is neededExtra attention is needed