Skip to content

score-compose - example with Docker Model Runner #28

@mathieu-benoit

Description

@mathieu-benoit

It would be great to add a provisioner for score-compose supporting the new Docker Model Runner (this requires Docker Desktop as far as I understand):

The generated compose.yaml file will look like something like this:

services:
  chat:
    image: my-chat-app
    depends_on:
      - ai-runner

  ai-runner:
    provider:
      type: model
      options:
        model: ai/smollm2

More examples:

Knowing that this is deprecated https://docs.docker.com/ai/compose/models-and-compose/#alternative-configuration-with-provider-services but that's the only way to achieve that today via score-compose. The top level models will need to be supported.

Metadata

Metadata

Assignees

No one assigned

    Labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions