Skip to content

gallettilance/llama-stack-distribution

 
 

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

2,102 Commits
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Red Hat Distribution Build Instructions

This directory contains the necessary files to build a Red Hat compatible container image for the llama-stack.

Prerequisites

  • Python >=3.11
  • llama CLI tool installed: pip install llama-stack
  • Podman or Docker installed

Generating the Containerfile

The Containerfile is auto-generated from a template. To generate it:

  1. Make sure you have the llama CLI tool installed
  2. Run the build script from root of this git repo:
    ./distribution/build.py

This will:

  • Check for the llama CLI installation
  • Generate dependencies using llama stack build
  • Create a new Containerfile with the required dependencies

Editing the Containerfile

The Containerfile is auto-generated from a template. To edit it, you can modify the template in distribution/Containerfile.in and run the build script again. NEVER edit the generated Containerfile manually.

Building the Container Image

Once the Containerfile is generated, you can build the image using either Podman or Docker:

Using Podman build image for x86_64

podman build --platform linux/amd64 -f distribution/Containerfile -t rh .

Notes

  • The generated Containerfile should not be modified manually as it will be overwritten the next time you run the build script

Push the image to a registry

podman push <build-ID> quay.io/opendatahub/llama-stack:rh-distribution

About

Repository to host llama-stack custom distributions.

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

 
 
 

Contributors

Languages

  • Python 80.5%
  • Dockerfile 19.5%