source_installation_inst.md

Installing the Lemonade SDK From Source Code

The following provides the steps to install Lemonade from source code. We also provide 2 alternative ways to install Lemonade:

• To install Lemonade via PyPi, see the Lemonade README.
• To install Lemonade Server using the standalone GUI installer, see the Lemonade Server Installer README.

1. Clone: git clone https://github.com/onnx/turnkeyml.git

2. cd turnkeyml (where turnkeyml is the repo root of your clone)

   • Note: be sure to run these installation instructions from the repo root.

3. Create and activate a Miniconda environment.

   conda create -n lemon python=3.10

   conda activate lemon

4. Install Lemonade for your backend of choice:

   • OnnxRuntime GenAI with CPU backend:

     pip install -e .[llm-oga-cpu]

   • OnnxRuntime GenAI with Integrated GPU (iGPU, DirectML) backend:

     Note: Requires Windows and a DirectML-compatible iGPU.

     pip install -e .[llm-oga-igpu]

   • OnnxRuntime GenAI with Ryzen AI Hybrid (NPU + iGPU) backend:

     Note: Ryzen AI Hybrid requires a Windows 11 PC with an AMD Ryzen™ AI 300-series processor.

     • Ensure you have the correct driver version installed by checking here.
     • Visit the AMD Hugging Face OGA Hybrid collection for supported checkpoints.

     pip install -e .[llm-oga-hybrid]

     lemonade-install --ryzenai hybrid

   • Hugging Face (PyTorch) LLMs for CPU backend:

         pip install -e .[llm]

   • llama.cpp: see instructions.

5. Use lemonade -h to explore the LLM tools, and see the commands and APIs in the Lemonade SDK REAMDE.