Skip to content

Ugrade to RAI 1.7.0 incl. model-gen#6

Merged
iswaryaalex merged 14 commits intomainfrom
iswarya/upgrade-lemonade-eval-rai1.7.0
Feb 10, 2026
Merged

Ugrade to RAI 1.7.0 incl. model-gen#6
iswaryaalex merged 14 commits intomainfrom
iswarya/upgrade-lemonade-eval-rai1.7.0

Conversation

@iswaryaalex
Copy link
Copy Markdown
Contributor

@iswaryaalex iswaryaalex commented Feb 6, 2026

This PR brings the latest updates in RAI 1.7.0 to Lemoande-eval

  • Updated setup.py to point to RAI 1.7.0 packages
  • Removed "require_dlls" that are no longer required and also no longer available with rai 1.7.0
  • Updated error messages to highlight that we support only 1.7.0 and onwards
  • Key upgrades to model_generate support additional cli options that is now used for NPU and hybrid model generation

To test this PR

Setup this test in a Ryzen AI 300/400 Series env

conda create -n lemon-eval python=3.12
conda activate lemon-eval
git clone https://github.com/lemonade-sdk/lemonade-eval.git -b iswarya/upgrade-lemonade-eval-rai1.7.0 
cd lemonade-eval
pip install -e .[oga-ryzenai,model-generate] --extra-index-url=https://pypi.amd.com/simple
lemonade-eval -i amd/Llama-3.2-1B-Instruct-awq-uint4-asym-g128-bf16-lmhead oga-load --device hybrid --dtype int4 llm-prompt -p "Alice and Bob" --max-new-tokens 10

Tests

  • Tested model-generation on NPU/Hybrid
image

Copy link
Copy Markdown
Contributor

@amd-pworfolk amd-pworfolk left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It worked on my hybrid and cpu test examples.

@iswaryaalex iswaryaalex closed this Feb 9, 2026
@iswaryaalex iswaryaalex reopened this Feb 9, 2026
Removed the test-oga-model-prep job from the workflow.
@iswaryaalex iswaryaalex merged commit 22dde33 into main Feb 10, 2026
2 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants