Skip to content

Release 6.2.0#309

Merged
danielholanda merged 2 commits intomainfrom
release_620
Apr 16, 2025
Merged

Release 6.2.0#309
danielholanda merged 2 commits intomainfrom
release_620

Conversation

@danielholanda
Copy link
Collaborator

@danielholanda danielholanda commented Apr 16, 2025

Summary of Contributions

Changes to Experimental Lemonade Server Endpoints

  • The experimental /load endpoint has been reworked (@jeremyfowers).
    • Load a model by its Lemonade name (e.g., Llama-3.2-1B-Instruct-Hybrid)
    • Load a model by its checkpoint and Lemonade Recipe (e.g., "checkpoint": "amd/Llama-3.2-3B-Instruct-awq-g128-int4-asym-fp16-onnx-hybrid", "recipe":"oga-hybrid")

For additional details, see load spec.

@danielholanda danielholanda self-assigned this Apr 16, 2025
@danielholanda danielholanda merged commit fe01e22 into main Apr 16, 2025
17 checks passed
@danielholanda danielholanda deleted the release_620 branch April 16, 2025 21:11
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants