Skip to content

Add Intel Gaudi support#3550

Open
12010486 wants to merge 1 commit intoEleutherAI:mainfrom
12010486:intel_gaudi_support
Open

Add Intel Gaudi support#3550
12010486 wants to merge 1 commit intoEleutherAI:mainfrom
12010486:intel_gaudi_support

Conversation

@12010486
Copy link

@12010486 12010486 commented Feb 3, 2026

What does this PR do?

Add Intel Gaudi support via optimum-habana.
Intel Gaudi platform is supported upstream in transformers and accelerator huggingface libraries, but still benefits of ad-hoc optimum-habana code.

Usage examples

lm_eval --model habana --model_args pretrained=meta-llama/Llama-3.2-1B-instruct --tasks ifeval --device hpu:0 --batch_size 16 --num_fewshot=0 --fewshot_as_multiturn --apply_chat_template

* Adding Intel Gaudi dependency
* Add to register + Add hpu among devices
* Add extra Intel Gaudi args
* Add Logging and Docstrings
* Simplify first upstream
* Include Intel Gaudi support in README
@12010486 12010486 requested a review from baberabb as a code owner February 3, 2026 14:58
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant