Skip to content

Commit b62b18e

Browse files
arjramanarjraman
authored
Update available images for HF Neuronx (#5462)
1 parent 31952b2 commit b62b18e

File tree

1 file changed

+14
-10
lines changed

1 file changed

+14
-10
lines changed

‎available_images.md‎

Lines changed: 14 additions & 10 deletions
Original file line numberDiff line numberDiff line change
@@ -309,12 +309,14 @@ Please refer to the following pages to view all available versions and tags for
309309

310310
To get the latest one, you can check the Hugging Face [documentation](https://huggingface.co/docs/optimum-neuron/en/containers#available-optimum-neuron-containers).
311311

312-
|Framework |Neuron SDK Version |Job Type |Supported EC2 Instance Type |Python Version Options |Example URL |
313-
|------------------------------------------------------------------|-------------------|-----------|----------------------------|-----------------------|----------------------------------------------------------------------------------------------------------------------------------------------|
314-
|PyTorch 1.10.2 with Neuron Inference and HuggingFace transformers |Neuron 1.19.1 |inference |inf1 |3.7 (py37) |763104351884.dkr.ecr.us-east-1.amazonaws.com/huggingface-pytorch-inference-neuron:1.10.2-transformers4.20.1-neuron-py37-sdk1.19.1-ubuntu18.04 |
315-
|PyTorch 1.13.1 with NeuronX Inference and HuggingFace transformers |Neuron 2.15.0 |inference |inf2/trn1 |3.10 (py310) |763104351884.dkr.ecr.us-east-1.amazonaws.com/huggingface-pytorch-inference-neuronx:1.13.1-transformers4.34.1-neuronx-py310-sdk2.15.0-ubuntu20.04 |
316-
|PyTorch 2.1.2 with NeuronX Inference and HuggingFace transformers |Neuron 2.18.0 |inference |inf2/trn1 |3.10 (py310) |763104351884.dkr.ecr.us-east-1.amazonaws.com/huggingface-pytorch-inference-neuronx:2.1.2-transformers4.36.2-neuronx-py310-sdk2.18.0-ubuntu20.04 |
317-
|PyTorch 2.1.2 with NeuronX Inference and HuggingFace transformers |Neuron 2.20.0 |inference |inf2/trn1 |3.10 (py310) |763104351884.dkr.ecr.us-east-1.amazonaws.com/huggingface-pytorch-inference-neuronx:2.1.2-transformers4.43.2-neuronx-py310-sdk2.20.0-ubuntu20.04 |
312+
| Framework | Neuron SDK Version | Job Type | Supported EC2 Instance Type | Python Version Options | Example URL |
313+
|--------------------------------------------------------------------|--------------------|-----------|-----------------------------|------------------------|--------------------------------------------------------------------------------------------------------------------------------------------------|
314+
| PyTorch 2.8.0 with NeuronX Inference and HuggingFace transformers | Neuron 2.26.0 | inference | inf2/trn1 | 3.10 (py310) | 763104351884.dkr.ecr.us-east-1.amazonaws.com/huggingface-pytorch-inference-neuronx:2.8.0-transformers4.55.4-neuronx-py310-sdk2.26.0-ubuntu22.04 |
315+
| PyTorch 2.7.1 with NeuronX Inference and HuggingFace transformers | Neuron 2.24.1 | inference | inf2/trn1 | 3.10 (py310) | 763104351884.dkr.ecr.us-east-1.amazonaws.com/huggingface-pytorch-inference-neuronx:2.7.1-transformers4.51.3-neuronx-py310-sdk2.24.1-ubuntu22.04 |
316+
| PyTorch 2.1.2 with NeuronX Inference and HuggingFace transformers | Neuron 2.20.0 | inference | inf2/trn1 | 3.10 (py310) | 763104351884.dkr.ecr.us-east-1.amazonaws.com/huggingface-pytorch-inference-neuronx:2.1.2-transformers4.43.2-neuronx-py310-sdk2.20.0-ubuntu20.04 |
317+
| PyTorch 2.1.2 with NeuronX Inference and HuggingFace transformers | Neuron 2.18.0 | inference | inf2/trn1 | 3.10 (py310) | 763104351884.dkr.ecr.us-east-1.amazonaws.com/huggingface-pytorch-inference-neuronx:2.1.2-transformers4.36.2-neuronx-py310-sdk2.18.0-ubuntu20.04 |
318+
| PyTorch 1.13.1 with NeuronX Inference and HuggingFace transformers | Neuron 2.15.0 | inference | inf2/trn1 | 3.10 (py310) | 763104351884.dkr.ecr.us-east-1.amazonaws.com/huggingface-pytorch-inference-neuronx:1.13.1-transformers4.34.1-neuronx-py310-sdk2.15.0-ubuntu20.04 |
319+
| PyTorch 1.10.2 with Neuron Inference and HuggingFace transformers | Neuron 1.19.1 | inference | inf1 | 3.7 (py37) | 763104351884.dkr.ecr.us-east-1.amazonaws.com/huggingface-pytorch-inference-neuron:1.10.2-transformers4.20.1-neuron-py37-sdk1.19.1-ubuntu18.04 |
318320

319321
HuggingFace Neuron Training Containers
320322
===============================
@@ -324,10 +326,12 @@ Please refer to the following pages to view all available versions and tags for
324326

325327
To get the latest one, you can check the Hugging Face [documentation](https://huggingface.co/docs/optimum-neuron/en/containers#available-optimum-neuron-containers).
326328

327-
|Framework |Neuron SDK Version |Job Type |Supported EC2 Instance Type |Python Version Options |Example URL |
328-
|------------------------------------------------------------------|-------------------|-----------|----------------------------|-----------------------|----------------------------------------------------------------------------------------------------------------------------------------------|
329-
|PyTorch 1.13.1 with NeuronX Training and HuggingFace transformers |Neuron 2.18.0 |training |trn1 |3.10 (py310) |763104351884.dkr.ecr.us-east-1.amazonaws.com/huggingface-pytorch-training-neuronx:1.13.1-transformers4.36.2-neuronx-py310-sdk2.18.0-ubuntu20.04 |
330-
|PyTorch 2.1.2 with NeuronX Training and HuggingFace transformers |Neuron 2.20.0 |training |trn1 |3.10 (py310) |763104351884.dkr.ecr.us-east-1.amazonaws.com/huggingface-pytorch-training-neuronx:2.1.2-transformers4.48.1-neuronx-py310-sdk2.20.0-ubuntu20.04 |
329+
| Framework | Neuron SDK Version | Job Type | Supported EC2 Instance Type | Python Version Options | Example URL |
330+
|-------------------------------------------------------------------|--------------------|----------|-----------------------------|------------------------|-------------------------------------------------------------------------------------------------------------------------------------------------|
331+
| PyTorch 2.8.0 with NeuronX Training and HuggingFace transformers | Neuron 2.26.0 | training | trn1 | 3.10 (py310) | 763104351884.dkr.ecr.us-east-1.amazonaws.com/huggingface-pytorch-training-neuronx:2.8.0-transformers4.55.4-neuronx-py310-sdk2.26.0-ubuntu22.04 |
332+
| PyTorch 2.7.0 with NeuronX Training and HuggingFace transformers | Neuron 2.24.1 | training | trn1 | 3.10 (py310) | 763104351884.dkr.ecr.us-east-1.amazonaws.com/huggingface-pytorch-training-neuronx:2.7.0-transformers4.51.0-neuronx-py310-sdk2.24.1-ubuntu22.04 |
333+
| PyTorch 2.1.2 with NeuronX Training and HuggingFace transformers | Neuron 2.20.0 | training | trn1 | 3.10 (py310) | 763104351884.dkr.ecr.us-east-1.amazonaws.com/huggingface-pytorch-training-neuronx:2.1.2-transformers4.48.1-neuronx-py310-sdk2.20.0-ubuntu20.04 |
334+
| PyTorch 1.13.1 with NeuronX Training and HuggingFace transformers | Neuron 2.18.0 | training | trn1 | 3.10 (py310) | 763104351884.dkr.ecr.us-east-1.amazonaws.com/huggingface-pytorch-training-neuronx:1.13.1-transformers4.36.2-neuronx-py310-sdk2.18.0-ubuntu20.04 |
331335

332336
StabilityAI Inference Containers
333337
===============================

0 commit comments

Comments
 (0)