Skip to content

Commit a7b26f2

Browse files
fix: update neuronx huggingface tests (#5314)
* fix: update neuronx huggingface tests * black formatter * Add inference_ami_version=al2-ami-sagemaker-inference-neuron-2 to all neuronx tests --------- Co-authored-by: Sirut Buasai <73297481+sirutBuasai@users.noreply.github.com>
1 parent 2ca24ed commit a7b26f2

File tree

4 files changed

+4
-0
lines changed

4 files changed

+4
-0
lines changed

test/sagemaker_tests/huggingface/inference/integration/sagemaker/test_neuronx_decoder_hosting.py

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -145,6 +145,7 @@ def _test_pt_neuronx(
145145
initial_instance_count=1,
146146
instance_type=instance_type,
147147
endpoint_name=endpoint_name,
148+
inference_ami_version="al2-ami-sagemaker-inference-neuron-2",
148149
)
149150

150151
data = {"inputs": "I really wish "}

test/sagemaker_tests/huggingface/inference/integration/sagemaker/test_neuronx_encoder_hosting.py

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -145,6 +145,7 @@ def _test_pt_neuronx(
145145
initial_instance_count=1,
146146
instance_type=instance_type,
147147
endpoint_name=endpoint_name,
148+
inference_ami_version="al2-ami-sagemaker-inference-neuron-2",
148149
)
149150

150151
data = {"inputs": "Hamilton is considered to be the best musical of human history."}

test/sagemaker_tests/huggingface/inference/integration/sagemaker/test_neuronx_no_context.py

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -127,6 +127,7 @@ def _test_sentence_transformers(
127127
initial_instance_count=1,
128128
instance_type=instance_type,
129129
endpoint_name=endpoint_name,
130+
inference_ami_version="al2-ami-sagemaker-inference-neuron-2",
130131
)
131132

132133
predictor.serializer = IdentitySerializer(content_type="application/json")

test/sagemaker_tests/huggingface/inference/integration/sagemaker/test_neuronx_sdxl_hosting.py

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -146,6 +146,7 @@ def _test_pt_neuronx(
146146
initial_instance_count=1,
147147
instance_type=instance_type,
148148
endpoint_name=endpoint_name,
149+
inference_ami_version="al2-ami-sagemaker-inference-neuron-2",
149150
)
150151

151152
data = {"inputs": "Astronaut in a jungle, cold color palette, muted colors, detailed, 8k"}

0 commit comments

Comments
 (0)