Skip to content

Commit 1a3622f

Browse files
committed
fix ENV to support vllm-ipex multi-arc deployment
Signed-off-by: Lin, Jiaojiao <[email protected]>
1 parent 1363844 commit 1a3622f

File tree

2 files changed

+2
-2
lines changed

2 files changed

+2
-2
lines changed

comps/llms/deployment/docker_compose/compose_text-generation.yaml

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -183,7 +183,7 @@ services:
183183
MAX_MODEL_LEN: ${MAX_MODEL_LEN:-20000}
184184
ONEAPI_DEVICE_SELECTOR: ${ONEAPI_DEVICE_SELECTOR:-level_zero:0}
185185
LOAD_QUANTIZATION: ${LOAD_QUANTIZATION:-fp8}
186-
ZE_AFFINITY_MASK: ${ZE_AFFINITY_MASK:-0}
186+
ZE_AFFINITY_MASK: ${ZE_AFFINITY_MASK}
187187
shm_size: 128g
188188
entrypoint: /bin/bash -c "\
189189
chmod +x /llm/vllm_ipex_entrypoint.sh && \

comps/lvms/deployment/docker_compose/compose.yaml

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -185,7 +185,7 @@ services:
185185
MAX_MODEL_LEN: ${MAX_MODEL_LEN:-20000}
186186
ONEAPI_DEVICE_SELECTOR: ${ONEAPI_DEVICE_SELECTOR:-level_zero:0}
187187
LOAD_QUANTIZATION: ${LOAD_QUANTIZATION:-fp8}
188-
ZE_AFFINITY_MASK: ${ZE_AFFINITY_MASK:-0}
188+
ZE_AFFINITY_MASK: ${ZE_AFFINITY_MASK}
189189
shm_size: 128g
190190
entrypoint: /bin/bash -c "\
191191
chmod +x /llm/vllm_ipex_entrypoint.sh && \

0 commit comments

Comments
 (0)