Skip to content

Commit af69cad

Browse files
Hoyuelosdivya agarwal
andauthored
patching HF pytorch training neuronx image
* removing audio * changed toml * remove emacs * ignoring some vulnerabilities for CVE * upgrading accelerate to latest version * installing peft * removing accelerate and letting peft install it * Revert "removing accelerate and letting peft install it" This reverts commit 7b97b27. * reverting toml file --------- Co-authored-by: divya agarwal <agardiv@amazon.com>
1 parent ba30bbf commit af69cad

File tree

2 files changed

+8
-4
lines changed

2 files changed

+8
-4
lines changed

data/ignore_ids_safety_scan.json

Lines changed: 3 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1491,7 +1491,9 @@
14911491
"71579": "Temporarily ignoring to patch CRITICAL vulnerabilties",
14921492
"71584": "Temporarily ignoring to patch CRITICAL vulnerabilties",
14931493
"71587": "Temporarily ignoring to patch CRITICAL vulnerabilties",
1494-
"71692": "Temporarily ignoring to patch CRITICAL vulnerabilties"
1494+
"71692": "Temporarily ignoring to patch CRITICAL vulnerabilties",
1495+
"76170": "Temporarily ignoring to patch CRITICAL vulnerabilties",
1496+
"76180": "Temporarily ignoring to patch CRITICAL vulnerabilties"
14951497
}
14961498
}
14971499
},

huggingface/pytorch/training/docker/2.1/py3/sdk2.20.0/Dockerfile.neuronx

Lines changed: 5 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -14,16 +14,16 @@ ARG DATASETS_VERSION
1414
ARG GEVENT_VERSION=24.10.3
1515
ARG PYTHON=python3
1616

17-
RUN apt-get remove -y --purge emacs && \
18-
apt-get autoremove -y
17+
RUN apt-get purge -y --auto-remove emacs && apt-get clean && rm -rf /usr/share/emacs /etc/emacs /var/lib/emacs
18+
1919

2020
RUN pip install --upgrade pip
2121

2222
# install Hugging Face libraries and its dependencies
2323
RUN pip install --no-cache-dir \
2424
"sagemaker==2.232.2" \
2525
evaluate \
26-
transformers[sklearn,sentencepiece,audio,vision]==${TRANSFORMERS_VERSION} \
26+
transformers[sklearn,sentencepiece,vision]==${TRANSFORMERS_VERSION} \
2727
datasets==${DATASETS_VERSION} \
2828
optimum-neuron==${OPTIMUM_NEURON_VERSION} \
2929
peft \
@@ -46,6 +46,8 @@ RUN pip install -U \
4646
google-auth \
4747
"urllib3>=1.26.17,<1.27"
4848

49+
RUN pip install "peft==0.14.0"
50+
4951
RUN apt-get update \
5052
&& apt install -y --no-install-recommends \
5153
git-lfs \

0 commit comments

Comments
 (0)