Open
Description
Checklist
- I've prepended issue tag with type of change: [bug]
- (If applicable) I've attached the script to reproduce the bug
- (If applicable) I've documented below the DLC image/dockerfile this relates to
- (If applicable) I've documented below the tests I've run on the DLC image
- I'm using an existing DLC image listed here: https://docs.aws.amazon.com/deep-learning-containers/latest/devguide/deep-learning-containers-images.html
- I've built my own container based off DLC (and I've attached the code used to build my own image)
Concise Description:
I am using a clean ubuntu ec2 instance with python 3.12.3
I am running the command
python -m src.main --buildspec pytorch/training/buildspec-2-6-sm.yml --framework pytorch
and have commented out the test code specified in this issue lines 349-367 of file src/patch_helper.py so the error is not thrown there, however I get the error I usually get which I specify below
DLC image/dockerfile:
Current behavior:
BuildSageMakerCPUPTTrainPy3DockerImage
Traceback (most recent call last):
File "/home/ubuntu/deep-learning-containers/dlc/lib/python3.12/site-packages/requests/adapters.py", line 633, in send
conn = self.get_connection_with_tls_context(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/ubuntu/deep-learning-containers/dlc/lib/python3.12/site-packages/requests/adapters.py", line 489, in get_connection_with_tls_context
conn = self.poolmanager.connection_from_host(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/ubuntu/deep-learning-containers/dlc/lib/python3.12/site-packages/urllib3/poolmanager.py", line 303, in connection_from_host
return self.connection_from_context(request_context)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/ubuntu/deep-learning-containers/dlc/lib/python3.12/site-packages/urllib3/poolmanager.py", line 325, in connection_from_context
raise URLSchemeUnknown(scheme)
urllib3.exceptions.URLSchemeUnknown: Not supported URL scheme http+docker
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "<frozen runpy>", line 198, in _run_module_as_main
File "<frozen runpy>", line 88, in _run_code
File "/home/ubuntu/deep-learning-containers/src/main.py", line 140, in <module>
main()
File "/home/ubuntu/deep-learning-containers/src/main.py", line 136, in main
image_builder(buildspec_file, image_types, device_types)
File "/home/ubuntu/deep-learning-containers/src/image_builder.py", line 392, in image_builder
pushed_images += process_images(parent_images, "Parent/Independent", buildspec_path=buildspec)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/ubuntu/deep-learning-containers/src/image_builder.py", line 448, in process_images
build_images(pre_push_image_list)
File "/home/ubuntu/deep-learning-containers/src/image_builder.py", line 603, in build_images
FORMATTER.progress(THREADS)
File "/home/ubuntu/deep-learning-containers/src/output.py", line 103, in progress
output[i] += "." * 10 + constants.STATUS_MESSAGE[futures[image].result()]
^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/lib/python3.12/concurrent/futures/_base.py", line 449, in result
return self.__get_result()
^^^^^^^^^^^^^^^^^^^
File "/usr/lib/python3.12/concurrent/futures/_base.py", line 401, in __get_result
raise self._exception
File "/usr/lib/python3.12/concurrent/futures/thread.py", line 58, in run
result = self.fn(*self.args, **self.kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/ubuntu/deep-learning-containers/src/image.py", line 168, in build
self.docker_build(fileobj=context_file, custom_context=True)
File "/home/ubuntu/deep-learning-containers/src/image.py", line 196, in docker_build
for line in self.client.build(
^^^^^^^^^^^^^^^^^^
File "/home/ubuntu/deep-learning-containers/dlc/lib/python3.12/site-packages/docker/api/build.py", line 263, in build
response = self._post(
^^^^^^^^^^^
File "/home/ubuntu/deep-learning-containers/dlc/lib/python3.12/site-packages/docker/utils/decorators.py", line 46, in inner
return f(self, *args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/ubuntu/deep-learning-containers/dlc/lib/python3.12/site-packages/docker/api/client.py", line 226, in _post
return self.post(url, **self._set_request_timeout(kwargs))
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/ubuntu/deep-learning-containers/dlc/lib/python3.12/site-packages/requests/sessions.py", line 637, in post
return self.request("POST", url, data=data, json=json, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/ubuntu/deep-learning-containers/dlc/lib/python3.12/site-packages/requests/sessions.py", line 589, in request
resp = self.send(prep, **send_kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/ubuntu/deep-learning-containers/dlc/lib/python3.12/site-packages/requests/sessions.py", line 703, in send
r = adapter.send(request, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/ubuntu/deep-learning-containers/dlc/lib/python3.12/site-packages/requests/adapters.py", line 637, in send
raise InvalidURL(e, request=request)
requests.exceptions.InvalidURL: Not supported URL scheme http+docker
Expected behavior:
Build success
Additional context:
Full scrollback:
$ python -m src.main --buildspec pytorch/training/buildspec-2-6-sm.yml --framework pytorch
login into public ECR
WARNING! Your password will be stored unencrypted in /home/ubuntu/snap/docker/3064/.docker/config.json.
Configure a credential helper to remove this warning. See
https://docs.docker.com/engine/reference/commandline/login/#credential-stores
Login Succeeded
[PROD_URI for 539247459990.dkr.ecr.us-east-1.amazonaws.com/pytorch-training:2.6.0-cpu-py312-ubuntu22.04-sagemaker] 763104351884.dkr.ecr.us-east-1.amazonaws.com/pytorch-training:2.6.0-cpu-py312-ubuntu22.04-sagemaker
=====================================================================================================================================================================
[PROD_URI for 539247459990.dkr.ecr.us-east-1.amazonaws.com/pytorch-training:2.6.0-gpu-py312-cu126-ubuntu22.04-sagemaker] 763104351884.dkr.ecr.us-east-1.amazonaws.com/pytorch-training:2.6.0-gpu-py312-cu126-ubuntu22.04-sagemaker
=====================================================================================================================================================================
=====================================================================================================================================================================
= _ ____ _ _____ ____ _ _ ____ ____ _____ ____ =
= / \ | _ \ / \|_ _/ ___| | | | | _ \| _ \| ____| _ \ =
= / _ \ | |_) / _ \ | || | | |_| |_____| |_) | |_) | _| | |_) | =
= / ___ \| __/ ___ \| || |___| _ |_____| __/| _ <| |___| __/ =
= /_/ \_\_| /_/ \_\_| \____|_| |_| |_| |_| \_\_____|_| =
= =
= =
=====================================================================================================================================================================
Requirement already satisfied: boto3 in ./dlc/lib/python3.12/site-packages (from -r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 1)) (1.37.9)
Requirement already satisfied: docker in ./dlc/lib/python3.12/site-packages (from -r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 2)) (4.2.0)
Requirement already satisfied: fabric in ./dlc/lib/python3.12/site-packages (from -r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 3)) (3.2.2)
Requirement already satisfied: invoke in ./dlc/lib/python3.12/site-packages (from -r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 4)) (2.2.0)
Requirement already satisfied: junit-xml==1.9 in ./dlc/lib/python3.12/site-packages (from -r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 5)) (1.9)
Requirement already satisfied: packaging in ./dlc/lib/python3.12/site-packages (from -r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 6)) (24.2)
Requirement already satisfied: pytest<8.1 in ./dlc/lib/python3.12/site-packages (from -r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 8)) (8.0.2)
Requirement already satisfied: pytest-rerunfailures in ./dlc/lib/python3.12/site-packages (from -r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 9)) (15.0)
Requirement already satisfied: pytest-timeout in ./dlc/lib/python3.12/site-packages (from -r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 10)) (2.3.1)
Requirement already satisfied: pytest-json-report in ./dlc/lib/python3.12/site-packages (from -r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 11)) (1.5.0)
Requirement already satisfied: pytest-xdist in ./dlc/lib/python3.12/site-packages (from -r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 12)) (3.6.1)
Requirement already satisfied: sagemaker<3,>=2 in ./dlc/lib/python3.12/site-packages (from -r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 13)) (2.242.0)
Requirement already satisfied: xmltodict in ./dlc/lib/python3.12/site-packages (from -r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 14)) (0.14.2)
Requirement already satisfied: retrying in ./dlc/lib/python3.12/site-packages (from -r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 15)) (1.3.4)
Requirement already satisfied: gitpython in ./dlc/lib/python3.12/site-packages (from -r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 16)) (3.1.44)
Requirement already satisfied: pytz in ./dlc/lib/python3.12/site-packages (from -r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 17)) (2025.1)
Requirement already satisfied: toml in ./dlc/lib/python3.12/site-packages (from -r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 18)) (0.10.2)
Requirement already satisfied: lxml==5.3.1 in ./dlc/lib/python3.12/site-packages (from -r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 19)) (5.3.1)
Requirement already satisfied: scrapy in ./dlc/lib/python3.12/site-packages (from -r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 20)) (2.12.0)
Requirement already satisfied: crochet in ./dlc/lib/python3.12/site-packages (from -r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 21)) (2.1.1)
Requirement already satisfied: tenacity in ./dlc/lib/python3.12/site-packages (from -r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 22)) (9.0.0)
Requirement already satisfied: requests in ./dlc/lib/python3.12/site-packages (from -r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 23)) (2.32.3)
Requirement already satisfied: six in ./dlc/lib/python3.12/site-packages (from junit-xml==1.9->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 5)) (1.17.0)
Requirement already satisfied: botocore<1.38.0,>=1.37.9 in ./dlc/lib/python3.12/site-packages (from boto3->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 1)) (1.37.9)
Requirement already satisfied: jmespath<2.0.0,>=0.7.1 in ./dlc/lib/python3.12/site-packages (from boto3->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 1)) (1.0.1)
Requirement already satisfied: s3transfer<0.12.0,>=0.11.0 in ./dlc/lib/python3.12/site-packages (from boto3->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 1)) (0.11.4)
Requirement already satisfied: websocket-client>=0.32.0 in ./dlc/lib/python3.12/site-packages (from docker->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 2)) (1.8.0)
Requirement already satisfied: paramiko>=2.4 in ./dlc/lib/python3.12/site-packages (from fabric->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 3)) (3.5.1)
Requirement already satisfied: decorator>=5 in ./dlc/lib/python3.12/site-packages (from fabric->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 3)) (5.2.1)
Requirement already satisfied: deprecated>=1.2 in ./dlc/lib/python3.12/site-packages (from fabric->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 3)) (1.2.18)
Requirement already satisfied: iniconfig in ./dlc/lib/python3.12/site-packages (from pytest<8.1->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 8)) (2.1.0)
Requirement already satisfied: pluggy<2.0,>=1.3.0 in ./dlc/lib/python3.12/site-packages (from pytest<8.1->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 8)) (1.5.0)
Requirement already satisfied: pytest-metadata in ./dlc/lib/python3.12/site-packages (from pytest-json-report->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 11)) (3.1.1)
Requirement already satisfied: execnet>=2.1 in ./dlc/lib/python3.12/site-packages (from pytest-xdist->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 12)) (2.1.1)
Requirement already satisfied: attrs<24,>=23.1.0 in ./dlc/lib/python3.12/site-packages (from sagemaker<3,>=2->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 13)) (23.2.0)
Requirement already satisfied: cloudpickle>=2.2.1 in ./dlc/lib/python3.12/site-packages (from sagemaker<3,>=2->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 13)) (3.1.1)
Requirement already satisfied: fastapi in ./dlc/lib/python3.12/site-packages (from sagemaker<3,>=2->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 13)) (0.115.12)
Requirement already satisfied: google-pasta in ./dlc/lib/python3.12/site-packages (from sagemaker<3,>=2->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 13)) (0.2.0)
Requirement already satisfied: importlib-metadata<7.0,>=1.4.0 in ./dlc/lib/python3.12/site-packages (from sagemaker<3,>=2->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 13)) (6.11.0)
Requirement already satisfied: jsonschema in ./dlc/lib/python3.12/site-packages (from sagemaker<3,>=2->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 13)) (4.23.0)
Requirement already satisfied: numpy<2.0,>=1.9.0 in ./dlc/lib/python3.12/site-packages (from sagemaker<3,>=2->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 13)) (1.26.4)
Requirement already satisfied: omegaconf<=2.3,>=2.2 in ./dlc/lib/python3.12/site-packages (from sagemaker<3,>=2->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 13)) (2.3.0)
Requirement already satisfied: pandas in ./dlc/lib/python3.12/site-packages (from sagemaker<3,>=2->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 13)) (2.2.3)
Requirement already satisfied: pathos in ./dlc/lib/python3.12/site-packages (from sagemaker<3,>=2->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 13)) (0.3.3)
Requirement already satisfied: platformdirs in ./dlc/lib/python3.12/site-packages (from sagemaker<3,>=2->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 13)) (4.3.7)
Requirement already satisfied: protobuf<6.0,>=3.12 in ./dlc/lib/python3.12/site-packages (from sagemaker<3,>=2->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 13)) (5.29.4)
Requirement already satisfied: psutil in ./dlc/lib/python3.12/site-packages (from sagemaker<3,>=2->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 13)) (7.0.0)
Requirement already satisfied: pyyaml~=6.0 in ./dlc/lib/python3.12/site-packages (from sagemaker<3,>=2->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 13)) (6.0.2)
Requirement already satisfied: sagemaker-core<2.0.0,>=1.0.17 in ./dlc/lib/python3.12/site-packages (from sagemaker<3,>=2->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 13)) (1.0.25)
Requirement already satisfied: schema in ./dlc/lib/python3.12/site-packages (from sagemaker<3,>=2->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 13)) (0.7.7)
Requirement already satisfied: smdebug-rulesconfig==1.0.1 in ./dlc/lib/python3.12/site-packages (from sagemaker<3,>=2->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 13)) (1.0.1)
Requirement already satisfied: tblib<4,>=1.7.0 in ./dlc/lib/python3.12/site-packages (from sagemaker<3,>=2->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 13)) (3.0.0)
Requirement already satisfied: tqdm in ./dlc/lib/python3.12/site-packages (from sagemaker<3,>=2->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 13)) (4.67.1)
Requirement already satisfied: urllib3<3.0.0,>=1.26.8 in ./dlc/lib/python3.12/site-packages (from sagemaker<3,>=2->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 13)) (2.3.0)
Requirement already satisfied: uvicorn in ./dlc/lib/python3.12/site-packages (from sagemaker<3,>=2->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 13)) (0.34.0)
Requirement already satisfied: gitdb<5,>=4.0.1 in ./dlc/lib/python3.12/site-packages (from gitpython->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 16)) (4.0.12)
Requirement already satisfied: Twisted>=21.7.0 in ./dlc/lib/python3.12/site-packages (from scrapy->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 20)) (24.11.0)
Requirement already satisfied: cryptography>=37.0.0 in ./dlc/lib/python3.12/site-packages (from scrapy->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 20)) (44.0.2)
Requirement already satisfied: cssselect>=0.9.1 in ./dlc/lib/python3.12/site-packages (from scrapy->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 20)) (1.3.0)
Requirement already satisfied: itemloaders>=1.0.1 in ./dlc/lib/python3.12/site-packages (from scrapy->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 20)) (1.3.2)
Requirement already satisfied: parsel>=1.5.0 in ./dlc/lib/python3.12/site-packages (from scrapy->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 20)) (1.10.0)
Requirement already satisfied: pyOpenSSL>=22.0.0 in ./dlc/lib/python3.12/site-packages (from scrapy->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 20)) (25.0.0)
Requirement already satisfied: queuelib>=1.4.2 in ./dlc/lib/python3.12/site-packages (from scrapy->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 20)) (1.7.0)
Requirement already satisfied: service-identity>=18.1.0 in ./dlc/lib/python3.12/site-packages (from scrapy->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 20)) (24.2.0)
Requirement already satisfied: w3lib>=1.17.0 in ./dlc/lib/python3.12/site-packages (from scrapy->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 20)) (2.3.1)
Requirement already satisfied: zope.interface>=5.1.0 in ./dlc/lib/python3.12/site-packages (from scrapy->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 20)) (7.2)
Requirement already satisfied: protego>=0.1.15 in ./dlc/lib/python3.12/site-packages (from scrapy->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 20)) (0.4.0)
Requirement already satisfied: itemadapter>=0.1.0 in ./dlc/lib/python3.12/site-packages (from scrapy->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 20)) (0.11.0)
Requirement already satisfied: tldextract in ./dlc/lib/python3.12/site-packages (from scrapy->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 20)) (5.1.3)
Requirement already satisfied: defusedxml>=0.7.1 in ./dlc/lib/python3.12/site-packages (from scrapy->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 20)) (0.7.1)
Requirement already satisfied: PyDispatcher>=2.0.5 in ./dlc/lib/python3.12/site-packages (from scrapy->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 20)) (2.0.7)
Requirement already satisfied: wrapt in ./dlc/lib/python3.12/site-packages (from crochet->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 21)) (1.17.2)
Requirement already satisfied: charset-normalizer<4,>=2 in ./dlc/lib/python3.12/site-packages (from requests->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 23)) (3.4.1)
Requirement already satisfied: idna<4,>=2.5 in ./dlc/lib/python3.12/site-packages (from requests->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 23)) (3.10)
Requirement already satisfied: certifi>=2017.4.17 in ./dlc/lib/python3.12/site-packages (from requests->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 23)) (2025.1.31)
Requirement already satisfied: python-dateutil<3.0.0,>=2.1 in ./dlc/lib/python3.12/site-packages (from botocore<1.38.0,>=1.37.9->boto3->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 1)) (2.9.0.post0)
Requirement already satisfied: cffi>=1.12 in ./dlc/lib/python3.12/site-packages (from cryptography>=37.0.0->scrapy->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 20)) (1.17.1)
Requirement already satisfied: smmap<6,>=3.0.1 in ./dlc/lib/python3.12/site-packages (from gitdb<5,>=4.0.1->gitpython->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 16)) (5.0.2)
Requirement already satisfied: zipp>=0.5 in ./dlc/lib/python3.12/site-packages (from importlib-metadata<7.0,>=1.4.0->sagemaker<3,>=2->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 13)) (3.21.0)
Requirement already satisfied: antlr4-python3-runtime==4.9.* in ./dlc/lib/python3.12/site-packages (from omegaconf<=2.3,>=2.2->sagemaker<3,>=2->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 13)) (4.9.3)
Requirement already satisfied: bcrypt>=3.2 in ./dlc/lib/python3.12/site-packages (from paramiko>=2.4->fabric->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 3)) (4.3.0)
Requirement already satisfied: pynacl>=1.5 in ./dlc/lib/python3.12/site-packages (from paramiko>=2.4->fabric->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 3)) (1.5.0)
Requirement already satisfied: typing-extensions>=4.9 in ./dlc/lib/python3.12/site-packages (from pyOpenSSL>=22.0.0->scrapy->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 20)) (4.12.2)
Requirement already satisfied: pydantic<3.0.0,>=2.0.0 in ./dlc/lib/python3.12/site-packages (from sagemaker-core<2.0.0,>=1.0.17->sagemaker<3,>=2->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 13)) (2.10.6)
Requirement already satisfied: rich<14.0.0,>=13.0.0 in ./dlc/lib/python3.12/site-packages (from sagemaker-core<2.0.0,>=1.0.17->sagemaker<3,>=2->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 13)) (13.9.4)
Requirement already satisfied: mock<5.0,>4.0 in ./dlc/lib/python3.12/site-packages (from sagemaker-core<2.0.0,>=1.0.17->sagemaker<3,>=2->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 13)) (4.0.3)
Requirement already satisfied: jsonschema-specifications>=2023.03.6 in ./dlc/lib/python3.12/site-packages (from jsonschema->sagemaker<3,>=2->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 13)) (2024.10.1)
Requirement already satisfied: referencing>=0.28.4 in ./dlc/lib/python3.12/site-packages (from jsonschema->sagemaker<3,>=2->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 13)) (0.36.2)
Requirement already satisfied: rpds-py>=0.7.1 in ./dlc/lib/python3.12/site-packages (from jsonschema->sagemaker<3,>=2->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 13)) (0.23.1)
Requirement already satisfied: pyasn1 in ./dlc/lib/python3.12/site-packages (from service-identity>=18.1.0->scrapy->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 20)) (0.6.1)
Requirement already satisfied: pyasn1-modules in ./dlc/lib/python3.12/site-packages (from service-identity>=18.1.0->scrapy->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 20)) (0.4.1)
Requirement already satisfied: automat>=24.8.0 in ./dlc/lib/python3.12/site-packages (from Twisted>=21.7.0->scrapy->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 20)) (24.8.1)
Requirement already satisfied: constantly>=15.1 in ./dlc/lib/python3.12/site-packages (from Twisted>=21.7.0->scrapy->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 20)) (23.10.4)
Requirement already satisfied: hyperlink>=17.1.1 in ./dlc/lib/python3.12/site-packages (from Twisted>=21.7.0->scrapy->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 20)) (21.0.0)
Requirement already satisfied: incremental>=24.7.0 in ./dlc/lib/python3.12/site-packages (from Twisted>=21.7.0->scrapy->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 20)) (24.7.2)
Requirement already satisfied: setuptools in ./dlc/lib/python3.12/site-packages (from zope.interface>=5.1.0->scrapy->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 20)) (78.0.2)
Requirement already satisfied: starlette<0.47.0,>=0.40.0 in ./dlc/lib/python3.12/site-packages (from fastapi->sagemaker<3,>=2->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 13)) (0.46.1)
Requirement already satisfied: tzdata>=2022.7 in ./dlc/lib/python3.12/site-packages (from pandas->sagemaker<3,>=2->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 13)) (2025.2)
Requirement already satisfied: ppft>=1.7.6.9 in ./dlc/lib/python3.12/site-packages (from pathos->sagemaker<3,>=2->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 13)) (1.7.6.9)
Requirement already satisfied: dill>=0.3.9 in ./dlc/lib/python3.12/site-packages (from pathos->sagemaker<3,>=2->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 13)) (0.3.9)
Requirement already satisfied: pox>=0.3.5 in ./dlc/lib/python3.12/site-packages (from pathos->sagemaker<3,>=2->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 13)) (0.3.5)
Requirement already satisfied: multiprocess>=0.70.17 in ./dlc/lib/python3.12/site-packages (from pathos->sagemaker<3,>=2->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 13)) (0.70.17)
Requirement already satisfied: requests-file>=1.4 in ./dlc/lib/python3.12/site-packages (from tldextract->scrapy->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 20)) (2.1.0)
Requirement already satisfied: filelock>=3.0.8 in ./dlc/lib/python3.12/site-packages (from tldextract->scrapy->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 20)) (3.18.0)
Requirement already satisfied: click>=7.0 in ./dlc/lib/python3.12/site-packages (from uvicorn->sagemaker<3,>=2->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 13)) (8.1.8)
Requirement already satisfied: h11>=0.8 in ./dlc/lib/python3.12/site-packages (from uvicorn->sagemaker<3,>=2->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 13)) (0.14.0)
Requirement already satisfied: pycparser in ./dlc/lib/python3.12/site-packages (from cffi>=1.12->cryptography>=37.0.0->scrapy->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 20)) (2.22)
Requirement already satisfied: annotated-types>=0.6.0 in ./dlc/lib/python3.12/site-packages (from pydantic<3.0.0,>=2.0.0->sagemaker-core<2.0.0,>=1.0.17->sagemaker<3,>=2->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 13)) (0.7.0)
Requirement already satisfied: pydantic-core==2.27.2 in ./dlc/lib/python3.12/site-packages (from pydantic<3.0.0,>=2.0.0->sagemaker-core<2.0.0,>=1.0.17->sagemaker<3,>=2->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 13)) (2.27.2)
Requirement already satisfied: markdown-it-py>=2.2.0 in ./dlc/lib/python3.12/site-packages (from rich<14.0.0,>=13.0.0->sagemaker-core<2.0.0,>=1.0.17->sagemaker<3,>=2->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 13)) (3.0.0)
Requirement already satisfied: pygments<3.0.0,>=2.13.0 in ./dlc/lib/python3.12/site-packages (from rich<14.0.0,>=13.0.0->sagemaker-core<2.0.0,>=1.0.17->sagemaker<3,>=2->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 13)) (2.19.1)
Requirement already satisfied: anyio<5,>=3.6.2 in ./dlc/lib/python3.12/site-packages (from starlette<0.47.0,>=0.40.0->fastapi->sagemaker<3,>=2->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 13)) (4.9.0)
Requirement already satisfied: sniffio>=1.1 in ./dlc/lib/python3.12/site-packages (from anyio<5,>=3.6.2->starlette<0.47.0,>=0.40.0->fastapi->sagemaker<3,>=2->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 13)) (1.3.1)
Requirement already satisfied: mdurl~=0.1 in ./dlc/lib/python3.12/site-packages (from markdown-it-py>=2.2.0->rich<14.0.0,>=13.0.0->sagemaker-core<2.0.0,>=1.0.17->sagemaker<3,>=2->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 13)) (0.1.2)
=====================================================================================================================================================================
= ____ _ ____ =
= | _ \| | / ___| =
= | | | | | | | =
= | |_| | |__| |___ =
= |____/|_____\____| =
= =
= =
=====================================================================================================================================================================
=====================================================================================================================================================================
= ____ _ _____ _ =
= | _ \ __ _ _ __ ___ _ __ | |_ / /_ _|_ __ __| | ___ _ __ ___ _ __ =
= | |_) / _` | '__/ _ \ '_ \| __| / / | || '_ \ / _` |/ _ \ '_ \ / _ \ '_ \ =
= | __/ (_| | | | __/ | | | |_ / / | || | | | (_| | __/ |_) | __/ | | | =
= |_| \__,_|_| \___|_| |_|\__/_/ |___|_| |_|\__,_|\___| .__/ \___|_| |_| =
= |_| =
= _ _ ____ _ _ _ =
= __| | ___ _ __ | |_ | __ ) _ _(_) | __| | =
= / _` |/ _ \ '_ \| __| | _ \| | | | | |/ _` | =
= | (_| | __/ | | | |_ | |_) | |_| | | | (_| | =
= \__,_|\___|_| |_|\__| |____/ \__,_|_|_|\__,_| =
= =
= =
=====================================================================================================================================================================
BuildSageMakerCPUPTTrainPy3DockerImage
Traceback (most recent call last):
File "/home/ubuntu/deep-learning-containers/dlc/lib/python3.12/site-packages/requests/adapters.py", line 633, in send
conn = self.get_connection_with_tls_context(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/ubuntu/deep-learning-containers/dlc/lib/python3.12/site-packages/requests/adapters.py", line 489, in get_connection_with_tls_context
conn = self.poolmanager.connection_from_host(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/ubuntu/deep-learning-containers/dlc/lib/python3.12/site-packages/urllib3/poolmanager.py", line 303, in connection_from_host
return self.connection_from_context(request_context)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/ubuntu/deep-learning-containers/dlc/lib/python3.12/site-packages/urllib3/poolmanager.py", line 325, in connection_from_context
raise URLSchemeUnknown(scheme)
urllib3.exceptions.URLSchemeUnknown: Not supported URL scheme http+docker
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "<frozen runpy>", line 198, in _run_module_as_main
File "<frozen runpy>", line 88, in _run_code
File "/home/ubuntu/deep-learning-containers/src/main.py", line 140, in <module>
main()
File "/home/ubuntu/deep-learning-containers/src/main.py", line 136, in main
image_builder(buildspec_file, image_types, device_types)
File "/home/ubuntu/deep-learning-containers/src/image_builder.py", line 392, in image_builder
pushed_images += process_images(parent_images, "Parent/Independent", buildspec_path=buildspec)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/ubuntu/deep-learning-containers/src/image_builder.py", line 448, in process_images
build_images(pre_push_image_list)
File "/home/ubuntu/deep-learning-containers/src/image_builder.py", line 603, in build_images
FORMATTER.progress(THREADS)
File "/home/ubuntu/deep-learning-containers/src/output.py", line 103, in progress
output[i] += "." * 10 + constants.STATUS_MESSAGE[futures[image].result()]
^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/lib/python3.12/concurrent/futures/_base.py", line 449, in result
return self.__get_result()
^^^^^^^^^^^^^^^^^^^
File "/usr/lib/python3.12/concurrent/futures/_base.py", line 401, in __get_result
raise self._exception
File "/usr/lib/python3.12/concurrent/futures/thread.py", line 58, in run
result = self.fn(*self.args, **self.kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/ubuntu/deep-learning-containers/src/image.py", line 168, in build
self.docker_build(fileobj=context_file, custom_context=True)
File "/home/ubuntu/deep-learning-containers/src/image.py", line 196, in docker_build
for line in self.client.build(
^^^^^^^^^^^^^^^^^^
File "/home/ubuntu/deep-learning-containers/dlc/lib/python3.12/site-packages/docker/api/build.py", line 263, in build
response = self._post(
^^^^^^^^^^^
File "/home/ubuntu/deep-learning-containers/dlc/lib/python3.12/site-packages/docker/utils/decorators.py", line 46, in inner
return f(self, *args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/ubuntu/deep-learning-containers/dlc/lib/python3.12/site-packages/docker/api/client.py", line 226, in _post
return self.post(url, **self._set_request_timeout(kwargs))
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/ubuntu/deep-learning-containers/dlc/lib/python3.12/site-packages/requests/sessions.py", line 637, in post
return self.request("POST", url, data=data, json=json, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/ubuntu/deep-learning-containers/dlc/lib/python3.12/site-packages/requests/sessions.py", line 589, in request
resp = self.send(prep, **send_kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/ubuntu/deep-learning-containers/dlc/lib/python3.12/site-packages/requests/sessions.py", line 703, in send
r = adapter.send(request, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/ubuntu/deep-learning-containers/dlc/lib/python3.12/site-packages/requests/adapters.py", line 637, in send
raise InvalidURL(e, request=request)
requests.exceptions.InvalidURL: Not supported URL scheme http+docker
Metadata
Metadata
Assignees
Labels
No labels