Skip to content

[Bug] pip installs where TAMR is a dependency take a long time (20+ min) #177

Description

@CCorrado

Issue: pip install where tamr is a dependency takes a very long time due to pip dependency resolver issues.

Versions of TAMR targeted:
tamr-unify-client>=0.13.0
tamr_toolbox[all]>=1.1.1

Potential solution: set an explicit version of the GCP dependency in setup.py rather than setting >=2.0.0.

Stack trace of running pip install where tamr_toolbox[all]>=1.1.1 is included takes 20+ minutes to run:

**06:26:12  #12 15.67 Collecting grpcio-status<2.0.dev0,>=1.33.2 (from google-api-core[grpc]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5->google-cloud-translate==3.7.4->tamr_toolbox[all]>=1.1.1->-r requirements.txt (line 2))**
06:26:12  #12 15.69   Downloading grpcio_status-1.65.5-py3-none-any.whl.metadata (1.1 kB)
06:26:12  #12 15.70   Downloading grpcio_status-1.65.4-py3-none-any.whl.metadata (1.1 kB)
06:26:12  #12 15.72   Downloading grpcio_status-1.65.2-py3-none-any.whl.metadata (1.1 kB)
06:26:12  #12 15.74   Downloading grpcio_status-1.65.1-py3-none-any.whl.metadata (1.1 kB)
06:26:12  #12 15.75   Downloading grpcio_status-1.64.3-py3-none-any.whl.metadata (1.1 kB)
06:26:12  #12 15.77   Downloading grpcio_status-1.64.1-py3-none-any.whl.metadata (1.1 kB)
06:26:12  #12 15.79   Downloading grpcio_status-1.64.0-py3-none-any.whl.metadata (1.1 kB)
06:26:12  #12 15.79 INFO: pip is still looking at multiple versions of grpcio-status to determine which version is compatible with other requirements. This could take a while.
06:26:12  #12 15.80   Downloading grpcio_status-1.63.2-py3-none-any.whl.metadata (1.1 kB)
06:26:12  #12 15.82   Downloading grpcio_status-1.63.0-py3-none-any.whl.metadata (1.1 kB)
06:26:12  #12 15.84   Downloading grpcio_status-1.62.3-py3-none-any.whl.metadata (1.3 kB)
06:26:12  #12 15.87   Downloading grpcio_status-1.62.2-py3-none-any.whl.metadata (1.3 kB)
06:26:12  #12 15.88   Downloading grpcio_status-1.62.1-py3-none-any.whl.metadata (1.3 kB)
06:26:12  #12 15.89 INFO: This is taking longer than usual. You might need to provide the dependency resolver with stricter constraints to reduce runtime. See https://pip.pypa.io/warnings/backtracking for guidance. If you want to abort this run, press Ctrl + C.
06:26:12  #12 15.90   Downloading grpcio_status-1.62.0-py3-none-any.whl.metadata (1.3 kB)
06:26:12  #12 15.92   Downloading grpcio_status-1.61.3-py3-none-any.whl.metadata (1.3 kB)
06:26:12  #12 15.93   Downloading grpcio_status-1.60.2-py3-none-any.whl.metadata (1.3 kB)
06:26:12  #12 15.95   Downloading grpcio_status-1.60.1-py3-none-any.whl.metadata (1.3 kB)
06:26:12  #12 15.97   Downloading grpcio_status-1.60.0-py3-none-any.whl.metadata (1.3 kB)
06:26:12  #12 15.99   Downloading grpcio_status-1.59.5-py3-none-any.whl.metadata (1.3 kB)
06:26:12  #12 16.00   Downloading grpcio_status-1.59.3-py3-none-any.whl.metadata (1.3 kB)
06:26:12  #12 16.02   Downloading grpcio_status-1.59.2-py3-none-any.whl.metadata (1.3 kB)
06:26:12  #12 16.04   Downloading grpcio_status-1.59.0-py3-none-any.whl.metadata (1.3 kB)
06:26:12  #12 16.05   Downloading grpcio_status-1.58.3-py3-none-any.whl.metadata (1.3 kB)
06:26:12  #12 16.07   Downloading grpcio_status-1.58.0-py3-none-any.whl.metadata (1.3 kB)
06:26:12  #12 16.08   Downloading grpcio_status-1.57.0-py3-none-any.whl.metadata (1.2 kB)
06:26:13  #12 16.10   Downloading grpcio_status-1.56.2-py3-none-any.whl.metadata (1.3 kB)
06:26:13  #12 16.11   Downloading grpcio_status-1.56.0-py3-none-any.whl.metadata (1.3 kB)
06:26:13  #12 16.13   Downloading grpcio_status-1.55.3-py3-none-any.whl.metadata (1.3 kB)
06:26:13  #12 16.15   Downloading grpcio_status-1.54.3-py3-none-any.whl.metadata (1.3 kB)
06:26:13  #12 16.16   Downloading grpcio_status-1.54.2-py3-none-any.whl.metadata (1.3 kB)
06:26:13  #12 16.18   Downloading grpcio_status-1.54.0-py3-none-any.whl.metadata (1.3 kB)
06:26:13  #12 16.20   Downloading grpcio_status-1.53.2-py3-none-any.whl.metadata (1.3 kB)
06:26:13  #12 16.21   Downloading grpcio_status-1.53.1-py3-none-any.whl.metadata (1.3 kB)
06:26:13  #12 16.23   Downloading grpcio_status-1.53.0-py3-none-any.whl.metadata (1.3 kB)
06:26:13  #12 16.25   Downloading grpcio_status-1.51.3-py3-none-any.whl.metadata (1.3 kB)
06:26:13  #12 16.26   Downloading grpcio_status-1.51.1-py3-none-any.whl.metadata (1.3 kB)
06:26:13  #12 16.28   Downloading grpcio_status-1.50.0-py3-none-any.whl.metadata (1.3 kB)
06:26:13  #12 16.30   Downloading grpcio_status-1.49.1-py3-none-any.whl.metadata (1.3 kB)
**06:26:13  #12 16.31 Collecting googleapis-common-protos<2.0.dev0,>=1.56.2 (from google-api-core!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5->google-api-core[grpc]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5->google-cloud-translate==3.7.4->tamr_toolbox[all]>=1.1.1->-r requirements.txt (line 2))**
06:26:13  #12 16.32   Downloading googleapis_common_protos-1.64.0-py2.py3-none-any.whl.metadata (1.5 kB)
06:26:13  #12 16.36   Downloading googleapis_common_protos-1.63.2-py2.py3-none-any.whl.metadata (1.5 kB)
06:26:13  #12 16.40   Downloading googleapis_common_protos-1.63.1-py2.py3-none-any.whl.metadata (1.5 kB)
06:26:13  #12 16.50   Downloading googleapis_common_protos-1.63.0-py2.py3-none-any.whl.metadata (1.5 kB)
06:26:13  #12 16.62   Downloading googleapis_common_protos-1.62.0-py2.py3-none-any.whl.metadata (1.5 kB)
06:26:13  #12 16.66   Downloading googleapis_common_protos-1.61.0-py2.py3-none-any.whl.metadata (1.5 kB)
06:26:13  #12 16.70   Downloading googleapis_common_protos-1.60.0-py2.py3-none-any.whl.metadata (1.5 kB)
06:26:13  #12 16.73   Downloading googleapis_common_protos-1.59.1-py2.py3-none-any.whl.metadata (1.5 kB)
06:26:13  #12 16.77   Downloading googleapis_common_protos-1.59.0-py2.py3-none-any.whl.metadata (1.5 kB)
06:26:13  #12 16.81   Downloading googleapis_common_protos-1.58.0-py2.py3-none-any.whl.metadata (1.5 kB)
06:26:13  #12 16.85   Downloading googleapis_common_protos-1.57.1-py2.py3-none-any.whl.metadata (1.5 kB)
06:26:13  #12 16.89   Downloading googleapis_common_protos-1.57.0-py2.py3-none-any.whl.metadata (1.5 kB)
06:26:13  #12 16.93   Downloading googleapis_common_protos-1.56.4-py2.py3-none-any.whl.metadata (1.3 kB)
06:26:13  #12 17.03   Downloading googleapis_common_protos-1.56.3-py2.py3-none-any.whl.metadata (1.3 kB)
06:26:13  #12 17.06   Downloading googleapis_common_protos-1.56.2-py2.py3-none-any.whl.metadata (1.3 kB)
**06:26:13  #12 17.15 Collecting proto-plus<2.0.0dev,>=1.15.0 (from google-cloud-translate==3.7.4->tamr_toolbox[all]>=1.1.1->-r requirements.txt (line 2))**
06:26:14  #12 17.16   Downloading proto_plus-1.23.0-py3-none-any.whl.metadata (2.2 kB)
06:26:14  #12 17.60   Downloading proto_plus-1.22.3-py3-none-any.whl.metadata (2.2 kB)
**06:26:15  #12 18.11 Collecting google-cloud-core<3.0.0dev,>=1.3.0 (from google-cloud-translate==3.7.4->tamr_toolbox[all]>=1.1.1->-r requirements.txt (line 2))**
06:26:15  #12 18.12   Downloading google_cloud_core-2.4.0-py2.py3-none-any.whl.metadata (2.7 kB)
**06:26:16  #12 19.65 Collecting google-api-core[grpc]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5 (from google-cloud-translate==3.7.4->tamr_toolbox[all]>=1.1.1->-r requirements.txt (line 2))**
06:26:16  #12 19.66   Downloading google_api_core-2.19.1-py3-none-any.whl.metadata (2.7 kB)
06:26:18  #12 21.14   Downloading google_api_core-2.19.0-py3-none-any.whl.metadata (2.7 kB)
06:26:19  #12 22.96   Downloading google_api_core-2.18.0-py3-none-any.whl.metadata (2.7 kB)
06:26:21  #12 24.68   Downloading google_api_core-2.17.1-py3-none-any.whl.metadata (2.7 kB)
**06:26:23  #12 26.36 Collecting proto-plus<2.0.0dev,>=1.15.0 (from google-cloud-translate==3.7.4->tamr_toolbox[all]>=1.1.1->-r requirements.txt (line 2))**
06:26:23  #12 26.37   Downloading proto_plus-1.22.2-py3-none-any.whl.metadata (2.2 kB)
06:26:23  #12 26.92   Downloading proto_plus-1.22.1-py3-none-any.whl.metadata (2.1 kB)
06:26:24  #12 27.47   Downloading proto_plus-1.22.0-py3-none-any.whl.metadata (2.1 kB)
06:26:24  #12 28.02   Downloading proto_plus-1.20.6-py3-none-any.whl.metadata (2.1 kB)
06:26:25  #12 28.57   Downloading proto_plus-1.20.5-py3-none-any.whl.metadata (2.1 kB)
06:26:25  #12 29.10   Downloading proto_plus-1.20.4-py3-none-any.whl.metadata (2.1 kB)
06:26:26  #12 29.64   Downloading proto_plus-1.20.3-py3-none-any.whl.metadata (2.3 kB)
06:26:27  #12 30.19   Downloading proto_plus-1.20.2-py3-none-any.whl.metadata (2.3 kB)
06:26:27  #12 30.73   Downloading proto_plus-1.20.1-py3-none-any.whl.metadata (2.2 kB)
06:26:28  #12 31.27   Downloading proto_plus-1.20.0-py3-none-any.whl.metadata (2.2 kB)
06:26:28  #12 31.82   Downloading proto_plus-1.19.9-py3-none-any.whl.metadata (2.2 kB)
06:26:29  #12 32.37   Downloading proto_plus-1.19.8-py3-none-any.whl.metadata (2.2 kB)
06:26:29  #12 32.91   Downloading proto_plus-1.19.7-py3-none-any.whl.metadata (2.2 kB)
06:26:30  #12 33.45   Downloading proto_plus-1.19.6-py3-none-any.whl.metadata (2.2 kB)
06:26:31  #12 34.20   Downloading proto_plus-1.19.5-py3-none-any.whl.metadata (2.2 kB)
06:26:31  #12 34.67   Downloading proto_plus-1.19.4-py3-none-any.whl.metadata (2.2 kB)
06:26:32  #12 35.13   Downloading proto_plus-1.19.3-py3-none-any.whl.metadata (2.2 kB)
06:26:32  #12 35.60   Downloading proto_plus-1.19.2-py3-none-any.whl.metadata (2.2 kB)
06:26:32  #12 36.07   Downloading proto_plus-1.19.1-py3-none-any.whl.metadata (2.2 kB)
06:26:33  #12 36.54   Downloading proto_plus-1.19.0-py3-none-any.whl.metadata (2.2 kB)
06:26:34  #12 37.01   Downloading proto_plus-1.18.1-py3-none-any.whl.metadata (2.2 kB)
06:26:34  #12 37.48   Downloading proto_plus-1.18.0-py3-none-any.whl.metadata (2.2 kB)
06:26:34  #12 37.95   Downloading proto_plus-1.17.0-py3-none-any.whl.metadata (2.2 kB)
06:26:35  #12 38.42   Downloading proto_plus-1.16.0-py3-none-any.whl.metadata (2.2 kB)
06:26:35  #12 38.88   Downloading proto_plus-1.15.0-py3-none-any.whl.metadata (2.2 kB)
**06:26:36  #12 39.34 Collecting google-api-core[grpc]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5 (from google-cloud-translate==3.7.4->tamr_toolbox[all]>=1.1.1->-r requirements.txt (line 2))**
06:26:36  #12 39.35   Downloading google_api_core-2.17.0-py3-none-any.whl.metadata (2.7 kB)
06:26:51  #12 53.58   Downloading google_api_core-2.16.2-py3-none-any.whl.metadata (2.7 kB)
06:27:06  #12 67.75   Downloading google_api_core-2.16.1-py3-none-any.whl.metadata (2.7 kB)
06:27:21  #12 82.06   Downloading google_api_core-2.16.0-py3-none-any.whl.metadata (2.7 kB)
06:27:33  #12 96.18   Downloading google_api_core-2.15.0-py3-none-any.whl.metadata (2.7 kB)
06:27:47  #12 110.5 INFO: pip is looking at multiple versions of google-api-core[grpc] to determine which version is compatible with other requirements. This could take a while.
06:28:55  #12 172.1 INFO: pip is still looking at multiple versions of google-api-core[grpc] to determine which version is compatible with other requirements. This could take a while.
**06:29:17  #12 200.4 Collecting google-cloud-storage>=2.0.0 (from tamr_toolbox[all]>=1.1.1->-r requirements.txt (line 2))**
06:29:17  #12 200.5   Downloading google_cloud_storage-2.18.1-py2.py3-none-any.whl.metadata (9.1 kB)
06:31:23  #12 320.3 INFO: This is taking longer than usual. You might need to provide the dependency resolver with stricter constraints to reduce runtime. See https://pip.pypa.io/warnings/backtracking for guidance. If you want to abort this run, press Ctrl + C.
06:33:15  #12 429.5   Downloading google_cloud_storage-2.18.0-py2.py3-none-any.whl.metadata (9.1 kB)
06:37:06  #12 659.1   Downloading google_cloud_storage-2.17.0-py2.py3-none-any.whl.metadata (6.6 kB)
06:40:58  #12 888.0   Downloading google_cloud_storage-2.16.0-py2.py3-none-any.whl.metadata (6.1 kB)
06:44:49  #12 1118.2   Downloading google_cloud_storage-2.15.0-py2.py3-none-any.whl.metadata (6.1 kB)

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions