Cannot install package offline with VCS dependencies, even if they are pre-installed

[alkasm]

Description

Offline installations of a package with a VCS URL dependency fails even if the dependency is already installed. This happens because pip tries to pull the VCS URL, and when it can't it fails.

Recently (not sure when, possibly when the new resolver rolled out), I believe VCS-specified dependencies became "eager by default" in pip, so that they are downloaded even when already installed (to install and check version metadata, etc). This means that invoking pip install with VCS URL dependencies fails offline. To counteract this, we can use --no-deps to not install the dependencies, but then you must forego the version checking that pip does on all the other packages which are currently installed. Alternatively, I get around both problems using --use-deprecated legacy-resolver.

I marked this as a "bug" rather than a "feature request" as the old resolver worked here, but the new resolver does not.

I see at least two workable solutions for this problem, maybe there are other ideas:

• add a flag to not eagerly install vcs-specified dependencies if they're already installed
• add a command to explicitly check against version requirements (e.g. check your environment meets the current packages) (potentially similar to a pip resolve A pip resolve command to convert to transitive == requirements very fast by scanning wheels for static dependency info (WORKING PROTOTYPE!) #7819)

Expected behavior

There should be a way to install a package with VCS dependencies offline while version checking the other requirements.

pip version

21.3

How to Reproduce

I've uploaded a very basic example with a descriptive README here: https://github.com/alkasm/test-vcs-offline

Code of Conduct

• I agree to follow the PSF Code of Conduct.

[pradyunsg]

See #5780, which this issue is a specific subset of. Specifically, the intended resolution direction: #5780 (comment)

[sbidoul]

@alkasm I come back here from #10564 (comment).

I'm not entirely sure I follow what you mean with an offline installation of a VCS URL. Could you provide a step-by-step scenario that illustrates your use case ?

[alkasm]

@sbidoul Sure thing. For clarity I mean "offline install of a package which has a VCS URL dependency"

I created a repo with an explanatory README here: https://github.com/alkasm/vcs-url-install-example

edit: lol I just realized in editing the OP that I already created a repo example, but I forgot and this one is a different example. Oh well! Now there's two examples :P

[uranusjr]

I think this is the key statement

offline installations of a package with a VCS URL dependency fails even if the dependency is already installed

[alkasm]

I think this is the key statement

Yep, sorry I think my initial description dived into the details too quickly. I added that as a first line for clarity. Thanks!