retsore to nuget packages fails if exact version was not found

when I try reverting projects back to references and the reference was already removed due to another partial solution, the project references remains (message states replacement is skipped).

When restoring the package folder and trying again, there is no trace of leftovers that need replacing.