Description

I don't know if anything can be done about this, but using memray do to a memory analysis of pip for a large dry install (apache-airflow[all]==2.9.2) there is a peak memory usage of 354 MBs and 250 MBs of that is a list of pages.

Expected behavior

This seems like far too much memory, like the whole page contents is being kept in memory where a smaller representation of the page needs to be kept?

pip version

24.1.1

Python version

3.12

OS

Linux

How to Reproduce

1. Create and activate virtual environment
2. python -m pip install memray
3. python -m pip install --dry-run "apache-airflow[all]==2.9.2" (to fill cache)
4. python -m memray run -m pip install --dry-run "apache-airflow[all]==2.9.2"
5. python -m memray flamegraph memray-pip.*.bin

Output

Code of Conduct

• I agree to follow the PSF Code of Conduct.