High memory consumption with `galsim 2.8.4`.

[mairanteodoro]

It seems that creating an L1 file using romanisim and galsim==2.84 takes up way more memory when compared with galsim==2.7.2.

Input file

The input file romanisim_input_catalog.parquet used in the following command can be found on central storage, in the folder roman/mteodoro/ROMANISIM_INPUT_CATALOG.

Themd5sum for the file is 441d8045bbe757a45ed27e7baca5433c.

Command

$ romanisim-make-image --radec 270.0 66.0 --level 1 --sca 11 --bandpass F213 --usecrds --roll 90.0 --catalog romanisim_input_catalog.parquet --psftype stpsf --ma_table_number 5 --date 2027-06-01T00:00:00 --rng_seed 1 --drop-extra-dq r0000401002001001001_0008_wfi11_f213_uncal.asdf

Results

• galsim==2.7.2:

  • pip list: venv_galsim272.txt

  • logfile: log_galsim272.log

  • memory profile data: mprofile_20260306131648.txt

• galsim==2.8.4:

  • pip list: venv_galsim284.txt

  • logfile: log_galsim284.log

  • memory profile data: mprofile_20260306133514.txt

[schlafly]

It looks to me like this is the likely culprit:
https://github.com/GalSim-developers/GalSim/blob/v2.8.4/CHANGELOG.rst#api-changes

Would you mind trying with:
#341
? Thanks!

[mairanteodoro]

PR#341 seems to have fixed the issue; now the memory profile when using galsim==2.84 is similar to that from 2.7.2:

• galsim==2.84:

  • pip list: venv_galsim284_PR341.txt

  • logfile: log_galsim284_PR341.log

  • memory profile data: mprofile_20260316081920_PR341.txt

[schlafly]

Thanks, merging.