Bundle many files #83
Description
Most filesystems on clusters do not like many files (like >10_000 pdb or cif files). It would be nice if you could keep those files inside a bundle like an archive or container.
Possible things:
- fsspec with archive fs
- apptainer/squashfs like https://github.com/CSCfi/hpc-container-wrapper or https://github.com/containers/toolbox
- fuse mount