Skip to content

Conversation

@kysrpex
Copy link
Contributor

@kysrpex kysrpex commented Oct 30, 2025

Hi! I was looking into an OOM issue with HISAT2 on usegalaxy.eu and although it's unrelated, at some point @bgruening mentioned the TPV rule they have at usegalaxy.org for HISAT2.

It looks better than what the have in the shared DB, it seems to provide more breathing room when processing large datasets with HISAT2. However I don't know how well it works, I guess @natefoo can provide better insights and help us decide if the switch is worth it.

Provide more breathing room when processing large datasets with HISAT2.
@kysrpex kysrpex force-pushed the hisat2_usegalaxy.org branch from 20a2281 to 15a9c9f Compare October 30, 2025 09:55
@nuwang
Copy link
Member

nuwang commented Nov 6, 2025

@nuwang nuwang requested a review from cat-bro November 6, 2025 09:54
@cat-bro
Copy link
Collaborator

cat-bro commented Nov 6, 2025

LGTM. It’s not that different from AU’s set of rules except for the largest allocation. We were seeing OOM errors for hisat2 and switched to giving the big jobs cores: 36, mem: 500 over a year ago. Some jobs run out of memory even with this allocation. It would be interesting to understand the parameters that lead to such high memory use, because 500GB is excessive for most of the jobs.

@nuwang nuwang merged commit 9e497f5 into galaxyproject:main Nov 6, 2025
1 check passed
@nuwang
Copy link
Member

nuwang commented Nov 6, 2025

Thank you @kysrpex!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants