Skip to content

lower celery mem limit#2189

Open
gsaudade99 wants to merge 3 commits into
usegalaxy-eu:masterfrom
gsaudade99:patch/celery-mem-limits
Open

lower celery mem limit#2189
gsaudade99 wants to merge 3 commits into
usegalaxy-eu:masterfrom
gsaudade99:patch/celery-mem-limits

Conversation

@gsaudade99

@gsaudade99 gsaudade99 commented Jul 14, 2026

Copy link
Copy Markdown
Contributor

With recent fixes, our celery restarts pick memory is be less than 1G. I think having some slack in case we need to process milions of tasks again at the time is okay IMO.

needs: usegalaxy-eu/ansible-galaxy-systemd#20

closes https://github.com/usegalaxy-eu/issues/issues/1010

@gsaudade99
gsaudade99 requested a review from domgz July 14, 2026 14:53
Comment thread hosts
celery-cloud-1.galaxyproject.eu ansible_ssh_user=rocky
celery-cloud-2.galaxyproject.eu ansible_ssh_user=rocky
celery-cloud-3.galaxyproject.eu ansible_ssh_user=rocky
celery-cloud-4.galaxyproject.eu ansible_ssh_user=rocky

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

just for me, those are now separate KVM hosts?

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

*.galaxproject.eu are in openstack and the bi.privat in KVM

Comment thread hosts
celery-1.bi.privat
celery-2.bi.privat
celery-3.bi.privat
celery-4.bi.privat

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

what are those?

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

KVMs in celery,ig we could probably reduce the amount of celery workers

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants