Skip to content

System resource checks in kubernetes environments #186

@mscienski

Description

@mscienski

We're running taskq workers on kubernetes pods, but have encountered a less than ideal situation with the hasFreeSystemResources check. It appears that the Sysinfo checks are returning total RAM and CPU values for the entire k8s node, not the pod. So when we run on a node with 64GB of RAM, we'd have to specify the minimum memory for each taskq worker replica pod to be at least ~3072 MiB to meet the 5% threshold, which seems excessive.

We see an MR to make system resource customization customizable here: #95. We'd be interested in picking that up so that we could configure the limits when running on k8s nodes or other VM infrastructures, if Sysinfo is reporting total resources of the host rather than the pods.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions