Skip to content

Integrate Karpenter with AWS Health Checks (EC2 instances, EBS volumes, etc.) #7634

Open
@balusarakesh

Description

@balusarakesh

Description

Observed Behavior: We noticed that a node in EC2 is not reachable and failing health checks but karpenter is not terminating the node

Expected Behavior: Karpenter should terminate the node if it is not reachable

Reproduction Steps (Please include YAML): Not sure how since the node failed health checks

  • currently the node has the following 2 taints
node.kubernetes.io/unreachable:NoSchedule
node.kubernetes.io/unreachable:NoExecute
  • I can also confirm that in EC2 console I see that the instance failed health checks like 6 hours ago
  • most of the pods on the node are stuck in Terminating state
  • there are no logs related to this node/nodeClaim in karpenter even after enabling debug logs

Versions:

  • Chart Version: v0.34.0
  • Kubernetes Version (kubectl version): 1.29.8

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    featureNew feature or requesthelp-wantedExtra attention is needed

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions