-
Notifications
You must be signed in to change notification settings - Fork 2
feat: activity pod healthcheck #45
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
base: staging
Are you sure you want to change the base?
Conversation
chore: staging to master (helm chart version v0.0.1)
fix: add write permissions for gh token (#11)
feat: add index copy step (#13)
feat: add release workflows (#17)
fix: set task queue (#20)
- Add nfsServer.external.storageClass and size parameters in values.yaml - Modify shared-storage-pvc.yaml to always create PVC with conditional storage class - Simplify _helpers.tpl sharedStoragePVC function to use consistent naming - Add validation error when storageClass is empty and NFS is disabled - Support RWX storage classes like EFS, Azure Files, GCP Filestore, etc.
- Remove PodAntiAffinity that prevented sync pods from running on same node - Allow multiple sync operations to run concurrently for better resource utilization - Keep JobID-based node affinity for resource mapping - Fix tautological condition in affinity assignment
- Add ConfigMapWatcher using client-go informers for live updates - Integrate watcher into K8sPodManager with graceful shutdown - Update pod scheduling to use live mapping instead of static config - Support debouncing (2s) for rapid ConfigMap changes - Maintain backward compatibility with existing Helm charts
feat: live cm reload
fix: lint and sec bugs
feat: live cm reload
…nto refactor/olake-worker
…olake-helm into refactor/olake-worker
| // Add liveness probe for long-running sync operations | ||
| if req.Command == types.Sync { | ||
| pod.Spec.Containers[0].LivenessProbe = &corev1.Probe{ | ||
| ProbeHandler: corev1.ProbeHandler{ | ||
| Exec: &corev1.ExecAction{ | ||
| Command: []string{ | ||
| "/bin/sh", | ||
| "-c", | ||
| "echo ok > /mnt/config/.healthcheck", | ||
| }, | ||
| }, | ||
| }, | ||
| InitialDelaySeconds: 10, | ||
| PeriodSeconds: 30, | ||
| TimeoutSeconds: 5, | ||
| FailureThreshold: 3, | ||
| SuccessThreshold: 1, | ||
| } | ||
| } | ||
|
|
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I have added a constant AysncCommands which has all long running tasks. So can we use that here?
// Add liveness probe for long-running sync operations
if slices.Contains(constants.AsyncCommands, req.Command) {
pod.Spec.Containers[0].LivenessProbe = &corev1.Probe{
...
}There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I don't see it in this file: https://github.com/datazip-inc/olake-helm/blob/refactor/olake-worker/worker/constants/constants.go where is it located?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
If it is pending on some other PR, then let's change it later on.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Need to add when clear-destination PR is merged.
Description
Add liveness probe to sync pods
Fixes # (issue)
Type of change
How Has This Been Tested?
Screenshots or Recordings
Related PR's (If Any):