fix/indexed-search: add livenessProbe to zoekt-webserver to prevent hung pods

Without a livenessProbe, zoekt-webserver pods that crash silently remain
in an unhealthy state indefinitely. The probe acts as a backup to the
in-process watchdog (failureThreshold=10, period=60s > watchdog's 9x60s
detection window).

ref incident INC-484 https://sourcegraph.slack.com/archives/C0APJUXBG4R

Author: devdinu

charts/sourcegraph/CHANGELOG.md

@@ -8,6 +8,7 @@ Use `**BREAKING**:` to denote a breaking change
 
 ## Unreleased
 
+- Added livenessProbe to zoekt-webserver in indexed-search to detect and restart hung pods
 - Fix Pod Disruption Budget for sourcegraph-frontend
 - Added a startup probe to the gitserver statefulset to give it time to run the on-disk migration from repo names to repo IDs
 - The repo-updater service is no longer needed and has been removed from the chart.

charts/sourcegraph/templates/indexed-search/indexed-search.StatefulSet.yaml

@@ -63,6 +63,15 @@ spec:
         ports:
         - name: grpc
           containerPort: 6070
+        livenessProbe:
+          httpGet:
+            path: /healthz
+            port: grpc
+            scheme: HTTP
+          initialDelaySeconds: 120
+          timeoutSeconds: 5
+          periodSeconds: 60
+          failureThreshold: 10
         readinessProbe:
           failureThreshold: 3
           httpGet: