You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: deploy/docs/LoadingLargeDatasets.md
+6-10Lines changed: 6 additions & 10 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -25,15 +25,13 @@ EOF
25
25
26
26
### 2. Add nodes to the es-ingest node pool
27
27
28
-
This can be done by adjusting the `pool_num_nodes` variable in our [terraform deployment](https://github.com/broadinstitute/gnomad-terraform/blob/8519ea09e697afc7993b278f1c2b4240ae21c8a4/exac-gnomad/services/browserv4/main.tf#L99) and opening a PR to review and apply the infrastructure change.
28
+
This can be done by adjusting the `pool_num_nodes` variable in our [terraform deployment](https://github.com/broadinstitute/gnomad-terraform/blob/8519ea09e697afc7993b278f1c2b4240ae21c8a4/exac-gnomad/services/browserv4/main.tf#L99) and applying the change with `terraform apply`.
29
29
30
-
### 3. When the new es-ingest GKE nodes are ready, Add temporary pods to Elasticsearch cluster
30
+
### 3. When the new es-ingest GKE nodes are ready, add temporary pods to Elasticsearch cluster
Uncommend the [stanza for ingest nodes in the gnomad-deployments repo](https://github.com/broadinstitute/gnomad-deployments/blob/main/elasticsearch/prod/kustomization.yaml#L160), commit, push, and merge to `main`. The number of ingest pods should match the number of nodes in the `es-ingest` node pool.
35
33
36
-
The number of ingest pods should match the number of nodes in the `es-ingest` node pool.
34
+
When the update is merged to `main`, start the new pods by going to [the Argo CD dashboard](https://argocd.sre.the-tgg.dev/applications/tgg-services/gnomad-elasticsearch) and syncing.
### 7. Once data is done being moved, remove the ingest pods
131
129
132
-
```
133
-
./deployctl elasticsearch apply --n-ingest-pods=0
134
-
```
130
+
Revert the commit you made in step 3, thus once again commenting out the stanza for ingest nodes in the gnomad-deployments repo, then sync via Argo as in step 3.
135
131
136
132
Watch the cluster to ensure that the ingest pods are successfully terminated:
137
133
@@ -141,7 +137,7 @@ kubectl get pods -w
141
137
142
138
### 8. Once the ingest pods are terminated, resize the es-ingest node pool to 0
143
139
144
-
Set the `pool_num_nodes` varible for the es-ingest node pool to 0 in our [terraform deployment](https://github.com/broadinstitute/gnomad-terraform/blob/8519ea09e697afc7993b278f1c2b4240ae21c8a4/exac-gnomad/services/browserv4/main.tf#L99) and open a PR to review and apply the infrastructure change.
140
+
Set the `pool_num_nodes` varible for the es-ingest node pool to 0 in our [terraform deployment](https://github.com/broadinstitute/gnomad-terraform/blob/8519ea09e697afc7993b278f1c2b4240ae21c8a4/exac-gnomad/services/browserv4/main.tf#L99) and `terraform apply`.
0 commit comments