Skip to content

Commit 4ff31e0

Browse files
Update docs on loading large datasets
1 parent 85b5f15 commit 4ff31e0

File tree

1 file changed

+6
-10
lines changed

1 file changed

+6
-10
lines changed

deploy/docs/LoadingLargeDatasets.md

Lines changed: 6 additions & 10 deletions
Original file line numberDiff line numberDiff line change
@@ -25,15 +25,13 @@ EOF
2525

2626
### 2. Add nodes to the es-ingest node pool
2727

28-
This can be done by adjusting the `pool_num_nodes` variable in our [terraform deployment](https://github.com/broadinstitute/gnomad-terraform/blob/8519ea09e697afc7993b278f1c2b4240ae21c8a4/exac-gnomad/services/browserv4/main.tf#L99) and opening a PR to review and apply the infrastructure change.
28+
This can be done by adjusting the `pool_num_nodes` variable in our [terraform deployment](https://github.com/broadinstitute/gnomad-terraform/blob/8519ea09e697afc7993b278f1c2b4240ae21c8a4/exac-gnomad/services/browserv4/main.tf#L99) and applying the change with `terraform apply`.
2929

30-
### 3. When the new es-ingest GKE nodes are ready, Add temporary pods to Elasticsearch cluster
30+
### 3. When the new es-ingest GKE nodes are ready, add temporary pods to Elasticsearch cluster
3131

32-
```
33-
./deployctl elasticsearch apply --n-ingest-pods=48
34-
```
32+
Uncommend the [stanza for ingest nodes in the gnomad-deployments repo](https://github.com/broadinstitute/gnomad-deployments/blob/main/elasticsearch/prod/kustomization.yaml#L160), commit, push, and merge to `main`. The number of ingest pods should match the number of nodes in the `es-ingest` node pool.
3533

36-
The number of ingest pods should match the number of nodes in the `es-ingest` node pool.
34+
When the update is merged to `main`, start the new pods by going to [the Argo CD dashboard](https://argocd.sre.the-tgg.dev/applications/tgg-services/gnomad-elasticsearch) and syncing.
3735

3836
Watch pods' readiness with `kubectl get pods -w`.
3937

@@ -129,9 +127,7 @@ curl -u "elastic:$ELASTICSEARCH_PASSWORD" -XPUT "localhost:9200/_cluster/setting
129127

130128
### 7. Once data is done being moved, remove the ingest pods
131129

132-
```
133-
./deployctl elasticsearch apply --n-ingest-pods=0
134-
```
130+
Revert the commit you made in step 3, thus once again commenting out the stanza for ingest nodes in the gnomad-deployments repo, then sync via Argo as in step 3.
135131

136132
Watch the cluster to ensure that the ingest pods are successfully terminated:
137133

@@ -141,7 +137,7 @@ kubectl get pods -w
141137

142138
### 8. Once the ingest pods are terminated, resize the es-ingest node pool to 0
143139

144-
Set the `pool_num_nodes` varible for the es-ingest node pool to 0 in our [terraform deployment](https://github.com/broadinstitute/gnomad-terraform/blob/8519ea09e697afc7993b278f1c2b4240ae21c8a4/exac-gnomad/services/browserv4/main.tf#L99) and open a PR to review and apply the infrastructure change.
140+
Set the `pool_num_nodes` varible for the es-ingest node pool to 0 in our [terraform deployment](https://github.com/broadinstitute/gnomad-terraform/blob/8519ea09e697afc7993b278f1c2b4240ae21c8a4/exac-gnomad/services/browserv4/main.tf#L99) and `terraform apply`.
145141

146142
### 9. Clean up, delete any unused indices.
147143

0 commit comments

Comments
 (0)