Skip to content

Commit 7026ce9

Browse files
patrick-tripppatrick-tripp
authored
RHEL 8.10 EFS v2.3.3 clean deployment (#121)
* deployed RHEL 8.10 * EFS utils v2.3.3 * fresh spack binary s3 mirror * spack binaries were built with install path padding * metis and petsc added * intel mkl install fixed * numerous fixes and updates to environment setup * numerous cloudflow updates, fixes, and cleanup * necofs, secofs, and eccofs models added * fixed spack gpg key issues * added deployment details file scp to head node
1 parent 0379cab commit 7026ce9

54 files changed

Lines changed: 966 additions & 329 deletions

Some content is hidden

Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.

‎.gitignore‎

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -39,3 +39,4 @@ models/utils/makedepf90/
3939
*.log
4040
*.out
4141
out.*
42+
terraform/deployment.info

‎DEPLOYMENT.md‎

Lines changed: 10 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -159,10 +159,16 @@ Run `terraform apply` to create the AWS resources.
159159
terraform apply -var-file="mysettings.tfvars"
160160
```
161161

162+
Alternative method:
163+
```
164+
terraform plan -var-file=mysettings.tfvars -out=my.plan
165+
terraform apply my.plan
166+
```
167+
162168
Enter 'yes' to create the resources.
163169

164170
---
165-
**NOTE:**
171+
**NOTES:**
166172

167173
You may run into something similar to the following error if applying Terraform on an AWS account where more than one Cloud Sandbox have been deployed:
168174
```
@@ -204,7 +210,7 @@ The installation script will continue to run on the instance after terraform com
204210
You can log into the newly created EC2 instance and watch the installation progress.
205211
```
206212
Example:
207-
ssh -i my-sandbox.pem centos@ec2-3-219-217-151.compute-1.amazonaws
213+
ssh -i my-sandbox.pem ec2-user@ec2-3-219-217-151.compute-1.amazonaws
208214
sudo -i
209215
tail -f /root/setup.log
210216
```
@@ -226,7 +232,7 @@ terraform apply -var-file="mysettings.tfvars"
226232
```
227233
*If terraform says the instance needs to be destroyed first, type "no" when prompted to keep the existing instance. There are other ways to change the instance type.*
228234

229-
### Cleanup
235+
### Cleanup - delete the sandbox
230236
When done using the Cloud Sandbox deployment, all of the AWS resources (including disks!) can be destroyed with the following command:
231237
```
232238
terraform destroy -var-file="mysettings.tfvars"
@@ -236,6 +242,6 @@ terraform destroy -var-file="mysettings.tfvars"
236242

237243
### Recovering Terraform State
238244

239-
In case you've already deployed cloud resources but your local copy of Cloud Sandbox is destroyed or you work on multiple copies, you can restore the Terraform state from the remote S3 bucket by simply running `terraform init -backend-config=config.s3.tfbackend` again. If you were using a custom workspace, switch to that workspace with `terraform workspace select`. Once you run `terraform plan` you should see that no new resources need to be created.
245+
In case you've already deployed cloud resources but your local Cloud Sandbox terraform directory/files are destroyed or or lost, or if you work on multiple copies, you can restore the Terraform state from the remote S3 bucket by simply running `terraform init -backend-config=config.s3.tfbackend` again. If you were using a custom workspace, switch to that workspace with `terraform workspace select`. Once you run `terraform plan` you should see that no new resources need to be created.
240246

241247
*© Copyright 2025 RPS Group. All rights reserved.*

‎cloudflow/cluster/configs/RPS/current.image_id‎

Lines changed: 2 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1 +1,2 @@
1-
ami-0df1adc30c6953fd8
1+
oldsb: ami-0df1adc30c6953fd8
2+
ami-0f9c8d69be8c31629

‎cloudflow/cluster/configs/RPS/eccofs.hpc6‎

Lines changed: 10 additions & 10 deletions
Original file line numberDiff line numberDiff line change
@@ -2,18 +2,18 @@
22
"platform" : "AWS",
33
"region" : "us-east-2",
44
"nodeType" : "hpc6a.48xlarge",
5-
"nodeTypeBig" : "hpc7a.96xlarge",
6-
"nodeCount" : 6,
5+
"nodeCount" : 4,
76
"tags" : [
8-
{ "Key": "Name", "Value": "eccofs-testcase-subseqday" },
7+
{ "Key": "Name", "Value": "eccofs" },
98
{ "Key": "Project", "Value": "IOOS-Cloud-Sandbox" }
109
],
11-
"image_id" : "ami-0df1adc30c6953fd8",
1210
"key_name" : "ioos-sandbox",
13-
"sg_ids" : [ "sg-0feaeb0d419b7ddda",
14-
"sg-046f683021585a25f",
15-
"sg-0416cbb8c060a1779"
16-
],
17-
"subnet_id" : "subnet-0be869ddbf3096968",
18-
"placement_group" : "forPR-cloud-sandbox-us-east-2b_Terraform_Placement_Group"
11+
"image_id" : "ami-03e854ffba37e01cc",
12+
"sg_ids" : [
13+
"sg-06f872237e3c34f00",
14+
"sg-03c2f65207b22676e",
15+
"sg-08f3162d6cded1567"
16+
],
17+
"subnet_id" : "subnet-091bcf131af86e9f9",
18+
"placement_group" : "cloud-sandbox-07292025-us-east-2b_Terraform_Placement_Group"
1919
}

‎cloudflow/cluster/configs/RPS/eccofs.hpc7‎

Lines changed: 19 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,19 @@
1+
{
2+
"platform" : "AWS",
3+
"region" : "us-east-2",
4+
"nodeType" : "hpc7a.96xlarge",
5+
"nodeCount" : 2,
6+
"tags" : [
7+
{ "Key": "Name", "Value": "eccofs" },
8+
{ "Key": "Project", "Value": "IOOS-Cloud-Sandbox" }
9+
],
10+
"key_name" : "ioos-sandbox",
11+
"image_id" : "ami-03e854ffba37e01cc",
12+
"sg_ids" : [
13+
"sg-06f872237e3c34f00",
14+
"sg-03c2f65207b22676e",
15+
"sg-08f3162d6cded1567"
16+
],
17+
"subnet_id" : "subnet-091bcf131af86e9f9",
18+
"placement_group" : "cloud-sandbox-07292025-us-east-2b_Terraform_Placement_Group"
19+
}

‎cloudflow/cluster/configs/RPS/necofs.hindcast.newsb‎

Lines changed: 19 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,19 @@
1+
{
2+
"platform" : "AWS",
3+
"region" : "us-east-2",
4+
"nodeType" : "hpc7a.96xlarge",
5+
"nodeCount" : 2,
6+
"tags" : [
7+
{ "Key": "Name", "Value": "necofs-hindcast" },
8+
{ "Key": "Project", "Value": "IOOS-Cloud-Sandbox" }
9+
],
10+
"image_id" : "ami-02332a20baf901a90",
11+
"key_name" : "ioos-sandbox",
12+
"sg_ids" : [
13+
"sg-06f872237e3c34f00",
14+
"sg-03c2f65207b22676e",
15+
"sg-08f3162d6cded1567"
16+
],
17+
"subnet_id" : "subnet-091bcf131af86e9f9",
18+
"placement_group" : "cloud-sandbox-07292025-us-east-2b_Terraform_Placement_Group"
19+
}

‎cloudflow/cluster/configs/RPS/secofs.hpc6‎

Lines changed: 11 additions & 10 deletions
Original file line numberDiff line numberDiff line change
@@ -2,19 +2,20 @@
22
"platform" : "AWS",
33
"region" : "us-east-2",
44
"nodeType" : "hpc6a.48xlarge",
5-
"nodeTypeNew" : "hpc7a.96xlarge",
6-
"nodeCount" : 8,
5+
"nodeCount" : 7,
76
"TODO": "make name tag an argument to workflow_main",
87
"tags" : [
9-
{ "Key": "Name", "Value": "seccofs-hotstart" },
8+
{ "Key": "Name", "Value": "seccofs" },
109
{ "Key": "Project", "Value": "IOOS-Cloud-Sandbox" }
1110
],
12-
"image_id" : "ami-0df1adc30c6953fd8",
1311
"key_name" : "ioos-sandbox",
14-
"sg_ids" : [ "sg-0feaeb0d419b7ddda",
15-
"sg-046f683021585a25f",
16-
"sg-0416cbb8c060a1779"
17-
],
18-
"subnet_id" : "subnet-0be869ddbf3096968",
19-
"placement_group" : "forPR-cloud-sandbox-us-east-2b_Terraform_Placement_Group"
12+
"image_id" : "ami-0f9c8d69be8c31629",
13+
"sg_ids" : [
14+
"sg-06f872237e3c34f00",
15+
"sg-03c2f65207b22676e",
16+
"sg-08f3162d6cded1567"
17+
],
18+
"subnet_id" : "subnet-091bcf131af86e9f9",
19+
"placement_group" : "cloud-sandbox-07292025-us-east-2b_Terraform_Placement_Group"
2020
}
21+

‎cloudflow/cluster/configs/RPS/secofs.hpc7‎

Lines changed: 8 additions & 7 deletions
Original file line numberDiff line numberDiff line change
@@ -7,12 +7,13 @@
77
{ "Key": "Name", "Value": "seccofs-hotstart" },
88
{ "Key": "Project", "Value": "IOOS-Cloud-Sandbox" }
99
],
10-
"image_id" : "ami-0df1adc30c6953fd8",
1110
"key_name" : "ioos-sandbox",
12-
"sg_ids" : [ "sg-0feaeb0d419b7ddda",
13-
"sg-046f683021585a25f",
14-
"sg-0416cbb8c060a1779"
15-
],
16-
"subnet_id" : "subnet-0be869ddbf3096968",
17-
"placement_group" : "forPR-cloud-sandbox-us-east-2b_Terraform_Placement_Group"
11+
"image_id" : "ami-0f9c8d69be8c31629",
12+
"sg_ids" : [
13+
"sg-06f872237e3c34f00",
14+
"sg-03c2f65207b22676e",
15+
"sg-08f3162d6cded1567"
16+
],
17+
"subnet_id" : "subnet-091bcf131af86e9f9",
18+
"placement_group" : "cloud-sandbox-07292025-us-east-2b_Terraform_Placement_Group"
1819
}

‎cloudflow/cluster/configs/RPS/secofs.test.cconf‎

Lines changed: 0 additions & 18 deletions
This file was deleted.

‎cloudflow/cluster/configs/list_amis.sh‎

Lines changed: 8 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,8 @@
1+
#!/usr/bin/env bash
2+
3+
aws ec2 describe-images \
4+
--owners self \
5+
--filters "Name=name,Values=*" \
6+
--query "Images | sort_by(@, &CreationDate) | reverse(@) | [].{ID:ImageId, Name:Name, Created:CreationDate}" \
7+
--output table
8+

0 commit comments

Comments
 (0)