Conversation
mikebaumann
left a comment
There was a problem hiding this comment.
Thanks for your work on this, @GPelayo!
Please address the comments I added and let me know when it is ready for re-review.
README.md
Outdated
| @@ -1,93 +1,177 @@ | |||
| # cgp-deployment | |||
| # cgp-deployment (Commons Edition) | |||
There was a problem hiding this comment.
Change:
Commons Edition
to:
Data Commons/STAGE Edition
README.md
Outdated
| ## About | ||
|
|
||
| This repository contains our Docker-compose and setup bootstrap scripts used to create a deployment of the [UCSC Genomic Institute's](http://ucsc-cgl.org) Computational Genomics Platform for AWS. It uses, supports, and drives development of several key GA4GH APIs and open source projects. In many ways it is the generalization of the [PCAWG](https://dcc.icgc.org/pcawg) cloud infrastructure developed for that project and a potential reference implementation for the [NIH Commons](https://datascience.nih.gov/commons) concept. | ||
| This repository contains our Docker-compose and setup bootstrap scripts used to create a deployment of the [UCSC Genomic Institute's](http://ucsc-cgl.org) |
There was a problem hiding this comment.
Change:
http://ucsc-cgl.org
to:
https://commons.ucsc-cgp.org/
README.md
Outdated
|
|
||
| This repository contains our Docker-compose and setup bootstrap scripts used to create a deployment of the [UCSC Genomic Institute's](http://ucsc-cgl.org) Computational Genomics Platform for AWS. It uses, supports, and drives development of several key GA4GH APIs and open source projects. In many ways it is the generalization of the [PCAWG](https://dcc.icgc.org/pcawg) cloud infrastructure developed for that project and a potential reference implementation for the [NIH Commons](https://datascience.nih.gov/commons) concept. | ||
| This repository contains our Docker-compose and setup bootstrap scripts used to create a deployment of the [UCSC Genomic Institute's](http://ucsc-cgl.org) | ||
| Computational Genomics Platform for AWS. It uses, supports, and drives development of several key GA4GH APIs and open source projects. |
There was a problem hiding this comment.
Change:
for AWS.
to:
for AWS and GCP.
README.md
Outdated
| This repository contains our Docker-compose and setup bootstrap scripts used to create a deployment of the [UCSC Genomic Institute's](http://ucsc-cgl.org) Computational Genomics Platform for AWS. It uses, supports, and drives development of several key GA4GH APIs and open source projects. In many ways it is the generalization of the [PCAWG](https://dcc.icgc.org/pcawg) cloud infrastructure developed for that project and a potential reference implementation for the [NIH Commons](https://datascience.nih.gov/commons) concept. | ||
| This repository contains our Docker-compose and setup bootstrap scripts used to create a deployment of the [UCSC Genomic Institute's](http://ucsc-cgl.org) | ||
| Computational Genomics Platform for AWS. It uses, supports, and drives development of several key GA4GH APIs and open source projects. | ||
| In many ways it is the generalization of the [PCAWG](https://dcc.icgc.org/pcawg) cloud infrastructure developed for that project and a potential reference implementation for the [NIH Commons](https://datascience.nih.gov/commons) concept. |
There was a problem hiding this comment.
Add:
It is currently being used in the NIH Data Commons Pilot and NHLBI Data STAGE programs.
README.md
Outdated
| These components are setup with the install process available in this repository: | ||
|
|
||
| * [Boardwalk](boardwalk/README.md): our file browsing portal on top of Redwood | ||
| * [Boardwalk](boardwalk/README.md): our file browsing portal on top of the Blue Box |
There was a problem hiding this comment.
Change:
the Blue Box
to:
the HCA/DataBiosphere Data Storage System (DSS).
This includes installation of the the Azul web service and the cgp-dashboard service.
README.md
Outdated
| line tool to create a host. We will refer to this as the host VM throughout the rest of the documentation. | ||
| It will run the Docker containers for all of the components listed below. | ||
|
|
||
| 9. Select the region in AWS Console top toolbar. **Note** We have had problems when uploading big files to Virginia (~25GB). |
There was a problem hiding this comment.
All these steps are numbered "9."
Please correct the numbering.
There was a problem hiding this comment.
Markdown autocorrects the numbering, so they are numbered in order. This allows me to add or remove steps without updating numbering.
README.md
Outdated
| line tool to create a host. We will refer to this as the host VM throughout the rest of the documentation. | ||
| It will run the Docker containers for all of the components listed below. | ||
|
|
||
| 9. Select the region in AWS Console top toolbar. **Note** We have had problems when uploading big files to Virginia (~25GB). |
There was a problem hiding this comment.
Change "Virginia" to "AWS region us-east-1 (N. Virginia)"
README.md
Outdated
| 9. Select the region in AWS Console top toolbar. **Note** We have had problems when uploading big files to Virginia (~25GB). | ||
| If possible, set up your AWS anywhere else but Virginia. Preferrably US-West-2 (Oregon). | ||
| 9. In the AWS Web Console Top toolbar, Click on the **Services** > **EC2** (Under the **Compute** submenu) | ||
| - **Note**: Know which region to using in AWS. **Note** We have had problems when uploading big files to Virginia (~25GB). |
There was a problem hiding this comment.
The note re. Virginia is a redundant duplicate of the same note just above.
README.md
Outdated
| |ALL TCP|TCP|0 - 65535|\<Name of your Security Group>| | ||
|
|
||
| ### 4. Create your Host VM's Subdomain | ||
| Now we need to create a subdomain and link it to for Host VM. Your subdomain should contain your. |
There was a problem hiding this comment.
This sentence is incomplete:
Your subdomain should contain your.
README.md
Outdated
| ### 1 .Before Installation | ||
|
|
||
| 9. Before you start deploying make sure the following components are already setup | ||
| - Dos Azul Lambda |
There was a problem hiding this comment.
Add to list:
HCA/DataBiosphere Data Storage System(DSS)
DataBiosphere Azul indexer (for Commons)
jessebrennan
left a comment
There was a problem hiding this comment.
These are great doc instructions! Really clear and easy to follow. 👍
I pushed some minor adjustments and have a couple questions in the review, but otherwise this looks great!
|
|
||
| ### 4. Create your Host VM's Subdomain | ||
| Now we need to create a subdomain and link it to for Host VM. Your subdomain should contain your name. | ||
| So if your name is Bob, your subdomain should be `bob.ucsc-cgp-dev.org`. |
There was a problem hiding this comment.
Is this really the protocol? What if there's multiple Bobs (or Michaels)?
There was a problem hiding this comment.
That's a good question. There isn't a strict protocol for subdomain naming and looking at the old documentation, it doesn't say that you can only use your name as the subdomain. Everyone just uses their name.
So maybe those directions should be something like...
Your subdomain should be your name, project, or any name that will help you identify the url.
So if you want to use your name and your name is Bob, your subdomain should be `bob.ucsc-cgp-dev.org`
README.md
Outdated
| 9. Click on **Hosted Zones** in the sidebar. | ||
| 9. In the table, click on **ucsc-cgp-dev.org.** under the **Domain Name** column. | ||
| 9. Click on the Blue **Create Record Set** button. | ||
| 9. A form should appear on the right side of the screen. Put in your name in the **Name** text box in the form. |
mikebaumann
left a comment
There was a problem hiding this comment.
Thanks, Geryl -- this looks really good!
Just a couple small comments, then I think it is good to go!
| ### 1. Before Installation | ||
|
|
||
| 1. Before you start deploying make sure the following components are already setup | ||
| - DOS Azul Lambda |
There was a problem hiding this comment.
Please reorder as follows (the (partial) ordering in which they would need to be installed):
- HCA/DataBiosphere Data Storage System(DSS)
- DataBiosphere Azul indexer (for Commons)
- DOS Azul Lambda
- Boardwalk README for instructions on how to setup the external components.
- Bagit Firecloud Lambda
README.md
Outdated
| 1. The Google Client Secret when you created the Google App for Boardwalk | ||
| 1. The Google Site Verification Code from the Boardwalk setup | ||
| 1. The url of the Bagit Firecloud Lambda | ||
| 1. The url of the Dos Azul Lambda |
There was a problem hiding this comment.
Change:
The url of the Dos Azul Lambda
to:
The URL of the DOS Azul Lambda (aka DOS DSS service)
No description provided.