ADD: Downloading data from external data provider

[ajkarloss]

Jeevan will add/modify/edit this part and add it to the documentation

Downloading data from NSC (Or, other data providers) to NIRD

ssh <saga_username>@login.nird-lmd.sigma2.no

cd /nird/projects/NS9305K/datasets/

ls -lh

drwxrwsr-x 5 thhaverk ns9305k 16K Oct 17 14:57 metagenomics
drwxrwsr-x 10 thhaverk ns9305k 16K Dec 7 2022 transcriptomics
drwxrwsr-x 2 thhaverk ns9305k 4.0K Sep 15 2023 virus
drwxrwsr-x 47 thhaverk ns9305k 32K Oct 4 09:59 wgs

Choose the correct folder based on the type of data in NIRD

cd metagenomics/

Note: The link should be to a file not a web page
F. ex. www.mydata.com/data.tar.gz or www.mydata.com/data.tar

wget -username <username_given_by_the_Data_provider> --password <password_given_by_the_Data_provider>

if the file size is more than few (F.ex. 10GB) GBs in size, we recommend to use screen command to download

screen
wget -username <username_given_by_the_Data_provider> --password <password_given_by_the_Data_provider>
Press "Ctrl, A and D" buttons at the same time (ctrl + A + D) to deattach from screen

screen -r <screen_Id> will take you back to the screen where you are downloading
Note: Note down your login node in NIRD. F. ex. saga_username@login3-nird-lmd.