cronjob to harvest endpoints

Run the mail script to harvest nde and oai endpoints

./main.sh

This is the main repo to run the pipeline of CLARIAH. The pipeline consists of the following steps:

1. Harvesting endpoints both NDE and OAI
2. Ingesting the harvested datasets (Needs VLO and it's repo is here)
3. Labeling and RAIR-assess the datasets (Need INEO Labeling and pyFAT, they are built into one docker image)
   1. Labeling datasets as INEO records (true or false) in VLO
   2. RAIR-assess the datasets and show the resuilt in VLO
   3. The assessment reports are store in ttl folder on VLO
4. Sync the datasets to INEO (Needs INEO Sync)