Improvements to S3 paths

[abradley60]

• Changing final S3 paths based on our conversations. They will follow the format below:
• RTC_S1
  • s3_bucket/s3_project_folder/odc_product_name/burst_id/year/month/day/*files
  • odc_product_name is determined by the polarisation and collection_number for RTC_S1 products.
  • It will be one of ga_s1_iw_vv_vh_cX, ga_s1_iw_vv_cX, ga_s1_iw_hh_hv_cX, ga_s1_iw_hh_cX, where X is the collection_number
• example -> https://deant-data-public-dev.s3.ap-southeast-2.amazonaws.com/index.html?prefix=persistent/repositories/sar-pipeline/examples/gamma0/ga_s1_iw_hh_c1/t070_149815_iw3/2022/1/1/
• RTC_S1_STATIC
  • e.g. s3_bucket/s3_project_folder/odc_product_name/burst_id/*files
  • odc_product_name = ga_s1_iw_static_cX, where X is the collection_number
  • example -> https://deant-data-public-dev.s3.ap-southeast-2.amazonaws.com/index.html?prefix=persistent/repositories/sar-pipeline/examples/gamma0/ga_s1_iw_static_c1/t070_149815_iw3/
• A collection is no longer specified, a collection_number is given

[geoscience-aman]

LGTM, nice one.

[caitlinadams]

Looks good to me apart from the suggestion that we further update the odc product name.

[caitlinadams]

We discussed adding "nrb" to the product name, which will allow us to potentially index other ARD products in future. So perhaps the names below need to change to ga_s1_nrb_iw_vv_vh_c0 etc?