platform/4040: feat: add additional_transfer_job_excluded_prefixes variable for transfer job customization (#30)

Author: filippolmt

CHANGELOG.md

@@ -6,6 +6,12 @@ The format is based on [Keep a Changelog](https://keepachangelog.com/en/1.0.0/),
 and this project adheres
 to [Semantic Versioning](https://semver.org/spec/v2.0.0.html).
 
+# [0.11.0] - 2025-12-10
+
+[Compare with previous version](https://github.com/sparkfabrik/terraform-google-gcp-application-bucket-creation-helper/compare/0.10.0...0.11.0)
+
+- Added `additional_transfer_job_excluded_prefixes` variable to allow excluding specific prefixes from the transfer job.
+
 # [0.10.0] - 2024-11-26
 
 [Compare with previous version](https://github.com/sparkfabrik/terraform-google-gcp-application-bucket-creation-helper/compare/0.9.0...0.10.0)
@@ -54,7 +60,7 @@ to [Semantic Versioning](https://semver.org/spec/v2.0.0.html).
 
 [Compare with previous version](https://github.com/sparkfabrik/terraform-google-gcp-application-bucket-creation-helper/compare/0.6.1...0.7.0)
 
-- **BREAKING CHANGES**: tags are now passed using a user-friendly name as 
+- **BREAKING CHANGES**: tags are now passed using a user-friendly name as
   `<TAG_KEY_SHORTNAME>/<TAG_VALUE_SHORTNAME>` instead of the tag value.
 - Support global tags to be applied to all buckets. If a bucket specify a list
   of tags, the global tags will be overridden and replaced by those specified for

README.md

@@ -85,6 +85,7 @@ want to import existing buckets with a known name.
 
 | Name | Description | Type | Default | Required |
 |------|-------------|------|---------|:--------:|
+| <a name="input_additional_transfer_job_excluded_prefixes"></a> [additional\_transfer\_job\_excluded\_prefixes](#input\_additional\_transfer\_job\_excluded\_prefixes) | A list of additional object file and folder prefixes that will be excluded from the transfer job. | `list(string)` | `[]` | no |
 | <a name="input_buckets_list"></a> [buckets\_list](#input\_buckets\_list) | The list of buckets to create. For each bucket you can specify the name, when deleting a bucket the force\_destroy option will delete the contents of the bucket (if you try to delete a bucket that contains objects, Terraform will fail that run), the location (default to project region), the storage class (default to STANDARD), if you want enable the object versioning (default to true), if you want to plan a disaster recovery with the creation of a mirroring bucket with a scheduled transfer job and if you want to append a random suffix to the bucket name (default true). The property set\_all\_users\_as\_viewer controls if the bucket will be readable by all users (default false). The property labels set labels to organize buckets. The property tag\_list set google tags to bind with the bucket for fine grained access control. Properties bucket\_obj\_vwr and bucket\_obj\_adm set a list of specific IAM members as objectViewers and objectAdmin | <pre>list(object({<br/>    name                             = string<br/>    force_destroy                    = optional(bool, false)<br/>    append_random_suffix             = optional(bool, true)<br/>    location                         = optional(string, null)<br/>    storage_class                    = optional(string, "STANDARD")<br/>    enable_versioning                = optional(bool, true)<br/>    enable_disaster_recovery         = optional(bool, true)<br/>    set_all_users_as_viewer          = optional(bool, false)<br/>    labels                           = optional(map(string), {})<br/>    tag_list                         = optional(list(string), [])<br/>    bucket_obj_adm                   = optional(list(string), [])<br/>    bucket_obj_vwr                   = optional(list(string), [])<br/>    soft_delete_retention_seconds    = optional(number, 0)<br/>    lifecycle_policy_retention       = optional(number, 30)<br/>    dr_soft_delete_retention_seconds = optional(number, 0)<br/>    dr_lifecycle_policy_retention    = optional(number, 60)<br/>  }))</pre> | n/a | yes |
 | <a name="input_disaster_recovery_bucket_location"></a> [disaster\_recovery\_bucket\_location](#input\_disaster\_recovery\_bucket\_location) | The location in which the disaster recovery bucket will be created. For a list of available regions, see https://cloud.google.com/storage/docs/locations. By default, the disaster recovery bucket will be created in the same location as the primary bucket. | `string` | `""` | no |
 | <a name="input_global_tags"></a> [global\_tags](#input\_global\_tags) | A list of tags to be applied to all the resources, in the form <TAG\_KEY\_SHORTNAME>/<TAG\_VALUE\_SHORTNAME>. If a resource specify a list of tags, the global tags will be overridden and replaced by those specified in the resource. | `list(string)` | `[]` | no |

main.tf

@@ -1,4 +1,4 @@
-# Data resources. 
+# Data resources.
 data "google_client_config" "current" {}
 
 locals {
@@ -294,7 +294,7 @@ resource "google_storage_transfer_job" "application_bucket_nightly_backup" {
 
   transfer_spec {
     object_conditions {
-      exclude_prefixes = var.transfer_job_excluded_prefixes
+      exclude_prefixes = concat(var.transfer_job_excluded_prefixes, var.additional_transfer_job_excluded_prefixes)
     }
 
     transfer_options {

variables.tf

@@ -27,6 +27,12 @@ variable "transfer_job_excluded_prefixes" {
   ]
 }
 
+variable "additional_transfer_job_excluded_prefixes" {
+  type        = list(string)
+  description = "A list of additional object file and folder prefixes that will be excluded from the transfer job."
+  default     = []
+}
+
 variable "global_tags" {
   description = "A list of tags to be applied to all the resources, in the form <TAG_KEY_SHORTNAME>/<TAG_VALUE_SHORTNAME>. If a resource specify a list of tags, the global tags will be overridden and replaced by those specified in the resource."
   type        = list(string)