Skip to content

[ALS-10968] Make Jenkins Configurable for AIM-AHEAD and BDC#164

Open
Gcolon021 wants to merge 19 commits intomainfrom
ALS-10968
Open

[ALS-10968] Make Jenkins Configurable for AIM-AHEAD and BDC#164
Gcolon021 wants to merge 19 commits intomainfrom
ALS-10968

Conversation

@Gcolon021
Copy link
Contributor

No description provided.

…mplates

Introduced a new `.gitlab-ci.yml` file to enable security scanning (SAST, DAST, Secrets Detection) and dependency scanning stages in the pipeline. Config includes development and production environments, along with relevant job stages and scripts.
…Git credentials

Added support for Jenkins Configuration as Code (CasC) using a YAML file. Introduced a `GIT_CREDENTIALS_ID` argument to dynamically render SCM credentials at build time. Updated environment variables and file copying logic to reflect the changes.
… variables

Updated multiple Jenkins job configurations and Terraform scripts to use the `${git_credentials_id}` variable for SCM credentials. Enhanced the RHEL9 user script with error handling and support for acquiring GitLab credentials from AWS Secrets Manager. Simplified and standardized setup across jobs to improve maintainability.
…enkins job configurations

Updated multiple Jenkins job configurations to use `${curated_datasets_s3_role}` and `${git_credentials_id}` for dynamic S3 role assumption and SCM credentials. Improved scripts for conditional role handling and updated plugin versions for Git and cleanup steps.
…d optimized Docker builds

Replaced `${git_base_url}` with `${dictionary_git_repo}` in `GIT_REPO_URL` parameters for better dynamic configuration. Added Maven build stage for Dictionary Build job. Enhanced Docker build steps with better caching. Add `--load` flag because we are now enabling the docker buildkit.
The WildFly repository has been merged into the PIC-SURE API repository. I have consolidated and streamlined the build by moving all build logic to the PIC-SURE API Build job. The WildFly build job has been removed. All other WildFly jobs have been altered to remove the WildFly build steps and directly deploy the PIC-SURE API.
…zed Docker build logic

Upgraded various Jenkins plugins (Git, workflow, cleanup) to latest versions. Standardized Docker build steps across jobs with `--load` flag and volume mounts for improved build performance. Updated Dictionary Build and Auth Micro App Build jobs for dynamic repository variables and build optimization. Switched JDK configuration to `(System)` in HPDS Build job.
…ing jobs to integrate new stages

Added `Upload HPDS Templates`, `Render HPDS Config Templates`, and `Download HPDS Templates` jobs to streamline template management for HPDS configurations. Updated deployment pipelines with new stages to render and manage HPDS environment-specific templates.
This is needed for the jenkins.yaml file.
…rror handling

Replaced `#!/bin/bash` with `#!/usr/bin/env bash` across job scripts for compatibility. Enabled `set -euo pipefail` for stricter error checking and safer script execution. Enhanced key functions for sourcing shared Bash scripts, validating inputs, and handling errors.
@Gcolon021 Gcolon021 self-assigned this Mar 13, 2026
The `sudo systemctl daemon-reexec` command was removed from multiple deployment scripts as it was redundant. Error messages and parameter handling were also refined for better clarity, including the use of String.valueOf() in Jenkins job configurations for consistent parameter processing.
Eliminated redundant `STACK_S3_BUCKET` parameter from the HPDS Auth and Open Deploy jobs in Jenkins configuration to streamline parameter handling.
…atching

Refined the `wait_for_spring_boot_ssm_logs` function in Jenkins configuration to look for a regex pattern (`Started .* in`) instead of a fixed string. Simplified the log condition check by replacing `grep -Fq` with `grep -q`.
Included the `STACK_S3_BUCKET` parameter in both the HPDS Auth and Open Deploy jobs within Jenkins configuration for improved flexibility in deployment.
Enhanced `wait_for_spring_boot_ssm_logs` to support customizable log patterns via regex. Refined handling of `STACK_S3_BUCKET` and other parameters with `String.valueOf` for consistent processing in deploy jobs.
# wait_for_spring_boot_ssm_logs "i-xxxxxxxxxx" "spring_app_container" "Started .* in"
# Result:
# The function will wait until the log message indicating the application has started is found.
wait_for_spring_boot_ssm_logs() {
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

update name

Comment on lines +46 to +47
sh "echo $pwd"

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

remove the pwd

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant