Skip to content
Open
Show file tree
Hide file tree
Changes from 72 commits
Commits
Show all changes
74 commits
Select commit Hold shift + click to select a range
4dc92e3
replace update_zowe_yaml with update_zowe_yaml_configmgr
MarkAckert May 1, 2025
b0018e7
undo whitespace changes
MarkAckert May 1, 2025
521a062
remove whitespace changes
MarkAckert May 1, 2025
5388d47
delete and update functional, migrate-for-k8s not quite working yet
MarkAckert May 6, 2025
e364a40
migrate for kubernetes working
MarkAckert May 7, 2025
36f231d
migrate for kubernetes working, config-converter no longer used
MarkAckert May 8, 2025
680c74d
remove last traces of ncert, add new v3 keyring-util to pax
MarkAckert May 16, 2025
cf547f4
remove obvious curl references
MarkAckert May 16, 2025
f7b1515
remote integration removes install-packaging-tools, adds curl, keyrin…
MarkAckert May 16, 2025
e946e7a
adds a new internal command - utils cleanup-ipcmq. internal start pre…
MarkAckert Apr 29, 2025
0f185a9
use launcher from pr
MarkAckert Apr 29, 2025
1a1026a
fix cleanup-ipcmq script. avoid date formatting errors in later columns
MarkAckert Apr 30, 2025
437ef9d
remove HEAPPOOLS64(OFF)
MarkAckert Apr 30, 2025
290dbde
add real command back to cleanup script
MarkAckert May 1, 2025
ce86746
remove all occurrences of cleanup-ipc-mq
MarkAckert May 1, 2025
d1f473a
revert launcher version in manifest
MarkAckert May 1, 2025
90d20c1
Allow different member names for PARMLIB entries of config (#4285)
1000TurquoisePogs May 5, 2025
5847fa8
Updated the schema to support new configuration parameter to trim sys…
Gautham-coder May 8, 2025
60ed235
switch to read_yaml_configmgr for cert CAs and domains extraction (#4…
skurnevich May 8, 2025
3687658
Update base_diff.txt
Martin-Zeithaml May 14, 2025
4ca92a1
Remove old import name
Martin-Zeithaml May 14, 2025
c037494
FIXME note
Martin-Zeithaml May 16, 2025
bb7915b
Comment update
Martin-Zeithaml May 16, 2025
5858c46
Changelog
Martin-Zeithaml May 19, 2025
ccc1964
Add CHANGELOG workflow automation (#4334)
MarkAckert May 20, 2025
22ffc1e
basic migrate for kubernetes test case
MarkAckert May 20, 2025
d6be11d
mask mutable data in migrate test case
MarkAckert May 20, 2025
2df9f1e
remove unused message
MarkAckert May 20, 2025
8b04ee6
remove yauzl from test framework
MarkAckert May 20, 2025
08ddfbb
update snapshot with quotes
MarkAckert May 21, 2025
b144b22
Changelog Workflow update (#4351)
Martin-Zeithaml May 27, 2025
b7f1fcc
Add certificate analyser to the build (#4354)
1000TurquoisePogs May 28, 2025
1ec034e
remove or modify require_node calls
MarkAckert May 28, 2025
5081370
add new download to expected-count
MarkAckert May 28, 2025
f038f5f
fix require_node's, make update/read/delete yaml container friendly
MarkAckert May 28, 2025
96989d3
add yq to container base images, leave curl in ubuntu images
MarkAckert May 30, 2025
9798a94
update curl extraction
MarkAckert May 30, 2025
9ca8953
update pax packaging scripts
MarkAckert May 30, 2025
3a1bc84
catch .pax.Z files
MarkAckert May 30, 2025
0bdb6e8
correct curl pax name
MarkAckert May 30, 2025
b3f6936
fix curl name
MarkAckert May 30, 2025
2306799
Merge branch 'v3.x/staging' into user/markackert/node-removal-tasks
MarkAckert Jun 16, 2025
fd08ccd
update manifest to mainline versions for keyring and configmgr
MarkAckert Jun 17, 2025
8dcdeaf
Merge branch 'v3.x/staging' into user/markackert/node-removal-tasks
MarkAckert Jun 17, 2025
6920cd7
fix compilation errors in configmgr.ts due to merge
MarkAckert Jun 17, 2025
27a2472
update playbook call to shell script, test suite download of vtl move…
MarkAckert Jun 18, 2025
0b60c31
only setup clean function once
MarkAckert Jun 19, 2025
55b9709
Merge branch 'v3.x/staging' into user/markackert/node-removal-tasks
MarkAckert Jun 19, 2025
dfcb2c1
Merge branch 'v3.x/staging' into user/markackert/node-removal-tasks
MarkAckert Jun 20, 2025
0d81215
update playbooks to set runtimeDirectory first in zowe.yaml
MarkAckert Jun 20, 2025
eaa4d1e
fix migrate for kubernetes snapshot
MarkAckert Jun 20, 2025
349d1e1
Merge branch 'v3.x/staging' into user/markackert/node-removal-tasks
MarkAckert Jul 8, 2025
34e263f
Merge branch 'v3.x/staging' into user/markackert/node-removal-tasks
MarkAckert Jul 9, 2025
b245f97
updating YAML now optionally validate updates: this is required to fi…
MarkAckert Jul 9, 2025
f730800
Merge branch 'v3.x/staging' into user/markackert/node-removal-tasks
MarkAckert Jul 11, 2025
7759f0f
fix globalSetup launcher PAX name, remove old ncert reference
MarkAckert Jul 11, 2025
e6fd97e
Merge branch 'v3.x/staging' into user/markackert/node-removal-tasks
MarkAckert Oct 2, 2025
7eb411a
add 1 to expected count (curl)
MarkAckert Oct 2, 2025
2b535ae
Merge branch 'v3.x/staging' into user/markackert/node-removal-tasks
MarkAckert Oct 27, 2025
b1d9514
update `read_yaml_configmgr` references to `read_yaml`
MarkAckert Oct 28, 2025
82b888d
update snapshots, longer timeout for install permutations
MarkAckert Oct 28, 2025
ae1ba83
minor updates to LONG tests
MarkAckert Oct 28, 2025
11c1553
refactor some cleanup in the LONG cert tests
MarkAckert Oct 28, 2025
f59ed3d
remove node by default in test cases
MarkAckert Oct 28, 2025
7aecad3
more modifications supporting update without schema validation
MarkAckert Oct 28, 2025
b7568d1
don't schema check in playbook automation
MarkAckert Oct 29, 2025
a4dc92d
update snapshots, allow internal start prepare to pass when NODE_HOME…
MarkAckert Oct 29, 2025
c411fcf
fix whitespace
MarkAckert Oct 29, 2025
df737e7
adjust to `zis-test` in test cases.
MarkAckert Oct 30, 2025
d6b1b2c
sort env file before snapshot
MarkAckert Oct 30, 2025
6e1082c
lazily load ZWE_CLI_PARAMETER_CONFIG in `config.ts`
MarkAckert Oct 30, 2025
e074641
add zwe_cli_parameter to playbook
MarkAckert Oct 30, 2025
08ad28c
fix updateConfig condition check
MarkAckert Oct 31, 2025
aba234f
Internal start prepare - get zOSMF host & port from config (#4324)
Martin-Zeithaml Oct 31, 2025
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion .github/workflows/build-packaging.yml
Original file line number Diff line number Diff line change
Expand Up @@ -276,7 +276,7 @@ jobs:
with:
manifest-file-path: ${{ github.workspace }}/manifest.json
default-target-path: .pax/binaryDependencies/
expected-count: 32
expected-count: 33

# this step is not doing a publish, we are just utilizing this actions to get the PUBLISH_TARGET_PATH,
# and it will be used in the next step: [Download 3] Download SMPE build log
Expand Down
22 changes: 16 additions & 6 deletions .pax/pre-packaging.sh
Original file line number Diff line number Diff line change
Expand Up @@ -228,6 +228,22 @@ chmod +x "${ZOWE_ROOT_DIR}"/bin/zwe
chmod +x "${ZOWE_ROOT_DIR}"/bin/utils/*.sh
chmod +x "${ZOWE_ROOT_DIR}"/bin/utils/*.rex

echo "[$SCRIPT_NAME] extract curl ..."
curl_pax=$(find "${ZOWE_ROOT_DIR}/files" -type f \( -name "curl-*.pax.Z" \) | head -n 1)
cd "${ZOWE_ROOT_DIR}/bin/utils"
pax -ppx -rf "${curl_pax}"
mv "${ZOWE_ROOT_DIR}"/bin/utils/curl-*/bin/curl ./curl
rm -rf "${ZOWE_ROOT_DIR}"/bin/utils/curl-*

echo "[$SCRIPT_NAME] change curl to be executable ..."
chmod +x "${ZOWE_ROOT_DIR}"/bin/utils/curl

echo "[$SCRIPT_NAME] extract keyring-util ..."
keyring_util=$(find "${ZOWE_ROOT_DIR}/files" -type f \( -name "keyring-util*.pax" \) | head -n 1)
mkdir -p "${ZOWE_ROOT_DIR}/bin/utils/keyring-util"
cd "${ZOWE_ROOT_DIR}/bin/utils/keyring-util"
pax -ppx -rf "${keyring_util}"
rm "${keyring_util}"
echo "[$SCRIPT_NAME] extract zowex ..."
zowex_components=$(find "${ZOWE_ROOT_DIR}/files" -type f \( -name "zowe-server-*.pax.Z" \) | head -n 1)
mkdir -p "${ZOWE_ROOT_DIR}/bin/utils/zowe-server"
Expand All @@ -245,12 +261,6 @@ rm -rf "${zowex_components}"
echo "[$SCRIPT_NAME] change keyring-util to be executable ..."
chmod +x "${ZOWE_ROOT_DIR}"/bin/utils/keyring-util/keyring-util

echo "[$SCRIPT_NAME] extract zowe-ncert ..."
cd "${ZOWE_ROOT_DIR}/bin/utils"
mkdir -p ncert
cd ncert
pax -ppx -rf ../zowe-ncert-*.pax
rm -f ../zowe-ncert-*.pax
cd "${BASE_DIR}"

# prepare for SMPE
Expand Down
82 changes: 30 additions & 52 deletions .pax/prepare-workspace.sh
Original file line number Diff line number Diff line change
Expand Up @@ -38,34 +38,33 @@
# $wf_from: input location (raw workfiles)
# $wf_to: target location (customized workfiles)
# ---------------------------------------------------------------------
_customizeWorkflow () {
_customizeWorkflow() {
echo "[${SCRIPT_NAME}] creating workflows in $wf_to ..."
mkdir -p "$wf_to"

wf_files=$(ls "$wf_from") # processes all files (.xml, .vtl & .properties)
for wf_file in $wf_files
do
wf_files=$(ls "$wf_from") # processes all files (.xml, .vtl & .properties)
for wf_file in $wf_files; do
# skip if directory
test -d "$wf_from/$wf_file" && continue
# fill in Zowe version in the workflow file
sed -e "s/###ZOWE_VERSION###/${ZOWE_VERSION}/g" \
-e "s/encoding=\"utf-8\"/encoding=\"ibm-1047\"/g" \
"$wf_from/$wf_file" \
> "$wf_to/$wf_file"
-e "s/encoding=\"utf-8\"/encoding=\"ibm-1047\"/g" \
"$wf_from/$wf_file" \
>"$wf_to/$wf_file"
# remove raw workflow file if requested
test -n "$1" && rm "$wf_from/$wf_file"
done

return 0
} # _customizeWorkflow
} # _customizeWorkflow

# ---------------------------------------------------------------------
# --- do sed substitutions to template workflow files
# $wf_from: input location (raw workfiles)
# $wf_to: target location (customized workfiles)
# ---------------------------------------------------------------------
_templateWorkflow () {
wf_temp="${PAX_WORKSPACE_DIR}/ascii/wf_temp" # temp dir for sed
_templateWorkflow() {
wf_temp="${PAX_WORKSPACE_DIR}/ascii/wf_temp" # temp dir for sed
mkdir -p "$wf_temp"
mkdir -p "$wf_to"

Expand All @@ -81,15 +80,21 @@ _templateWorkflow () {
rm -rf $wf_temp

return 0
} # _templateWorkflow
} # _templateWorkflow

# ---------------------------------------------------------------------
# --- main --- main --- main --- main --- main --- main --- main ---
# ---------------------------------------------------------------------
SCRIPT_NAME=$(basename "$0") # $0=./.pax/prepare-workspace.sh
PAX_WORKSPACE_DIR=$(cd "$(dirname "$0")";pwd) # <something>/.pax
SCRIPT_NAME=$(basename "$0") # $0=./.pax/prepare-workspace.sh
PAX_WORKSPACE_DIR=$(
cd "$(dirname "$0")"
pwd
) # <something>/.pax
PAX_BINARY_DEPENDENCIES="${PAX_WORKSPACE_DIR}/binaryDependencies"
ROOT_DIR=$(cd "${PAX_WORKSPACE_DIR}/../";pwd)
ROOT_DIR=$(
cd "${PAX_WORKSPACE_DIR}/../"
pwd
)

echo "[${SCRIPT_NAME}] extracting ZOWE_VERSION ..."
ZOWE_VERSION=$(cat ${ROOT_DIR}/manifest.json | grep version | head -1 | awk -F: '{ print $2 }' | sed 's/[",]//g' | tr -d '[[:space:]]')
Expand Down Expand Up @@ -126,14 +131,13 @@ find "${ROOT_DIR}/bin" -type f -name '*.ts' -delete
# copy from current github source
echo "[${SCRIPT_NAME}] copying files ..."
cd "${ROOT_DIR}"
cp manifest.json "${CONTENT_DIR}"
cp example-zowe.yaml "${CONTENT_DIR}"
cp ZOWE.md "${CONTENT_DIR}/README.md"
cp DEVELOPERS.md "${CONTENT_DIR}/DEVELOPERS.md"
cp -R bin/* "${CONTENT_DIR}/bin"
cp -R files/* "${CONTENT_DIR}/files"
cp -R schemas/* "${CONTENT_DIR}/schemas"

cp manifest.json "${CONTENT_DIR}"
cp example-zowe.yaml "${CONTENT_DIR}"
cp ZOWE.md "${CONTENT_DIR}/README.md"
cp DEVELOPERS.md "${CONTENT_DIR}/DEVELOPERS.md"
cp -R bin/* "${CONTENT_DIR}/bin"
cp -R files/* "${CONTENT_DIR}/files"
cp -R schemas/* "${CONTENT_DIR}/schemas"

# build dir should not end up in release, will be removed after build in pre-packaging phase
#cp -R build "${CONTENT_DIR}/"
Expand All @@ -143,28 +147,6 @@ mkdir -p "${CONTENT_DIR}/licenses"
echo "[${SCRIPT_NAME}] copy license file ..."
mv "${PAX_BINARY_DEPENDENCIES}/zowe_licenses_full.zip" "${CONTENT_DIR}/licenses"

# extract packaging utility tools to bin/utils
echo "[${SCRIPT_NAME}] prepare utility tools ..."
cd "${ROOT_DIR}" && cd "${CONTENT_DIR}/bin/utils"
echo "[${SCRIPT_NAME}] extract zowe-utility-tools.zip ..."
jar -xf "${PAX_BINARY_DEPENDENCIES}"/zowe-utility-tools*.zip
# we should get 2 tgz files as npm packages
echo "[${SCRIPT_NAME}] extract zowe-fconv ..."
tar zxf zowe-fconv-*.tgz
mv package fconv
rm zowe-fconv-*.tgz
echo "[${SCRIPT_NAME}] extract zowe-njq ..."
tar zxf zowe-njq-*.tgz
mv package njq
rm zowe-njq-*.tgz
echo "[${SCRIPT_NAME}] extract zowe-config-converter ..."
tar zxf zowe-config-converter-*.tgz
mv package config-converter
rm zowe-config-converter-*.tgz
# zowe-ncert.pax will be extracted on z/OS side
cd "${ROOT_DIR}"
rm -f "${PAX_BINARY_DEPENDENCIES}"/zowe-utility-tools*.zip

# put text files into ascii folder (recursive & verbose)
echo "[${SCRIPT_NAME}] move ASCII files out of CONTENT directory for encoding conversion ..."
rsync -rv \
Expand All @@ -174,23 +156,19 @@ rsync -rv \
--exclude '*.tar.gz' \
--exclude '*.pax.Z' \
--exclude '*.pax' \
--exclude '*.pax.Z' \
--exclude '*.jar' \
--exclude '*.class' \
--prune-empty-dirs --remove-source-files \
"${CONTENT_DIR}/" \
"${ASCII_DIR}"

echo "[${SCRIPT_NAME}] copy keyring_utils"
cd "${ROOT_DIR}" && cd "${CONTENT_DIR}/bin/utils"
mkdir -p keyring-util
mv "${PAX_BINARY_DEPENDENCIES}"/keyring-util-* keyring-util/keyring-util

# move binary dependencies and prepare to extract on z/OS
echo "[${SCRIPT_NAME}] move binary dependencies ..."
mkdir -p "${CONTENT_DIR}/files/zlux"
cd "${PAX_BINARY_DEPENDENCIES}"
for zlux_dep in zlux-editor tn3270-ng2 vt-ng2 sample-react-app sample-iframe-app sample-angular-app explorer-ip ; do
mv ${zlux_dep}-*.pax "${CONTENT_DIR}/files/zlux/${zlux_dep}.pax"
for zlux_dep in zlux-editor tn3270-ng2 vt-ng2 sample-react-app sample-iframe-app sample-angular-app explorer-ip; do
mv ${zlux_dep}-*.pax "${CONTENT_DIR}/files/zlux/${zlux_dep}.pax"
done
mv *.pax.Z "${CONTENT_DIR}/files/"
mv *.pax "${CONTENT_DIR}/files/"
Expand All @@ -214,7 +192,7 @@ _customizeWorkflow
wf_from="workflows/templates"
wf_to="${PAX_WORKSPACE_DIR}/ascii/templates"
_templateWorkflow
cp workflows/*.rex "$wf_to" # add tooling
cp workflows/*.rex "$wf_to" # add tooling

echo "[${SCRIPT_NAME}] copy smpe scripts ..."
# copy smpe scripts -- build usage only
Expand Down
1 change: 1 addition & 0 deletions CHANGELOG.md
Original file line number Diff line number Diff line change
Expand Up @@ -9,6 +9,7 @@ All notable changes to the Zowe Installer will be documented in this file.
- Enhancement: `ZWEGEN00` supports long path by continuation character, which can be used in JCL `ZWEGENER` [#4459](https://github.com/zowe/zowe-install-packaging/pull/4459)
- Bugfix: Zowe startup now removes outdated static definition files from workspace/api-mediation/api-defs, which previously caused wrong or duplicate registrations of servers to APIML. [#4526](https://github.com/zowe/zowe-install-packaging/pull/4526)
- Bugfix: `--update-config` might fail if the specified config file is a symbolic link. [#4492](https://github.com/zowe/zowe-install-packaging/pull/4492)
- Enhancement: Node.JS is no longer required to run `zwe migrate for kubernetes`, or any other `zwe` command. [#4393](https://github.com/zowe/zowe-install-packaging/pull/4393)

## `3.3.1`

Expand Down
1 change: 0 additions & 1 deletion bin/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -55,7 +55,6 @@ Please be aware of using functions marked as `@experimental`. These functions ma
`bin/utils` directory holds several utility tools used by Zowe, and you can take advantage of them too.

- `bin/utils/opercmd.rex`: To issue operator command on z/OS. This script can only run on z/OS and requires SDSF.
- `bin/utils/curl.js`: This node.js script works similar to popular Linux tool `curl`. It can make HTTP/HTTPS request and display response.
- `bin/utils/getesm`: Executable to get the name of External Security Manager.
- `bin/utils/certificate-analyser.jar`: Java based tool to verify the certificates. See [README](https://github.com/zowe/api-layer/blob/v3.x.x/certificate-analyser/README.md) for more information.
- `@experimental`: `bin/utils/zowex`: Zowe Native Protocol CLI for various tasks (console, jobs, datasets, ...), use `zowex --help` for more information.
Expand Down
1 change: 0 additions & 1 deletion bin/commands/.errors
Original file line number Diff line number Diff line change
Expand Up @@ -51,5 +51,4 @@ ZWEL0300W||%s already exists. This %s will be overwritten.
ZWEL0301W||%s already exists and will not be overwritten. For upgrades, you must use --allow-overwrite.
ZWEL0316E|316|Invalid PARMLIB format %s.
ZWEL0322E|322|%s is not a valid directory.
ZWEL0323E||NodeJS required but not found. Errors such as ZWEL0157E may occur as a result. The value 'node.home' in the Zowe YAML is not correct.
ZWEL0326E|326|An error occurred while processing Zowe YAML config %s:
4 changes: 2 additions & 2 deletions bin/commands/init/apfauth/index.sh
Original file line number Diff line number Diff line change
Expand Up @@ -41,7 +41,7 @@ if [ -n "${ZWE_CLI_PARAMETER_DRY_RUN}" ] || [ -n "${ZWE_CLI_PARAMETER_SECURITY_D
fi

# read prefix and validate
prefix=$(read_yaml_configmgr "${ZWE_CLI_PARAMETER_CONFIG}" ".zowe.setup.dataset.prefix")
prefix=$(read_yaml "${ZWE_CLI_PARAMETER_CONFIG}" ".zowe.setup.dataset.prefix")
if [ -z "${prefix}" ]; then
print_error_and_exit "Error ZWEL0157E: Zowe dataset prefix (zowe.setup.dataset.prefix) is not defined in Zowe YAML configuration file." "" 157
fi
Expand All @@ -51,7 +51,7 @@ fi
job_has_failures=
for key in ${auth_libs}; do
# read def and validate
ds=$(read_yaml_configmgr "${ZWE_CLI_PARAMETER_CONFIG}" ".zowe.setup.dataset.${key}")
ds=$(read_yaml "${ZWE_CLI_PARAMETER_CONFIG}" ".zowe.setup.dataset.${key}")
if [ -z "${ds}" ]; then
# authLoadlib can be empty
if [ "${key}" = "authLoadlib" ]; then
Expand Down
Loading
Loading