Skip to content

Releases: NASA-PDS/validate

validate v4.2.0

15 Jun 22:35

Choose a tag to compare

validate 4.2.0 Release Notes

Released: 2026-06-15

Highlights

  • Validation of large bundles (23,000+ products) no longer runs out of memory (#1594)
  • Significant performance improvements: schematron template caching, label identifier caching, and faster table I/O reduce validation time for large datasets (#1572, #1607, NASA-PDS/pds4-jparser#199)
  • Missing bundle/collection members now correctly reported as errors (previously warnings) (#1608)
  • Security: CVE-2025-46392 remediated via Apache Commons Configuration 2.x upgrade (#1591)
  • Reserved filename misuse (PDS4 SR 6C.1.3) now detected and reported for label files (#1579)
  • pds4-jparser v3.2.1 integrated: fixes table read performance and BigInteger type mismatch in image exporters (NASA-PDS/pds4-jparser#199, NASA-PDS/pds4-jparser#194)

New

  • Adds MSSS ODR and Nikon NEF encoding types for Product_Native labels (#1544)
  • Adds validation of reserved filename patterns per PDS4 SR 6C.1.3 (collection_*, bundle_* restricted to label files) (#1579)

Improvements

  • Performance: Schematron Templates objects now cached per schema URI, eliminating redundant XSLT compilation across repeated validations (#1572)
  • Performance: Label identifier data cached to eliminate redundant XML re-parsing during the referential integrity phase (#1607)
  • Performance (pds4-jparser): RawTableReader.readNextLine() now uses buffered bulk reads instead of byte-at-a-time reads, dramatically reducing I/O overhead for large tables (NASA-PDS/pds4-jparser#199)
  • Performance: Inline regex patterns in FieldValueValidator pre-compiled as static constants (#1600)
  • warning.integrity.member_not_found promoted to an error by default; use --skip-strict-collection-membership to downgrade back to warning if needed (e.g. for accumulating bundles) (#1608, closes #1601)
  • Referential integrity checks for Internal_Reference now applied consistently in all label locations, not just top-level references (#1547, closes #1481)

Fixes

  • Critical: OutOfMemoryError no longer occurs when validating large bundles with 23,000+ products (#1594, closes #1571)
  • Products that pass all validation checks are now correctly counted, preventing false no_products_found errors (#1558, closes #1557)
  • Non-existent target paths now correctly reported as errors instead of silently passing (#1556, closes #1548)
  • Misleading "XML could not be parsed." message no longer shown for directory targets (#1533, closes #1510)
  • NaN no longer incorrectly rejected as an invalid value for ASCII_String table fields (#1532, closes #956)
  • error.directory.unallowed_name now raised correctly on Windows for absolute directory_path_name values (#1540, closes #1539)
  • Report pass/fail counts for general and execution categories now accurate (#1538, closes #1458)
  • (pds4-jparser) BigInteger/int type mismatch in image exporters fixed after Information Model 1M00 upgrade (NASA-PDS/pds4-jparser#194)

Security

Compatibility

  • Requires: Java 17+
  • Integrated: pds4-jparser v3.2.1 (upgraded from v3.1.0)

Links

validate v4.1.0

22 Apr 20:16

Choose a tag to compare

Release Notes - NASA PDS Validate v4.1.0

Release Date: 2026-04-22


Highlights

  • Caches Schematron templates per stylesheet, eliminating per-label XSLT recompilation for bundle and collection runs (#1565)
  • Adds two new MSSS encoding types and one Encoded_Native type for Product_Native (#1541, #1542)
  • Fixes false positives — warning.file.reserved_name_mismatch no longer fires for CSV collection inventory files (#1580)
  • Includes LID of mismatched context object and known-correct values in context mismatch reports (#1509)
  • Fixes 150 GB+ file validation — no longer buffers large data files to local temp space (#1241)
  • Enforces HTTPS for all outbound connections via pds4-jparser 3.1.0, closing a long-standing security gap (pds4-jparser #191)

New

  • Data providers: Adds Encoded_Native encoding type for Product_Native products (#1542)
  • Data providers: Adds MSSS Original Data Record Mini Header and MSSS Original Data Record Payload Data encoding types (#1541)
  • Data providers / operators: Context name mismatch reports now include the offending LID and list of correct known values (#1509)
  • Data providers (via pds4-jparser 3.1.0): PDS4 Information Model upgraded to 1Q00; adds support for Product_Resource and other new product types (pds4-jparser #195, pds4-jparser #192, #1550)

Improvements

  • Performance: Caches compiled Schematron templates per stylesheet; eliminates repeated XSLT compilation across labels in bundle/collection runs (#1565)
  • Context products: Automated weekly sync keeps registered context products current in the distributed JSON file (#1453)
  • Offline reliability (via pds4-jparser 3.1.0): Label parsing falls back to a local cached schema instead of fetching remote URLs, improving robustness in network-restricted environments (pds4-jparser #189)

Fixes

  • Reserved filename false positives: warning.file.reserved_name_mismatch no longer fires for non-label files such as collection_*.csv (#1580)
  • Reserved filename enforcement: Raises an error when PDS4 reserved filename patterns (collection_*, bundle_*) are misused on non-collection/non-bundle label files (#1459)
  • Product counting: Counts cleanly passing products correctly; no longer incorrectly triggers no_products_found (#1557)
  • Passing product count: Summary product totals now match actual counts (#1458)
  • Missing target reporting: Reports an error and fails when an explicitly specified target file does not exist (#1548)
  • Product_Resource / IM 1Q00: Supports Product_Resource and current IM product types via updated JAXB context (#1550, pds4-jparser #195)
  • Large-file validation: No longer copies 150 GB+ data files to local temp space, eliminating out-of-disk-space errors (#1241)
  • Referential integrity coverage: Includes Internal_Reference areas not previously checked in referential integrity validation (#1481)
  • NaN false positives: No longer reports unexpected NaN errors for ASCII_String fields (#956)
  • Misleading directory warning: No longer reports "XML could not be parsed" for directories that have a warning (#1510)
  • Windows path handling: Raises error.directory.unallowed_name on Windows for absolute directory_path_name values (#1539)
  • Build reliability: Cucumber scenario failures now correctly propagate to Maven and cause BUILD FAILURE (#1581)
  • Image array data (via pds4-jparser 3.1.0): Fixes BigInteger/int type mismatch in image exporters following the IM upgrade (pds4-jparser #194)

Security

  • HTTPS enforcement (via pds4-jparser 3.1.0): All outbound connections now enforce HTTPS, addressing CWE-311 (cleartext transmission of sensitive information) (pds4-jparser #191, pds4-jparser #190)

Compatibility

Requirements:

  • Java 17 or later (unchanged from v4.0.8)
  • Compatible with PDS4 Information Model versions 1.x through 1Q00
  • Supports PDS3 volume validation
Component Version Notes
Java Runtime 17+ Required (unchanged)
Maven 3.6+ For building from source

Upgrade notes (from v4.0.8):

  • Reserved filename false positives resolved: warning.file.reserved_name_mismatch warnings on CSV collection inventory files will no longer appear.
  • Referential integrity is stricter: Additional Internal_Reference areas are now validated; bundles or collections with previously unchecked broken references may report new errors.
  • Missing targets now fail: Validation workflows that pass a non-existent target path now report an error instead of silently passing.
  • member_not_found severity (upcoming): The next release upgrades warning.integrity.member_not_found from warning to error by default. See #1601 to prepare early.

Known Issues

No critical known issues at this time. Report any issues at GitHub Issues.


Links

validate v4.0.8

06 Nov 22:41

Choose a tag to compare

⚠️ Breaking Changes

Java 17 or later now required — Validate v4.0.8 requires Java 17 or later. Applications and environments running Java 11 or earlier will no longer work.

Who is affected: All users running validate, including CI/CD pipelines and automated validation workflows.

What breaks: Any environment with Java versions below 17 will fail to run validate v4.0.8.

How to migrate:

  1. Install Java 17 or later from Adoptium or your preferred JDK distribution
  2. Update your JAVA_HOME environment variable to point to Java 17+
  3. Rebuild any custom integrations that depend on validate
  4. Update CI/CD pipeline configurations to use Java 17+ base images
  5. Test your validation workflows with the new Java version

(#1386)


Highlights

  • Java 17+ requirement — Modernizes runtime to support latest security updates and dependency upgrades (#1386)
  • Faster validation — Google Caching significantly improves performance for repeated validations (#1327)
  • Enhanced reporting — All reports now include LIDVID tracking and user-provided CLI arguments for better traceability (#1404, #1288)
  • Improved table validation — Delimited tables with whitespace-only numeric fields now validate correctly per PDS4 CCB standards (#1392)
  • Product_Ancillary support — Content validation now works for Product_Ancillary products (#1278)

New

  • Data providers: LIDVID tracking added to all report formats for better product traceability (#1404)
  • Data providers: Delimited tables with whitespace-only numeric fields now supported per PDS4-CCB#28 (#1392)
  • Data providers: Offset support added for Packed_Data_Fields validation (#1345)
  • Data providers: Content validation now available for Product_Ancillary products (#1278)
  • Data providers: Special constants handling now supports UnsignedMSB4 data type (#1301)

Improvements

  • Performance: Validation speed significantly improved through Google Caching implementation (#1327)
  • Bundle validation: validate-bundle now handles filenames case-insensitively for better cross-platform compatibility (#1338)
  • Reporting: All user-provided CLI arguments now appear in validation reports for reproducibility (#1288)
  • Bundle scripts: validate-bundle script better handles missing --report-dir flag with clearer error messages (#1279)
  • Documentation: Updated for improved usability and markdown formatting (#1420)

Fixes

  • WAV validation: Fixed handling of WAV audio file validation (#1390)
  • LID validation: Corrected regex pattern for ASCII_LID* type validation (#1360)
  • Integer comparison: Integers now correctly compared as floats unless hexadecimal notation (0x) is present (#1362)
  • Product_External: encoding_type checks now properly skipped for Product_External products (#1361)
  • Label detection: More comprehensive detection of malformed labels (#1287)
  • Inventory validation: Fixed inventory underflow detection when using pds4.label rule (#1266)

Compatibility

Requirements:

  • Java 17 or later (breaking change from previous Java 11 requirement)
  • Compatible with PDS4 Information Model versions 1.x
  • Supports PDS3 volume validation
Component Version Requirements
Java Runtime 17+ Required upgrade from Java 11
Maven 3.6+ For building from source

Upgrade Notes

Required Actions

  1. Install Java 17 or later

    # Verify your Java version
    java -version
    
    # Should output "openjdk version 17.x" or higher
  2. Update environment variables

    # Update JAVA_HOME to point to Java 17+
    export JAVA_HOME=/path/to/java17
    export PATH=$JAVA_HOME/bin:$PATH
  3. Update CI/CD pipelines

    • Update Docker base images to use Java 17+
    • Update GitHub Actions workflows to use actions/setup-java@v5 with Java 17
    • Update Jenkins/GitLab CI Java version configurations
  4. Test validation workflows

    • Run validate on representative test datasets
    • Verify all custom scripts and integrations work with Java 17
    • Check that all reports generate correctly

Optional Actions

  • Review new LIDVID tracking in reports for integration opportunities
  • Leverage performance improvements by validating larger datasets
  • Update bundle validation scripts to take advantage of case-insensitive handling

Known Issues

No critical known issues at this time. Please report any issues at https://github.com/NASA-PDS/validate/issues


Links


All Changes

Enhancements

  • Add LIDVID to all reports (#1404)
  • Allow delimited tables with whitespace-only numeric fields (#1392)
  • Add offset support in Packed_Data_Fields (#1345)
  • Add content validation for Product_Ancillary (#1278)
  • Update Special Constants handling for UnsignedMSB4 (#1301)

Bug Fixes

  • Fix WAV validation handling (#1390)
  • Fix regex for ASCII_LID types (#1360)
  • Fix integer comparison to use float comparison (#1362)
  • Ignore encoding_type checks for Product_External (#1361)
  • Improve bad label detection (#1287)
  • Fix inventory underflow detection (#1266)

Infrastructure & Dependencies

  • Upgrade to Java 17 (#1386)
  • Improve performance through Google Caching (#1327)
  • Update validate-bundle case sensitivity (#1338)
  • Show CLI arguments in reports (#1288)
  • Improve validate-bundle flag handling (#1279)
  • Update OSSRH workflows (#1280)
  • Update documentation (#1420)
  • Bump actions/setup-java from 4 to 5 (#1341)
  • Bump actions/checkout from 4 to 5 (#1337)
  • Bump software.amazon.awssdk:opensearch (#1333)
  • Bump software.amazon.awssdk:apache-client (#1334)
  • Bump io.cucumber:cucumber-java (#1335)
  • Update hashicorp/aws requirement (#1336)

validate v3.7.1

30 May 17:58

Choose a tag to compare

Enhancements / Bug Fixes

  • Refactored validate-refs to use new OpenSearch Serverless and registry-common library by @al-niessner in #906
  • Added new encoding_standard_id values for Encoded_Byte_Stream quality check by @al-niessner in #1144
  • Add JP2 as an alias encoding to J2C by @al-niessner in #1211
  • Add progress information to standard out by @al-niessner in #1212
  • Progress message updates by @al-niessner in #1213
  • Count products as skipped when --skip-product-validation by @al-niessner in #1200
  • Update handling of the ASCII_NUMERIC_BASE* FieldType to throw WARNING instead of ERROR by @al-niessner in #1199
  • Update EncodingMimeMapping.java with additional file suffix for jp2 by @al-niessner in #1162
  • Add more complete JPEG check by @al-niessner in #1167
  • Update configuration file argument to support validate.strictFieldChecks to match CLI argument by @al-niessner in #1166
  • Update validate-refs to use registry alias for searching across all Registry indices by @al-niessner in #1134
  • Add ASCII_DATE_TIME processing to special constants by @jordanpadams in #1185
  • Fix bug with file extension checks on products by @al-niessner in #1112

Technical Improvements

Dependency Upgrades

  • Bump org.apache.logging.log4j:log4j-core from 2.24.1 to 2.24.2 by @dependabot in #1070
  • Update hashicorp/aws requirement from ~> 5.73.0 to ~> 5.77.0 in /terraform by @dependabot in #1068
  • Bump commons-io:commons-io from 2.17.0 to 2.18.0 by @dependabot in #1069
  • Bump jakarta.xml.bind:jakarta.xml.bind-api from 4.0.1 to 4.0.2 by @dependabot in #1071
  • Bump org.apache.httpcomponents.client5:httpclient5 from 5.3.1 to 5.4.1 by @dependabot in #1073
  • Update hashicorp/aws requirement from ~> 5.77.0 to ~> 5.81.0 in /terraform by @dependabot in #1086
  • Bump software.amazon.awssdk:apache-client from 2.25.31 to 2.29.34 by @dependabot in #1087
  • Bump software.amazon.awssdk:opensearch from 2.25.31 to 2.29.34 by @dependabot in #1088
  • Bump org.opensearch.client:opensearch-java from 2.13.0 to 2.19.0 by @dependabot in #1089
  • Bump software.amazon.awssdk:apache-client from 2.29.34 to 2.29.45 by @dependabot in #1101
  • Update hashicorp/aws requirement from ~> 5.81.0 to ~> 5.82.2 in /terraform by @dependabot in #1098
  • Bump org.apache.logging.log4j:log4j-core from 2.24.2 to 2.24.3 by @dependabot in #1096
  • Bump org.verapdf:validation-model-jakarta from 1.26.1 to 1.26.2 by @dependabot in #1095
  • Bump jakarta.activation:jakarta.activation-api from 2.1.2 to 2.1.3 by @dependabot in #1094
  • Bump org.jsoup:jsoup from 1.18.1 to 1.18.3 by @dependabot in #1093
  • Update hashicorp/aws requirement from ~> 5.82.2 to ~> 5.85.0 in /terraform by @dependabot in #1121
  • Bump software.amazon.awssdk:apache-client from 2.29.45 to 2.30.14 by @dependabot in #1120
  • Bump org.verapdf:validation-model-jakarta from 1.26.2 to 1.26.5 by @dependabot in #1111
  • Bump gov.nasa.pds:pds3-product-tools from 4.4.1 to 4.4.2 by @dependabot in #1109
  • Bump org.junit.vintage:junit-vintage-engine from 5.11.3 to 5.11.4 by @dependabot in #1108
  • Update hashicorp/aws requirement from ~> 5.85.0 to ~> 5.86.0 in /terraform by @dependabot in #1128
  • Bump org.junit.jupiter:junit-jupiter from 5.11.3 to 5.11.4 by @dependabot in #1127
  • Bump software.amazon.awssdk:opensearch from 2.29.34 to 2.30.16 by @dependabot in #1126
  • Bump org.opensearch.client:opensearch-java from 2.19.0 to 2.20.0 by @dependabot in #1125
  • Bump com.google.guava:guava from 33.3.1-jre to 33.4.0-jre by @dependabot in #1124
  • Bump software.amazon.awssdk:apache-client from 2.30.14 to 2.30.18 by @dependabot in #1132
  • Bump software.amazon.awssdk:opensearch from 2.30.16 to 2.30.23 by @dependabot in #1145
  • Bump org.opensearch.client:opensearch-java from 2.20.0 to 2.21.0 by @dependabot in #1143
  • Bump com.google.code.gson:gson from 2.11.0 to 2.12.1 by @dependabot in #1141
  • Bump com.fasterxml.jackson.core:jackson-databind from 2.18.1 to 2.18.2 by @dependabot in #1139
  • Update hashicorp/aws requirement from ~> 5.86.0 to ~> 5.87.0 in /terraform by @dependabot in #1138
  • Bump io.cucumber:cucumber-java from 7.20.1 to 7.21.1 by @dependabot in #1152
  • Bump software.amazon.awssdk:apache-client from 2.30.18 to 2.31.6 by @dependabot in #1182
  • Bump software.amazon.awssdk:opensearch from 2.30.23 to 2.31.6 by @dependabot in #1181
  • Update hashicorp/aws requirement from ~> 5.87.0 to ~> 5.92.0 in /terraform by @dependabot in #1180
  • Bump software.amazon.awssdk:opensearch from 2.30.23 to 2.31.1 by @dependabot in #1174
  • Bump org.junit.jupiter:junit-jupiter from 5.11.4 to 5.12.1 by @dependabot in #1175
  • Bump org.apache.httpcomponents.client5:httpclient5 from 5.4.1 to 5.4.3 by @dependabot in #1190
  • Update hashicorp/aws requirement from ~> 5.93.0 to ~> 5.94.1 in /terraform by @dependabot in #1209
  • Bump org.jsoup:jsoup from 1.18.3 to 1.19.1 by @dependabot in #1204
  • Bump software.amazon.awssdk:apache-client from 2.31.16 to 2.31.21 by @dependabot in #1214

Full Changelog: v3.6.3...v3.7.0

validate v3.7.0

14 Apr 21:37

Choose a tag to compare

Enhancements / Bug Fixes

  • Refactored validate-refs to use new OpenSearch Serverless and registry-common library by @al-niessner in #906
  • Added new encoding_standard_id values for Encoded_Byte_Stream quality check by @al-niessner in #1144
  • Add JP2 as an alias encoding to J2C by @al-niessner in #1211
  • Add progress information to standard out by @al-niessner in #1212
  • Progress message updates by @al-niessner in #1213
  • Count products as skipped when --skip-product-validation by @al-niessner in #1200
  • Update handling of the ASCII_NUMERIC_BASE* FieldType to throw WARNING instead of ERROR by @al-niessner in #1199
  • Update EncodingMimeMapping.java with additional file suffix for jp2 by @al-niessner in #1162
  • Add more complete JPEG check by @al-niessner in #1167
  • Update configuration file argument to support validate.strictFieldChecks to match CLI argument by @al-niessner in #1166
  • Update validate-refs to use registry alias for searching across all Registry indices by @al-niessner in #1134
  • Add ASCII_DATE_TIME processing to special constants by @jordanpadams in #1185
  • Fix bug with file extension checks on products by @al-niessner in #1112

Technical Improvements

Dependency Upgrades

  • Bump org.apache.logging.log4j:log4j-core from 2.24.1 to 2.24.2 by @dependabot in #1070
  • Update hashicorp/aws requirement from ~> 5.73.0 to ~> 5.77.0 in /terraform by @dependabot in #1068
  • Bump commons-io:commons-io from 2.17.0 to 2.18.0 by @dependabot in #1069
  • Bump jakarta.xml.bind:jakarta.xml.bind-api from 4.0.1 to 4.0.2 by @dependabot in #1071
  • Bump org.apache.httpcomponents.client5:httpclient5 from 5.3.1 to 5.4.1 by @dependabot in #1073
  • Update hashicorp/aws requirement from ~> 5.77.0 to ~> 5.81.0 in /terraform by @dependabot in #1086
  • Bump software.amazon.awssdk:apache-client from 2.25.31 to 2.29.34 by @dependabot in #1087
  • Bump software.amazon.awssdk:opensearch from 2.25.31 to 2.29.34 by @dependabot in #1088
  • Bump org.opensearch.client:opensearch-java from 2.13.0 to 2.19.0 by @dependabot in #1089
  • Bump software.amazon.awssdk:apache-client from 2.29.34 to 2.29.45 by @dependabot in #1101
  • Update hashicorp/aws requirement from ~> 5.81.0 to ~> 5.82.2 in /terraform by @dependabot in #1098
  • Bump org.apache.logging.log4j:log4j-core from 2.24.2 to 2.24.3 by @dependabot in #1096
  • Bump org.verapdf:validation-model-jakarta from 1.26.1 to 1.26.2 by @dependabot in #1095
  • Bump jakarta.activation:jakarta.activation-api from 2.1.2 to 2.1.3 by @dependabot in #1094
  • Bump org.jsoup:jsoup from 1.18.1 to 1.18.3 by @dependabot in #1093
  • Update hashicorp/aws requirement from ~> 5.82.2 to ~> 5.85.0 in /terraform by @dependabot in #1121
  • Bump software.amazon.awssdk:apache-client from 2.29.45 to 2.30.14 by @dependabot in #1120
  • Bump org.verapdf:validation-model-jakarta from 1.26.2 to 1.26.5 by @dependabot in #1111
  • Bump gov.nasa.pds:pds3-product-tools from 4.4.1 to 4.4.2 by @dependabot in #1109
  • Bump org.junit.vintage:junit-vintage-engine from 5.11.3 to 5.11.4 by @dependabot in #1108
  • Update hashicorp/aws requirement from ~> 5.85.0 to ~> 5.86.0 in /terraform by @dependabot in #1128
  • Bump org.junit.jupiter:junit-jupiter from 5.11.3 to 5.11.4 by @dependabot in #1127
  • Bump software.amazon.awssdk:opensearch from 2.29.34 to 2.30.16 by @dependabot in #1126
  • Bump org.opensearch.client:opensearch-java from 2.19.0 to 2.20.0 by @dependabot in #1125
  • Bump com.google.guava:guava from 33.3.1-jre to 33.4.0-jre by @dependabot in #1124
  • Bump software.amazon.awssdk:apache-client from 2.30.14 to 2.30.18 by @dependabot in #1132
  • Bump software.amazon.awssdk:opensearch from 2.30.16 to 2.30.23 by @dependabot in #1145
  • Bump org.opensearch.client:opensearch-java from 2.20.0 to 2.21.0 by @dependabot in #1143
  • Bump com.google.code.gson:gson from 2.11.0 to 2.12.1 by @dependabot in #1141
  • Bump com.fasterxml.jackson.core:jackson-databind from 2.18.1 to 2.18.2 by @dependabot in #1139
  • Update hashicorp/aws requirement from ~> 5.86.0 to ~> 5.87.0 in /terraform by @dependabot in #1138
  • Bump io.cucumber:cucumber-java from 7.20.1 to 7.21.1 by @dependabot in #1152
  • Bump software.amazon.awssdk:apache-client from 2.30.18 to 2.31.6 by @dependabot in #1182
  • Bump software.amazon.awssdk:opensearch from 2.30.23 to 2.31.6 by @dependabot in #1181
  • Update hashicorp/aws requirement from ~> 5.87.0 to ~> 5.92.0 in /terraform by @dependabot in #1180
  • Bump software.amazon.awssdk:opensearch from 2.30.23 to 2.31.1 by @dependabot in #1174
  • Bump org.junit.jupiter:junit-jupiter from 5.11.4 to 5.12.1 by @dependabot in #1175
  • Bump org.apache.httpcomponents.client5:httpclient5 from 5.4.1 to 5.4.3 by @dependabot in #1190
  • Update hashicorp/aws requirement from ~> 5.93.0 to ~> 5.94.1 in /terraform by @dependabot in #1209
  • Bump org.jsoup:jsoup from 1.18.3 to 1.19.1 by @dependabot in #1204
  • Bump software.amazon.awssdk:apache-client from 2.31.16 to 2.31.21 by @dependabot in #1214

Full Changelog: v3.6.3...v3.7.0

validate v3.6.3

19 Nov 00:13

Choose a tag to compare

What's Changed

Full Changelog: v3.6.2...v3.6.3

validate v3.6.2

17 Nov 20:28

Choose a tag to compare

Tag release v3.6.2

validate v3.6.1

09 Nov 14:35

Choose a tag to compare

Highlights

  • Improve error handling for invalid config file options by @al-niessner in #930
  • Update PDF-A checker to fix mismatched filenames in error messages by @al-niessner in #940
  • Performance improvements for referential integrity checking by @al-niessner in #980
  • Re-organize tests per planned release by @jordanpadams in #1007
  • Image vulnerability scanning in support of safer devops by @nutjob4life in #1009
  • Update documentation with batching recommendation by @jordanpadams in #1012
  • Switchover to using Registry API for generating context products json by @jordanpadams in #1036
  • New requirement to ensure is exactly one digit to the left of the decimal point for the specifier e or E and fix tests by @al-niessner in #1042
  • Minimally handle SEED files and fix automated test caching issue by @al-niessner in #1057

Bug Fixes

Technical Updates

Dependency Upgrades

  • Update hashicorp/aws requirement from ~> 5.52.0 to ~> 5.53.0 in /terraform by @dependabot in #928
  • Bump docker/build-push-action from 5 to 6 in /.github/workflows by @dependabot in #938
  • Bump org.apache.maven.plugins:maven-surefire-plugin from 3.2.5 to 3.3.0 by @dependabot in #937
  • Bump org.apache.maven.plugins:maven-site-plugin from 4.0.0-M13 to 4.0.0-M15 by @dependabot in #943
  • Update hashicorp/aws requirement from ~> 5.54.1 to ~> 5.56.1 in /terraform by @dependabot in #948
  • Bump org.apache.commons:commons-compress from 1.26.1 to 1.26.2 by @dependabot in #925
  • Bump com.jamesmurty.utils:java-xmlbuilder from 1.2 to 1.3 by @dependabot in #924
  • Bump org.verapdf:validation-model-jakarta from 1.24.2 to 1.26.1 by @dependabot in #954
  • Update hashicorp/aws requirement from ~> 5.56.1 to ~> 5.57.0 in /terraform by @dependabot in #952
  • Bump commons-logging:commons-logging from 1.3.2 to 1.3.3 by @dependabot in #963
  • Update hashicorp/aws requirement from ~> 5.57.0 to ~> 5.60.0 in /terraform by @dependabot in #962
  • Bump org.apache.solr:solr-solrj from 9.5.0 to 9.6.1 by @dependabot in #955
  • Bump org.jsoup:jsoup from 1.17.2 to 1.18.1 by @dependabot in #965
  • Update hashicorp/aws requirement from ~> 5.60.0 to ~> 5.61.0 in /terraform by @dependabot in #966
  • Bump org.opensearch.client:opensearch-rest-client from 2.5.0 to 2.16.0 by @dependabot in #968
  • Update hashicorp/aws requirement from ~> 5.61.0 to ~> 5.63.0 in /terraform by @dependabot in #977
  • Bump org.junit.jupiter:junit-jupiter from 5.10.2 to 5.11.0 by @dependabot in #976
  • Bump com.sun.xml.bind:jaxb-xjc from 2.3.4 to 4.0.5 by @dependabot in #897
  • Update hashicorp/aws requirement from ~> 5.63.0 to ~> 5.64.0 in /terraform by @dependabot in #981
  • Bump com.fasterxml.jackson.core:jackson-databind from 2.17.1 to 2.17.2 by @dependabot in #984
  • Bump net.sf.saxon:Saxon-HE from 12.4 to 12.5 by @dependabot in #982
  • Bump org.apache.commons:commons-lang3 from 3.14.0 to 3.16.0 by @dependabot in #983
  • Upgrade cucumber dependencies by @al-niessner in #985
  • Bump io.cucumber:cucumber-java from 6.9.1 to 7.18.1 by @dependabot in #974
  • Bump commons-logging:commons-logging from 1.3.3 to 1.3.4 by @dependabot in #991
  • Bump org.apache.maven.plugins:maven-jar-plugin from 3.3.0 to 3.4.2 by @dependabot in #988
  • Update hashicorp/aws requirement from ~> 5.64.0 to ~> 5.66.0 in /terraform by @dependabot in #994
  • Bump com.google.guava:guava from 33.2.0-jre to 33.3.0-jre by @dependabot in #987
  • Bump org.slf4j:slf4j-nop from 2.0.13 to 2.0.16 by @dependabot in #990
  • Bump org.apache.commons:commons-compress from 1.26.2 to 1.27.1 by @dependabot in #999
  • Bump org.codehaus.mojo:buildnumber-maven-plugin from 3.2.0 to 3.2.1 by @dependabot in #998
  • Bump org.apache.commons:commons-lang3 from 3.16.0 to 3.17.0 by @dependabot in #996
  • Bump org.junit.vintage:junit-vintage-engine from 5.10.2 to 5.11.0 by @dependabot in #997
  • Bump commons-cli:commons-cli from 1.7.0 to 1.9.0 by @dependabot in #1004
  • Bump commons-io:commons-io from 2.16.1 to 2.17.0 by @dependabot in #1003
  • Update hashicorp/aws requirement from ~> 5.66.0 to ~> 5.68.0 in /terraform by @dependabot in #1002
  • Bump org.verapdf:validation-model from 1.24.2 to 1.26.1 by @dependabot in #989
  • Bump org.apache.maven.plugins:maven-site-plugin from 4.0.0-M15 to 4.0.0-M16 by @dependabot in #1001
  • Bump org.junit.jupiter:junit-jupiter from 5.11.0 to 5.11.2 by @dependabot in #1020
  • Bump org.junit.vintage:junit-vintage-engine from 5.11.0 to 5.11.2 by @dependabot in #1021
  • Update hashicorp/aws requirement from ~> 5.68.0 to ~> 5.70.0 in /terraform by @dependabot in #1023
  • Bump anchore/scan-action from 4 to 5 in /.github/workflows by @dependabot in #1029
  • Bump com.fasterxml.jackson.core:jackson-databind from 2.17.2 to 2.18.0 by @dependabot in #1032
  • Bump org.apache.logging.log4j:log4j-core from 2.23.1 to 2.24.1 by @dependabot in #1031
  • Update hashicorp/aws requirement from ~> 5.70.0 to ~> 5.71.0 in /terraform by @dependabot in #1033
  • Bump com.google.guava:guava from 33.3.0-jre to 33.3.1-jre by @dependabot in #1018
  • Upgrades of libraries to support regression when introducing colliding JAXB libraries by @al-niessner in #1046
  • Update hashicorp/aws requirement from ~> 5.71.0 to ~> 5.73.0 in /terraform by @dependabot in #1044
  • Bump org.junit.jupiter:junit-jupiter from 5.11.2 to 5.11.3 by @dependabot in #1043
  • Bump io.cucumber:cucumber-java from 7.18.1 to 7.20.1 by @dependabot in #1040
  • Bump org.apache.maven.plugins:maven-site-plugin from 4.0.0-M13 to 4.0.0-M16 by @dependabot in #1038
  • Bump gov.nasa.pds:pds3-product-tools from 4.4.0 to 4.4.1 by @dependabot in #1037
  • Bump org.apache.maven.plugins:maven-surefire-plugin from 3.3.0 to 3.5.2 by @dependabot in #1052
  • Bump org.apache.httpcomponents.client5:httpclient5 from 5.3.1 to 5.4.1 by @dependabot in #1051
  • Bump com.fasterxml.jackson.core:jackson-databind from 2.18.0 to 2.18.1 by @dependabot in #1050
  • Bump org.junit.vintage:junit-vintage-engine from 5.11.2 to 5.11.3 by @dependabot in #1049

New Contributors

Full Changelog: v3.5.2...v3.6.1

validate v3.5.2

12 Jun 18:16

Choose a tag to compare

Highlights

  • Memory leak fix for bundle validation - #826
  • Add WARNING messages for context product metadata mismatch with labels and new flag --disable-context-mismatch-warnings to disable the messages by @al-niessner in #890
  • Update functionality to throw ERROR for validation_format mismatch, and WARNING for field_format mismatch. by @al-niessner in #888
  • Numerous fixes to support special constants
  • Improve handling for high_instrument_saturation - #831
  • Update handling of Infinity / NaN values as special constants when they are not represented as the data type of the parent object. by @al-niessner in #894

What's Changed

Enhancements / Bug Fixes

  • Add retries to schematron downloads in the event of network connectivity issues by @al-niessner in #907
  • Update duplicate file check to only check for Product Observational by @al-niessner in #914
  • Fix URL handling on Windows OS by @al-niessner in #920
  • Update reference warning to throw on all --rule executions by @al-niessner in #921
  • Allow 64 bits to span more than 8 bytes (think shifted relative to byte boundaries) by @al-niessner in #922
  • Downgrade maven-site-plugin per bug with markdown by @jordanpadams in #934

Dependency Upgrades

  • Bump gov.nasa.pds:pds3-product-tools from 4.3.0 to 4.4.0 by @dependabot in #911
  • Update hashicorp/aws requirement from ~> 5.50.0 to ~> 5.51.1 in /terraform by @dependabot in #908
  • Bump commons-io:commons-io from 2.7 to 2.16.1 by @dependabot in #885
  • Bump com.google.code.gson:gson from 2.10.1 to 2.11.0 by @dependabot in #917
  • Bump commons-logging:commons-logging from 1.3.1 to 1.3.2 by @dependabot in #909
  • Update hashicorp/aws requirement from ~> 5.51.1 to ~> 5.52.0 in /terraform by @dependabot in #918
  • Bump com.fasterxml.jackson.core:jackson-databind from 2.17.0 to 2.17.1 by @dependabot in #910
  • Bump org.apache.maven.plugins:maven-site-plugin from 4.0.0-M14 to 4.0.0-M15 by @dependabot in #927

Full Changelog: v3.5.1...v3.5.2

validate v3.5.1

25 May 17:55

Choose a tag to compare

Highlights

  • Memory leak fix for bundle validation - #826
  • Add WARNING messages for context product metadata mismatch with labels and new flag --disable-context-mismatch-warnings to disable the messages by @al-niessner in #890
  • Update functionality to throw ERROR for validation_format mismatch, and WARNING for field_format mismatch. by @al-niessner in #888
  • Numerous fixes to support special constants
    • Improve handling for high_instrument_saturation - #831
    • Update handling of Infinity / NaN values as special constants when they are not represented as the data type of the parent object. by @al-niessner in #894
    • Update handling of Infinity / NaN values as special constants when they are not represented as the data type of the parent object. by @al-niessner in #894

🎉 Enhancements by External Contributors 🎉

Other Bug Fixes and Enhancements

  • Improved report generation to be more consistent across output formats by @al-niessner in #804
  • Update precision check to be less than or equal to by @jordanpadams in #815
  • Fix bug introduced by #308 when converting URLs to local paths on Windows by @jordanpadams in #818
  • Fix regression where unlabeled files are not being identified by @al-niessner in #836
  • handle float special constant maximum by @al-niessner in #843
  • Fix memory leaks and update PDF/A algorithm for non-document products by @al-niessner in #845
  • Fix bug for duplicate filenames used in different sub-directories by @al-niessner in #886
  • Fixes bugs with erroneous messages from output logs, duplicate records in collections, and handling of high_instrument_saturation special constants by @al-niessner in #859
  • Allow for special constant to be non-conformant with object's data type by @al-niessner in #893

Dependency Upgrades

  • Bump github/codeql-action from 2 to 3 in /.github/workflows by @dependabot in #802
  • Bump org.apache.maven.plugins:maven-site-plugin from 4.0.0-M11 to 4.0.0-M13 by @dependabot in #799
  • Bump actions/upload-artifact from 3 to 4 in /.github/workflows by @dependabot in #801
  • Update hashicorp/aws requirement from ~> 5.30.0 to ~> 5.31.0 in /terraform by @dependabot in #800
  • Bump com.google.code.gson:gson from 2.8.9 to 2.10.1 by @dependabot in #798
  • Bump actions/cache from 3 to 4 in /.github/workflows by @dependabot in #814
  • Bump org.codehaus.mojo:buildnumber-maven-plugin from 1.4 to 3.2.0 by @dependabot in #841
  • Bump com.google.guava:guava from 32.0.0-jre to 33.0.0-jre by @dependabot in #838
  • Bump commons-logging:commons-logging from 1.2 to 1.3.0 by @dependabot in #806
  • Bump org.apache.commons:commons-compress from 1.25.0 to 1.26.0 by @dependabot in #834
  • Bump org.jsoup:jsoup from 1.15.3 to 1.17.2 by @dependabot in #808
  • Bump org.apache.logging.log4j:log4j-core from 2.22.0 to 2.23.0 by @dependabot in #848
  • Bump net.sf.saxon:Saxon-HE from 12.3 to 12.4 by @dependabot in #847
  • Bump org.apache.commons:commons-compress from 1.26.0 to 1.26.1 by @dependabot in #851
  • Bump org.apache.solr:solr-solrj from 7.7.2 to 9.5.0 by @dependabot in #828
  • Bump gov.nasa:pds from 1.15.0 to 1.16.0 by @dependabot in #864
  • Bump commons-logging:commons-logging from 1.3.0 to 1.3.1 by @dependabot in #863
  • Bump com.fasterxml.jackson.core:jackson-databind from 2.14.2 to 2.17.0 by @dependabot in #870
  • Bump org.verapdf:validation-model from 1.24.1 to 1.24.2 by @dependabot in #869
  • Bump org.junit.jupiter:junit-jupiter from 5.7.0 to 5.10.2 by @dependabot in #871
  • Bump org.verapdf:validation-model-jakarta from 1.24.1 to 1.24.2 by @dependabot in #878
  • Bump commons-cli:commons-cli from 1.6.0 to 1.7.0 by @dependabot in #876
  • Bump org.apache.maven.plugins:maven-surefire-plugin from 3.2.2 to 3.2.5 by @dependabot in #877
  • Bump org.apache.maven.plugins:maven-assembly-plugin from 3.6.0 to 3.7.1 by @dependabot in #883
  • Bump com.google.guava:guava from 33.0.0-jre to 33.2.0-jre by @dependabot in #892
  • Catch NumberFormatException when values in data do not match spec in label by @al-niessner in #889
  • Bump org.apache.logging.log4j:log4j-core from 2.23.0 to 2.23.1 by @dependabot in #900
  • Bump org.slf4j:slf4j-nop from 2.0.9 to 2.0.13 by @dependabot in #898
  • Bump org.junit.vintage:junit-vintage-engine from 5.10.1 to 5.10.2 by @dependabot in #899
  • Update hashicorp/aws requirement from ~> 5.31.0 to ~> 5.50.0 in /terraform by @dependabot in #813

Known bugs and possible work arounds: known bugs in v3.4.1

Full Changelog: v3.4.1...v3.5.1