Skip to content

Release 1.3.20240308 - Backup scripts and bugfixes
Compare
Choose a tag to compare
@jsmatias jsmatias released this 11 Mar 11:11
v1.3.20240308
31eef86
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Verified
Learn about vigilant mode.

Changelog

The format is loosely based on Keep a Changelog,
and this project adheres to Semantic Versioning, except that the date of the release is used as the patch version.

Added

  • Automated Backup and Restoration System: Implemented automated incremental backup and restoration of any data related to the metadata catalogue (e.g., MySQL DB, Keycloak, connector states/logs, etc) (PR #275).

Fixed

  • OpenML Connector Issue #266: Fixed the issue on PR #270 to ensure that the connector correctly detects the last asset uploaded to OpenML, preventing the offset of its state from increasing on subsequent runs. This ensures synchronization without skipping any assets.
  • OpenML Connector empty distribution: Fixed on PR #270 to make sure that the connector correctly returns a distribution list when all the three fields: dependencies, installation_notes, and binary_url are filled.
  • Zenodo Rate Limits Issue #267: Resolved on PR #272 to prevent skipping assets due to improper error handling. This includes:
  1. Preventing connector to exceed harvesting rate limits;
  2. Preventing connector to exceed the resumption token expiration time.
  3. Avoiding connector to incorrectly raise an error on missing fields.
  • Zenodo Uploader Error Message: Fixed truncation of error messages due to line breaks on PR #268.
  • Hugging Face Connector Logging Operator: Updated the operator in connectors/huggingface/datasets.sh to prevent deletion of logs when the Docker container is restarted, fixed on PR #268.

Changed

  • Connector Log Version Tags: Added version tags to the connector.log files to facilitate debugging, as implemented in PR #268.
Assets 2
Loading