v1.0.0-beta.6

What's Changed

• Set user id and group id in docker file by @phwissmann in #219
• 205 improve runtime docker images by @phwissmann in #221
• Add retries to retrieval by @phwissmann in #220
• CI: fix release pipeline permission by @phwissmann in #223

Full Changelog: v1.0.0-beta.4...v1.0.0-beta.6

v1.0.0-beta.4

What's Changed

• Fixes for large datasets by @phwissmann in #213
• Remove staging step by @phwissmann in #216

Full Changelog: v1.0.0-beta.3...v1.0.0-beta.4

v1.0.0-beta.3

What's Changed

• fix(API): add missing async requests to scicat by @phwissmann in #210
• Archiver: wait for existing retrieval flow instead of starting new one by @phwissmann in #204

Full Changelog: v1.0.0-beta.2...v1.0.0-beta.3

v1.0.0-beta.2

What's Changed

• Prefect: Update and Align prefect version to 3.4.1 by @phwissmann in #199
• 157 bug exception is thrown when entering on dataset flow failure by @phwissmann in #201
• Fix api service by @phwissmann in #202
• [Feature] Add health check to api service by @phwissmann in #207

Full Changelog: v1.0.0-beta.1...v1.0.0-beta.2

v1.0.0-beta.1

What's Changed

• Fix concurrency limits deployment by @phwissmann in #112
• 109 feature upgrade to prefect 30 by @phwissmann in #113
• Remove Mockarchiver by @phwissmann in #114
• Remove webuploader by @phwissmann in #115
• 99 update documentation by @phwissmann in #116
• fix(ci): main trigger used template variable by @phwissmann in #117
• Fix gh pages deployment by @phwissmann in #118
• feature(backend-service): add backend generated by openapi gen by @phwissmann in #121
• 122 setup https on minio by @phwissmann in #124
• fix: add archiver and s3 prefix to api paths by @phwissmann in #127
• Adapt to scicat api changes by @phwissmann in #128
• Deployment: add https endpoints and routing in traefik by @phwissmann in #131
• 138 feature improve http responses after post requests by @pulsargranular in #139
• 135 feature create a secure token in ethz archiver to be added to scicat jobconfig by @pulsargranular in #140
• 141 feature add token endpoint to issue a new service token by @pulsargranular in #142
• fix: always return 201 for POST requests by @pulsargranular in #148
• 146 feature allow both keycloak and scicat user jwt tokens by @pulsargranular in #149
• archiver api: fix docker build and add new secrets to deployment by @phwissmann in #150
• Update archiver to uv by @phwissmann in #153
• Archiver: Add user to runtime docker image by @phwissmann in #154
• Fix: avoid exception when trying to delete non-existing folder by @phwissmann in #163
• 47 feature add proper account management for backend components by @pulsargranular in #159
• 156 add retries to lts interaction by @phwissmann in #164
• Auth: fix missing route to prefect api by @phwissmann in #174
• 166 add missing checksum verification when retrieving data by @phwissmann in #171
• 161 Datablocks: refactor tarfile creation by @phwissmann in #165
• Scicat API: update to use api/v4/jobs endpoints by @phwissmann in #175
• Add api generation to dockerfile by @phwissmann in #178
• Refactor timeout before verify by @phwissmann in #187
• rsync: don't preserve file permissions when copying by @phwissmann in #188
• feat(datablocks): create tar files keeping the folder structure of nested folders by @phwissmann in #184
• deploy: set default datablock size to 500GB by @phwissmann in #190
• fix(minio): add configurable expiration time for presigned urls by @phwissmann in #191
• deploy: fix disabling of auth by @phwissmann in #194
• 145-add-archiver-api-endpoint-to-finalize-upload-in-scicat by @phwissmann in #195
• 181 scicat backend add credentials to archiving service in scicat by @phwissmann in #196
• Add release pipeline by @phwissmann in #198

New Contributors

• @pulsargranular made their first contribution in #139

Full Changelog: v0.3.0...v1.0.0-beta.1

Milestone-III

Development release corresponding to milestone-III as defined here. First functional system to archive datasets and integrate with SciCat.

What's Changed

• Add GitHub ci by @phwissmann in #7
• 2 poc direct upload to s3 uppy + minio by @phwissmann in #8
• CI: detect changes only in PRs by @phwissmann in #9
• Add tusd upload by @phwissmann in #10
• 14 implement basic job queue by @phwissmann in #21
• Cleanup job system, add feature flags by @phwissmann in #35
• 15 add archive job by @phwissmann in #40
• 57 feature add lts test share as nfs mount by @phwissmann in #60
• 58 feature implement archival in lts by @phwissmann in #64
• 16 feature add retrieval flow by @phwissmann in #65
• Wait for lts files available by @phwissmann in #71
• Wait for lts files available by @phwissmann in #75
• 67 define and implement end to end test procedures by @phwissmann in #84
• Fix path of landing zone bucket by @phwissmann in #90
• 87 bug download url missing in scicat dataset by @phwissmann in #98
• 95 bug expect origdatablocks to not be compressed files but only raw files by @phwissmann in #101
• Remove incompatible field of Job json sent to Scicat by @phwissmann in #102
• Add verification for each datafile by @phwissmann in #103
• Add jobResultObject to scicat job status update by @phwissmann in #106
• Set MINIO_EXTERNAL_URL and SCICAT_ENDPOINT from docker compose by @phwissmann in #108
• Allow defining file size when creating new dataset by @phwissmann in #105

Full Changelog: https://github.com/SwissOpenEM/ScopeMArchiver/commits/v0.3.0