Kestra storage & io.kestra.plugin.git.SyncNamespaceFiles

[sashok60]

Describe the issue

i use flow with type: io.kestra.plugin.git.SyncNamespaceFiles
id: sync_files namespace: system tasks: id: git type: io.kestra.plugin.git.SyncNamespaceFiles namespace: company.dsp gitDirectory: _files url: https://xxx.yyy.com/dsp/kestra branch: master username: "cicd" password: "{{ secret('REGISTRY_PASS') }}" triggers: id: schedule type: io.kestra.plugin.core.trigger.Schedule cron: "*/1 * * * *"
minio used as storage:
`
storage:
type: minio
minio:
endpoint: minio.platform.svc.cluster.local
port: 9000
secure: false
region: us-east-1
bucket: kestra
access-key: xxx
secret-key: xxx

`
Every time you sync, files with a version number are added to Minio bucket
why its added, its bug or feature?
and what do with this files?

Environment

• Kestra Version: 1.2.3

[proddata]

Hi @sashok60

Kestra 1.2 introduced revisions for namespace files.
While the tenant/namespace sync should check if files are changed, before creating a revision, this seemingly is not the case for SyncNamespaceFiles. This is a bug.

One can delete old namespace file revisions with https://kestra.io/plugins/core/namespace/io.kestra.plugin.core.namespace.purgefiles#examples-body

@kestra-io/plugins can we check also other Tasks please 🙏 .

[Malaydewangan09]

@proddata, are you able to reproduce on a fresh 1.2 instance?
Just to be sure that this is not a migration issue?

[proddata]

yes, fresh 1.2.5

[sashok60]

Starting with version 1.2.0, files are versioned regardless of whether they have been modified or not .
Each time synchronization occurs, new files are created with the new version.
in minio in my case!
in web ui shows origin namespace file without versions with current changes if any occurred

[proddata]

Starting with version 1.2.0, files are versioned regardless of whether they have been modified or not .

SyncNamespaceFiles always rewrites Git-side files into Kestra on each run, even if content is identical:

plugin-git/src/main/java/io/kestra/plugin/git/AbstractSyncTask.java

Line 201 in 54ca47c

resource = this.writeResource(runContext, renderedNamespace, e.getKey(), inputStream);

NamespaceSync checks if it is changed

[sashok60]

Please tell me when this bug is planned to be fixed?