Skip to content

Export/share manifest #916

Open
Open
@mrchtr

Description

@mrchtr

With the new interface we can initialise a dataset from a manifest. The manifest are currently located in the working directory. If we want to share the dataset/manifest we have to adapt the manifest location manually as well uploading the data to the final location.

Ideally, we would come with a method that allows to export a dataset to a remote storage bucket. The parquet files and a modified manifest have to be uploaded to defined location.

We do something similar with the write_to_file component, but there we don't modify the manifest itself.

Metadata

Metadata

Assignees

No one assigned

    Labels

    CoreCore framework

    Type

    No type

    Projects

    Status

    Backlog

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions