Open
Description
With the new interface we can initialise a dataset from a manifest. The manifest are currently located in the working directory. If we want to share the dataset/manifest we have to adapt the manifest location manually as well uploading the data to the final location.
Ideally, we would come with a method that allows to export a dataset to a remote storage bucket. The parquet files and a modified manifest have to be uploaded to defined location.
We do something similar with the write_to_file
component, but there we don't modify the manifest itself.
Metadata
Metadata
Assignees
Labels
Type
Projects
Status
Backlog