Open
Description
I don't think that's possible with the way target-csv currently works. The logic to write to the file, and more importantly here create if it doesn't exist, lives in the process_batch
implementation:
target-csv/target_csv/sinks.py
Lines 103 to 108 in 47a1c76
My guess is that it's never called for empty streams because the method is only called when a "batch" is full, but that never happens for the stream in question. One fix I can think of is to add an optional early file creation step controlled by a new setting (e.g create_files_for_empty_streams
), maybe within the Sink class __init__
method.
Metadata
Metadata
Assignees
Labels
No labels
Type
Projects
Status
No status