Currently, the conversion job fails if a raw output dataset already exists. This is annoying because
- it affects the entire job and it is hard to create spark jobs to convert many datasets
- just restarting the job will not work because it will fail the same way
Instead, only a warning should be emitted to inform the user that the existing dataset is skipped
Currently, the conversion job fails if a raw output dataset already exists. This is annoying because
Instead, only a warning should be emitted to inform the user that the existing dataset is skipped