Describe the bug
larger files are only split if both the --row-group-size and --file-size parameters are set, setting the latter alone won't result in files being split. I think if the file size < row group size the file size parameter should take precedence.
parquet-go specific details
Misc Details
- File is a previously compacted file of ~28MB with a row group size of 128MB
Describe the bug
larger files are only split if both the
--row-group-sizeand--file-sizeparameters are set, setting the latter alone won't result in files being split. I think if the file size < row group size the file size parameter should take precedence.parquet-go specific details
Misc Details