Skip to content

Commit 4e00d8b

Browse files
qchappCopilot
andauthored
Update src/mmirage/shard_process.py
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
1 parent eaff903 commit 4e00d8b

1 file changed

Lines changed: 2 additions & 1 deletion

File tree

src/mmirage/shard_process.py

Lines changed: 2 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -120,7 +120,8 @@ def main():
120120
ds_config = datasets_config[ds_idx]
121121
if processing_params.remove_columns:
122122
remove_columns = _remove_columns(ds_shard)
123-
else: remove_columns = []
123+
else:
124+
remove_columns = []
124125

125126
logger.info(
126127
f"Processing dataset {ds_idx} for shard {shard_id}: "

0 commit comments

Comments
 (0)