Commit 55c316b
authored
Change
`dask_cudf` is currently using fsspec to open all output files in `to_parquet`. We definitely want to let cudf/libcudf handle local filesystems in a more-optimal way.
Authors:
- Richard (Rick) Zamora (https://github.com/rjzamora)
Approvers:
- Tom Augspurger (https://github.com/TomAugspurger)
URL: #18408dask_cudf.to_parquet behavior for local filesystems (#18408)1 parent 661add6 commit 55c316b
1 file changed
+10
-2
lines changed| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
1 | 1 | | |
| 2 | + | |
2 | 3 | | |
3 | 4 | | |
4 | 5 | | |
| |||
22 | 23 | | |
23 | 24 | | |
24 | 25 | | |
| 26 | + | |
25 | 27 | | |
26 | 28 | | |
27 | 29 | | |
| |||
348 | 350 | | |
349 | 351 | | |
350 | 352 | | |
351 | | - | |
352 | | - | |
| 353 | + | |
| 354 | + | |
| 355 | + | |
| 356 | + | |
| 357 | + | |
| 358 | + | |
| 359 | + | |
| 360 | + | |
353 | 361 | | |
354 | 362 | | |
355 | 363 | | |
| |||
0 commit comments