New Features
- New dataset joining and pre-indexed joined tar iteration (#51, @philipp-fischer, @voegtlel)
- Allow restore with different worker configuration (refactor save/restore concept, worker dimension as outer dimension) (#80, @philipp-fischer, @voegtlel)
- Use EPath for all paths, removes fsspec (#62, @voegtlel)
- Simplify savable loader implementation (#87, @philipp-fischer, @voegtlel)
- Efficient Audio and Video decoding (#38, #93, @jon-barker, @voegtlel)
- Expose
prefetch_factor
arg for loader (#83, @philipp-fischer)
Fixes
- Fix len for
RepeatDataset
with float repeats (#89, @voegtlel) - Fix
EPath
for relative local filesystem string paths (#95, @voegtlel) - Fix
EPath.open
inITarReader
(#88, @shunjiad) - Fix a rare bug in save/restore (#79, @philipp-fischer)
Internal Changes
- Toolchain upgrade: Drop black, isort and introduce ruff, uv and just (#67, @philipp-fischer)
Full Changelog: 5.2.0...6.0.1