Main parquet text loader - #1220

Merged

artemru merged 14 commits into

mainfrom

main_parquet_text_loader

Jul 7, 2025

Commits on Jun 30, 2025

add parquet based text dataloader with packing, plus minor refactors
Artyom Kozhevnikov
committed
3e16f2e
missing file
Artyom Kozhevnikov
committed
c1150cd
using stric_state=False to avoid big buffer serialization
Artyom Kozhevnikov
committed
a3236ba
mypy
Artyom Kozhevnikov
committed
e9ffc87
annotations
Artyom Kozhevnikov
committed
6babf74
flake 8
Artyom Kozhevnikov
committed
a376fc1

Commits on Jul 3, 2025

pinned_memory
Artyom Kozhevnikov
committed
6f477ec

Commits on Jul 7, 2025

comments
Artyom Kozhevnikov
committed
77ea4d6
rm recipes
Artyom Kozhevnikov
committed
3eefea8
Merge branch 'main' into main_parquet_text_loader
artemru
authored
71d1557
rm npc=1
Artyom Kozhevnikov
committed
4f60566
stricter split selection
Artyom Kozhevnikov
committed
5930e52
adding split pattern
Artyom Kozhevnikov
committed
8eb2424
copy
Artyom Kozhevnikov
committed
8296bc6