-
append_parquet()now gives a clear error when appending data with
missing values (NA) to a column that was written asREQUIRED(i.e.
non-nullable) (#146). -
append_parquet()now creates a new file iffiledoes not exist (#155). -
read_parquet()now correctly readsDECIMALvalues stored as
FIXED_LEN_BYTE_ARRAYwith a byte length greater than 8 (e.g. 128-bit
decimals) (#148). -
write_parquet()now sets thedefinition_level_encodingand
repetition_level_encodingfields in data page headers toRLEfor all
columns, fixing an interoperability issue with the Apache Parquet Java
library (#98). -
write_parquet()now writes theARROW:schemametadata with correct
flatbuffer alignment, fixing an interoperability issue with the Rust
arrow-rs parquet reader (#152). -
read_parquet()now reads logical (BOOLEAN) columns correctly when the
column spans multiple data pages (#142). -
write_parquet()now writes files larger than 4 GB correctly. File offsets
and column sizes were stored as 32-bit integers and overflowed, producing
corrupt Parquet files that could not be read back (#143). -
write_parquet()now handles data frames with zero rows correctly,
including zero-column data frames (#138). -
read_parquet()no longer crashes when reading a Parquet file with
zero columns (#138). -
nanoparquet now supports Parquet
LISTcolumns:-
write_parquet()can write R list columns whose elements are integer,
double, or character vectors.NULLentries encode a missing list,
NAvalues inside an element vector encode a missing element, and
zero-length vectors encode an empty list. -
read_parquet()can readLISTcolumns with any supported scalar
element type. All four combinations of optional/required outer list
and optional/required element are supported, for both data page
version 1 and version 2. -
parquet_schema()acceptslist("LIST", element = <type>)to
specify aLISTcolumn type explicitly. -
infer_parquet_schema()andread_parquet_schema()report list
columns withr_typelist(...), e.g.list(double)or
list(list(characer)), etc. -
Dictionary encoding (
RLE_DICTIONARY) is supported forLIST
columns.
-