Skip to content

arrow 55.2.0

Compare
Choose a tag to compare
@github-actions github-actions released this 22 Jun 13:10
· 475 commits to main since this release
25114c5

Changelog

55.2.0 (2025-06-22)

Full Changelog

Implemented enhancements:

  • Do not populate nulls for NullArray for MutableArrayData #7725
  • Implement PartialEq for RunArray #7691
  • interleave_views is really slow #7688 [arrow]
  • Add min max aggregates for FixedSizeBinary #7674 [arrow]
  • Deliver pyarrow as a standalone crate #7668 [arrow]
  • [Variant] Implement VariantObject::field and VariantObject::fields #7665 [parquet]
  • [Variant] Implement read support for remaining primitive types #7630 [parquet]
  • Fast and ergonomic method to add metadata to a RecordBatch #7628 [arrow]
  • Add efficient way to change the keys of string dictionary builder #7610 [arrow]
  • Support add_nulls on additional builder types #7605 [arrow]
  • Add into_inner for AsyncArrowWriter #7603 [parquet]
  • Optimize PrimitiveBuilder::append_trusted_len_iter #7591 [arrow]
  • Benchmark for filter+concat and take+concat into even sized record batches #7589 [arrow]
  • max_statistics_truncate_length is ignored when writing statistics to data page headers #7579 [parquet]
  • Feature Request: Encoding in parquet-rewrite #7575 [parquet]
  • Add a strong_count method to Buffer #7568 [arrow]
  • Create version of LexicographicalComparator that compares fixed number of columns #7531 [arrow]
  • parquet-show-bloom-filter should work with integer typed columns #7528 [parquet]
  • Allow merging primitive dictionary values in concat and interleave kernels #7518 [arrow]
  • Add efficient concatenation of StructArrays #7516 [arrow]
  • Rename flight-sql-experimental to flight-sql #7498 [arrow] [arrow-flight]
  • Consider moving from ryu to lexical-core for string formatting / casting floats to string. #7496
  • Arithmetic kernels can be safer and faster #7494 [arrow]
  • Speedup filter_bytes by precalculating capacity #7465 [arrow]
  • [Variant]: Rust API to Create Variant Values #7424 [parquet] [arrow]
  • [Variant] Rust API to Read Variant Values #7423 [arrow]
  • Release arrow-rs / parquet Minor version 55.1.0 (May 2025) #7393 [parquet]
  • Support create_random_array for Decimal data types #7343 [arrow]
  • Truncate Parquet page data page statistics #7555 [parquet] (etseidl)

Fixed bugs:

  • In arrow_json, Decoder::decode can panic if it encounters two high surrogates in a row. #7712
  • FlightSQL "GetDbSchemas" and "GetTables" schemas do not fully match the protocol #7637 [arrow] [arrow-flight]
  • Cannot read encrypted Parquet file if page index reading is enabled #7629 [parquet]
  • encoding_stats not present in Parquet generated by parquet-rewrite #7616 [parquet]
  • When writing parquet plaintext footer files footer_signing_key_metadata is not included, encryption alghoritm is always written in footer #7599 [parquet]
  • new_null_array panics when constructing a struct of a dictionary #7571
  • Parquet derive fails to build when Result is aliased #7547
  • Unable to read Dictionary(u8, FixedSizeBinary(_)) using datafusion. #7545 [parquet]
  • filter_record_batch panics with empty struct array. #7538 [arrow]
  • Panic in pretty_format function when displaying DurationSecondsArray with i64::MIN / i64::MAX #7533 [arrow]
  • Record API unable to parse TIME_MILLIS when encoded as INT32 #7510 [parquet]
  • The read_record_batch func of the RecordBatchDecoder does not respect the skip_validation property #7508 [arrow]
  • arrow-55.1.0 breaks filter_record_batch #7500
  • Files containing binary data with >=8_388_855 bytes per row written with arrow-rs can't be read with pyarrow #7489 [parquet]
  • [Bug] Ingestion with Arrow Flight Sql panic when the input stream is empty or fallible #7329 [arrow] [arrow-flight]
  • Ensure page encoding statistics are written to Parquet file #7643 [parquet] (etseidl)

Documentation updates:

Closed issues:

  • [Variant] More efficient determination of String vs ShortString #7700
  • [Variant] Improve API for iterating over values of a VariantList #7685 [parquet]
  • [Variant] Consider validating variants on creation (rather than read) #7684 [parquet]
  • Miri test_native_type_pow test failing #7641 [arrow]
  • Improve performance of coalesce and concat for views #7615 [arrow]
  • Bad min value in row group statistics in some special cases #7593
  • Feature Request: BloomFilter Position Flexibility in parquet-rewrite #7552 [parquet]

Merged pull requests:

* This Changelog was automatically generated by github_changelog_generator