2025-10-23 kernel meeting notes

[zachschuermann]

Summary

0.17.0 soon (TM), delta-rs and catalog-managed checkin

Attendees

@zachschuermann @nicklan @mightyshazam @hntd187 @murali-db @roeap @DrakeLin

notes stream

• 0.17.0 timeline
• catalog-managed status
• delta-rs status
  • new contibutors: benchmarks against TPC-DS now
  • tracing: spans/logging
  • kernel helped squash some long standing bugs yay!
  • delta-rs materialized a lot
  • more prefactors
  • landing column mapping
  • no predicate pushdown into parquet read (turn into row group skipping)
• note arrow people are taking back up getting row ids
  • Support file row number in Parquet reader apache/arrow-rs#7299
• VARIANT status
  • path to support in delta-rs?
  • arrow 57 released this morning (VARIANT in experimental feature)
• robert: log replay, scan metadata iterator, get DVInfo for each
  • spawning something to read each
  • make a join set
  • collect at end

follow-ups

• do a test binary to hand to tyler
• @zachschuermann to update summer 2025 kernel work #1184