chore: modified add_actions_table to stream#3836

Closed

zen-zap wants to merge 2361 commits intodelta-io:mainfrom

This pull request is big! We're only showing the most recent 250 commits

Commits on May 18, 2025

Commits on May 19, 2025

test: avoid circular dependency with core/test crates
roeap
committed

Commits on May 20, 2025

refactor: use LogStore in Snapshot / LogSegment APIs
roeap
committed

Commits on May 22, 2025

Commits on May 23, 2025

Commits on May 24, 2025

Commits on May 25, 2025

Commits on May 26, 2025

refactor: remove protocol error
roeap
committed
feat: add table description and name API for Python

fvaleye
authored and
ion-elgreco
committed
feat: add validator crate and use to have update table metadata validation in Rust

fvaleye
authored and
ion-elgreco
committed

Commits on May 27, 2025

chore: remove unused stats parsed field
roeap
committed

Commits on May 28, 2025

Commits on May 29, 2025

chore: update runner

ion-elgreco
authored and
roeap
committed
ci: improve coverage collection

roeap
authored and
rtyler
committed
chore: prepare for the next python release

rtyler
authored and
ion-elgreco
committed
chore!: remove get_earliest_version
roeap
committed

Commits on Jun 3, 2025

refactor: compute stats schema with kernel types
roeap
committed

Commits on Jun 7, 2025

chore: set java version to 21
ion-elgreco
committed
chore: disable ansi
ion-elgreco
committed
refactor: remove unecessary uses of datafusion subcrates

alamb
authored and
ion-elgreco
committed

Commits on Jun 16, 2025

chore: pin aws crates
ion-elgreco
committed
fix: using arg state in execute

gtrawinski
authored and
rtyler
committed
chore: removed _ from state arg

gtrawinski
authored and
rtyler
committed

Commits on Jun 18, 2025

Commits on Jun 28, 2025

chore: update arrow/parquet to 55.2.0

alamb
authored and
rtyler
committed

Commits on Jun 29, 2025

Commits on Jun 30, 2025

docs: ensure create_checkpoint() is visible in the Python API docs

pythonspeed
authored and
ion-elgreco
committed

Commits on Jul 1, 2025

fix: use new DeltaTableState for subsequent commits and return value on Vacuum operation

jeromegn
authored and
ion-elgreco
committed

Commits on Jul 4, 2025

chore: remove redundant words in comment

shangchenglumetro
authored and
roeap
committed

Commits on Jul 5, 2025

refactor: move schema code to kernel module
roeap
committed

Commits on Jul 6, 2025

feat: convert partition filters to kernel predicates
roeap
committed

Commits on Jul 7, 2025

chore: latest clippy
roeap
committed

Commits on Jul 9, 2025

chore: remove the deltalake-sql crate
rtyler
committed
write engineInfo

zachschuermann
authored and
roeap
committed

Commits on Jul 12, 2025

feat!: use kernel Metadata action

roeap
authored and
rtyler
committed
feat!: use kernel Protocol action

roeap
authored and
rtyler
committed
chore: add comments docstring and deprecations

roeap
authored and
rtyler
committed
chore: upgrade to the latest kernel 0.13.0
rtyler
committed

Commits on Jul 14, 2025

chore: generate a more recentish updated changelog

rtyler
authored and
ion-elgreco
committed
Gate RetryConfig on 'cloud' feature

zeevm
authored and
rtyler
committed
feat: utilize StorageConfig for the log store's parse_url_opts
rtyler
committed
chore: Exclude typos in the changelog :laughing:
rtyler
committed
feat: remove redundant Handle from parse_url_opts
rtyler
committed
Creating new DeltaTable uses from_valid_url instead of from_url

smeyerre
authored and
rtyler
committed
Add test for attemping to create DeltaTable with invalid path

smeyerre
authored and
rtyler
committed

Commits on Jul 19, 2025

fix: fix typo to fix CI typo check

alamb
authored and
rtyler
committed
fix: scan time was always 0 for merge metrics

alexwilcoxson-rel
authored and
rtyler
committed
chore: add a validation of scan_time_ms into assert_merge
rtyler
committed

Commits on Jul 22, 2025

Commits on Jul 23, 2025

Commits on Jul 24, 2025

Commits on Jul 27, 2025

chore: Update to DataFusion 49.0.0

alamb
authored and
rtyler
committed
chore: Update to Rust version 1.85

alamb
authored and
rtyler
committed
chore: finish datafusion 49 upgrade
rtyler
committed

Commits on Jul 29, 2025

Commits on Jul 30, 2025

chore: use pytest-xdist for speeding up python tests
rtyler
committed

Commits on Aug 5, 2025

Commits on Aug 7, 2025

Commits on Aug 8, 2025

chore: bump python
ion-elgreco
committed

Commits on Aug 16, 2025

feat!: kernel log replay

roeap
authored and
rtyler
committed
test: fix python tests after kernel log replay

roeap
authored and
rtyler
committed
fix: refresh log store before log scans (#3659)

roeap
authored and
rtyler
committed
fix: align stats schema with delta-spark implementation (#3663)

roeap
authored and
rtyler
committed
refactor!: deprecate protocol, metadata, and schema methods on DeltaTable

roeap
authored and
rtyler
committed
refactor!: deprecate get_files_iter on DeltaTable

roeap
authored and
rtyler
committed
refactor: remove redundant NoMetadataError

roeap
authored and
rtyler
committed
refactor!: use kernel TableProperties

roeap
authored and
rtyler
committed
chore: introduce a regression test to demonstrate reading of v2 checkpoints
rtyler
committed

Commits on Aug 18, 2025

chore: update hdfs object store to 0.15 (#3681)
Kimahriman
authored

Commits on Aug 24, 2025

Commits on Aug 25, 2025

fix(format): fix formatting in Python for conversion file
fvaleye
committed
chore: remove unused dependencies
rtyler
committed
fix: enabling correctly pulling partition values out of column mapped tables
rtyler
committed
refactor: simplify file view iterators

roeap
authored and
rtyler
committed
feat: use kernel file skipping for getting files by partition

roeap
authored and
rtyler
committed
refactor: move file (action) apis async/stream

roeap
authored and
rtyler
committed
refactor: update method invocations to prepare migrations

roeap
authored and
rtyler
committed
refactor: use replace EagerSnapshot with LogDataHandler in conflict checks

roeap
authored and
rtyler
committed
chore: remove unnecessary parse_scalar function
rtyler
committed
docs: add some RustDocs

roeap
authored and
rtyler
committed
test: add some test for logical file view

roeap
authored and
rtyler
committed
Update crates/core/src/kernel/snapshot/mod.rs

rtyler
and
ion-elgreco
committed

Commits on Aug 27, 2025

fix: reintroduce the 100 commit checkpoint interval
rtyler
committed

Commits on Aug 28, 2025

Commits on Aug 29, 2025

Commits on Aug 30, 2025

chore: remove unused json module

roeap
authored and
rtyler
committed
feat: domain metadata read support

roeap
authored and
rtyler
committed
chore!: remove deprecated methods

roeap
authored and
rtyler
committed

Commits on Sep 1, 2025

refactor: move table provider to dedicated mod (#3726)
roeap
authored

Commits on Sep 2, 2025

Commits on Sep 3, 2025

Commits on Sep 7, 2025

fix: re-export the DecimalType for consumers
rtyler
committed

Commits on Sep 10, 2025

fix schema

FrankPortman
authored and
rtyler
committed
test and fmt

FrankPortman
authored and
rtyler
committed
add merge test

FrankPortman
authored and
rtyler
committed

Commits on Sep 11, 2025

feat: add per column Parquet Encoding support for Delta Table column (#3737)

niltecedu
and
Copilot
authored

Commits on Sep 12, 2025

fix: better error handles in unity client (#3752)
hntd187
authored

Commits on Sep 16, 2025

feat(datafusion): add insert_into operation to TableProvider and expose it via SQL through DataSink

fvaleye
authored and
rtyler
committed

Commits on Sep 17, 2025

fix: ensure that invalid URLs are bubbled up as errors when parsed
rtyler
committed

Commits on Sep 18, 2025

Commits on Sep 19, 2025

feat: update to DataFusion 50, pyo3 24, pyo3-arrow 0.11 (#3749)
alamb
authored

Commits on Sep 22, 2025

chore: pin cargo-machete action to the sha right before a regression
rtyler
committed

Commits on Sep 24, 2025

Signed-off-by: ohadmata <[email protected]>

ohadmata
authored and
fvaleye
committed
Signed-off-by: ohadamta <[email protected]>

ohadmata
authored and
fvaleye
committed
Signed-off-by: ohadmata <[email protected]>

ohadmata
authored and
fvaleye
committed
chore: add a regression test for the DeltaTable.count() method

rtyler
authored and
fvaleye
committed

Commits on Sep 25, 2025

fix: somehow the right test value didn't make it into the pr
rtyler
committed

Commits on Sep 27, 2025

Commits on Sep 30, 2025

Commits on Oct 1, 2025

Commits on Oct 2, 2025

feat: allow passing a `SessionState` into a `OptimizeBuilder` (#3802)
abhi-airspace-intelligence
authored

Commits on Oct 3, 2025

Commits on Oct 5, 2025

ci: split out integration tests (#3806)
roeap
authored
feat: access tombstones via TombstoneView (#3809)
roeap
authored
refactor: use EagerSnapshot in vacuum operation #3784 (#3812)
roeap
authored
fix: track log files as vec of batches

roeap
authored and
rtyler
committed
feat: process log repaly on stream

roeap
authored and
rtyler
committed
fix: track single representation of file stats #3371

roeap
authored and
rtyler
committed
refactor: better log data processing isolation

roeap
authored and
rtyler
committed
refactor: avoid downcasting to SessionState (#3813)
roeap
authored
add deletion_vector_descriptor method

zeevm
authored and
rtyler
committed
chore: add some rustdoc for a new/temporary public method
rtyler
committed
refactors: move find_files into dedicated mod (#3815)
roeap
authored

Commits on Oct 6, 2025

Commits on Oct 7, 2025

feat: expose arrow schema on snapshots (#3822)
roeap
authored

Commits on Oct 8, 2025

fix: update deprecation versions to next release (#3828)
roeap
authored

Commits on Oct 9, 2025

chore: unify inconsistent `SessionState` in datafusion operations (#3816)
abhi-airspace-intelligence
authored

Commits on Oct 10, 2025

fix: Protect recently written uncommitted files in vacuum Full mode

Manish Sogiyawar
authored and
rtyler
committed

Commits on Oct 11, 2025

Commits on Oct 13, 2025

Commits on Oct 14, 2025

feat: datafusiuon based kernel engine

roeap
authored and
rtyler
committed

Commits on Oct 15, 2025