v1.2.918-nightly

What's Changed

Exciting New Features ✨

• feat(time-travel): add NO_CHECK for snapshot direct lookup by @dantengsky in #19763

Thoughtful Bug Fix 🔧

• fix(query): unblock failed private task runs by @KKould in #19965

Code Refactor 🎉

• refactor(query): make aggregate payload lifecycle explicit by @forsaken628 in #19967

Build/Testing/CI Infra Changes 🔌

• ci: remove bendsave from release and upgrade github actions by @everpcpc in #19964

Full Changelog: v1.2.917-nightly...v1.2.918-nightly

v1.2.917-nightly

What's Changed

Exciting New Features ✨

• feat(query): virtual column support materialized cte by @b41sh in #19902
• feat(query): add local admin handlers for tenant-prefixed routes by @everpcpc in #19956

Thoughtful Bug Fix 🔧

• fix(query): align private task history with cloud by @KKould in #19943
• fix(query): stabilize pivot any rewrite by @KKould in #19949
• fix(binder): allow unresolved complex GROUP BY alias fallback by @forsaken628 in #19958
• fix(query): avoid nested window plans by @sundy-li in #19933
• fix(query): escape rewritten SQL string literals by @KKould in #19957
• fix(storage): make vacuum2 block deletion incremental by @SkyFan2002 in #19960

Code Refactor 🎉

• refactor(storage): limit concurrent io operations by @dqhl76 in #19948

Build/Testing/CI Infra Changes 🔌

• ci(release): add custom release type and restrict sha to custom only by @everpcpc in #19950
• ci: guard nightly docker tag updates by @youngsofun in #19959

Others 📒

• chore(deps): bump openssl from 0.10.72 to 0.10.80 by @dependabot[bot] in #19893

Full Changelog: v1.2.916-nightly...v1.2.917-nightly

v1.2.916-nightly

What's Changed

Exciting New Features ✨

• feat(query): refine ndjson infer schema by @youngsofun in #19928
• feat(query): add proxy table engine MVP by @KKould in #19924

Thoughtful Bug Fix 🔧

• fix(query): bound ANALYZE statistics commit retry by @zhyass in #19942
• fix(query): use to_hex instead of hex in stream change tracking row ID generation by @zhyass in #19945

Code Refactor 🎉

• refactor(query): split stage and file format resolution from TableContext by @forsaken628 in #19938
• refactor(query): centralize interpreter execution hooks by @dqhl76 in #19865

Documentation 📔

• docs(query): add proxy engine design by @sundy-li in #19920

Others 📒

• chore: add meta-to-meta (raft) compatibility docs by @drmingdrmer in #19947

Full Changelog: v1.2.915-nightly...v1.2.916-nightly

v1.2.768-patch.1

Full Changelog: v1.2.916-nightly...v1.2.768-patch.1

v1.2.915-nightly

What's Changed

Exciting New Features ✨

• feat(query): improve RECLUSTER FINAL task scheduling by @zhyass in #19914
• feat(query): support materialized CTE spilling by @SkyFan2002 in #19881
• feat(binder): improve histogram-based filter and join statistics propagation by @forsaken628 in #19906
• feat(sql): support nested lambda functions by @bohutang in #19936

Thoughtful Bug Fix 🔧

• fix(storage): run runtime min-max before bloom by @SkyFan2002 in #19925
• fix(storage): handle Decimal64 in replace-into row hash by @dantengsky in #19935
• fix(storage): project parquet array tuple fields by @youngsofun in #19934
• fix(storage): separate variable row hash fields by @SkyFan2002 in #19937
• fix(query): require alter for copy schema evolution by @youngsofun in #19932
• fix(storage): deduplicate file paths in remove_file_in_batch to prevent opendal hang by @dantengsky in #19939

Others 📒

• chore(deps): patch parquet to datafuse-extras arrow-rs by @zhang2014 in #19929

Full Changelog: v1.2.914-nightly...v1.2.915-nightly

v1.2.914-nightly

What's Changed

Exciting New Features ✨

• feat: add runtime watchdog task dumps by @dqhl76 in #19917

Thoughtful Bug Fix 🔧

• fix(query): resolve ndjson tuple fields by name by @youngsofun in #19916
• fix(binder): type check UDF and NOT LIKE ESCAPE regressions by @forsaken628 in #19907
• fix(query): handle regexp_instr position overflow by @KKould in #19910
• fix(query): include scalar function params in agg index key by @KKould in #19919
• fix: duplicated "and" in virtual_column_reader.rs comment by @vip892766gma in #19860
• fix(query): handle sub_bitmap offset beyond cardinality by @KKould in #19894
• fix(query): centralize conversion safety checks by @KKould in #19845
• fix(query): improve private task compatibility by @KKould in #19918

Code Refactor 🎉

• refactor(query): planner cache key remove tenant by @TCeason in #19904
• refactor(query): materialize srf tuples by return type by @KKould in #19895
• refactor(sql): Skip redundant Filter [SECURE] when prewhere covers all secure predicates by @TCeason in #19923

Others 📒

• chore: include runtime name in async task dumps by @dqhl76 in #19911
• chore(query): dump slow async running graph separately by @dqhl76 in #19926
• chore(query): expose query hashes in system processes by @dqhl76 in #19927

New Contributors

• @vip892766gma made their first contribution in #19860

Full Changelog: v1.2.913-nightly...v1.2.914-nightly

v1.2.913-nightly

What's Changed

Exciting New Features ✨

• feat(query): support ndjson copy schema evolution by @youngsofun in #19900
• feat(meta): use PutSequential table locks by @drmingdrmer in #19913

Thoughtful Bug Fix 🔧

• fix(query): use session function context in range join by @KKould in #19901
• fix(query): validate security policy metadata in planner cache by @TCeason in #19897
• fix(query): improve modulo and decimal selectivity stats by @forsaken628 in #19837
• fix: fix typo of infer_schema argument. by @youngsofun in #19908
• fix(bind): make SELECT alias resolution clause-aware by @forsaken628 in #19855

Code Refactor 🎉

• refactor: upgrading arrow-rs to 58.1.0 by @SkyFan2002 in #19684

Documentation 📔

• docs: update local Python quick start by @sundy-li in #19883

Full Changelog: v1.2.912-nightly...v1.2.913-nightly

v1.2.912-nightly

What's Changed

Exciting New Features ✨

• feat(query): support full outer asof join by @KKould in #19859
• feat(query): support ISO 8601 interval durations by @KKould in #19877
• feat(query): support variant array concat by @KKould in #19869
• feat(functions): add DATE_FROM_PARTS, TIMESTAMP_FROM_PARTS and TIMESTAMP_TZ_FROM_PARTS by @KKould in #19873
• feat: add block depth to clustering statistics by @zhyass in #19858
• feat(query): support ASOF JOIN USING by @KKould in #19862
• feat(query): add admin API for clustering information by @zhyass in #19885
• feat(query): push Row Access Policy predicates into prewhere for storage-level pruning by @TCeason in #19875
• refactor(sql): split type checking into CoreExpr modules by @forsaken628 in #19829
• feat(query): add CONV scalar function by @KKould in #19892

Thoughtful Bug Fix 🔧

• fix(query): avoid blocking Tokio by refactoring pipeline interface to async pattern by @dqhl76 in #19854
• fix(storage): avoid higher-level recluster starvation by @zhyass in #19844
• fix(query): rebuild join key histograms after join by @forsaken628 in #19880
• fix(query): account for NaN in inverse trig domains by @KKould in #19890
• fix(query): support non-padded date auto detect by @KKould in #19888
• fix(query): avoid blocking during statistics sender shutdown by @dqhl76 in #19887
• fix(storage): retry binary fuse32 with expanded capacity by @SkyFan2002 in #19884
• fix(query): reject negative factorial inputs by @KKould in #19891
• fix(cluster): close exchange buffer on send error by @dqhl76 in #19857

Code Refactor 🎉

• refactor: remove explicit meta dependency keys by @drmingdrmer in #19870
• refactor: replace legacy meta primitive id by @drmingdrmer in #19876
• refactor: remove raw u64 value decoder by @drmingdrmer in #19879
• refactor(query): fold CASE WHEN / if with constant conditions in ConstantFolder by @TCeason in #19874
• chore: add recluster benchmark scripts by @sundy-li in #19871
• refactor: simplify name-id-value helpers by @drmingdrmer in #19882
• refactor(query): compact virtual column metadata encoding by @b41sh in #19878

Others 📒

• chore: bump databend-meta to 260512.3.0 by @drmingdrmer in #19898

Full Changelog: v1.2.911-nightly...v1.2.912-nightly

v1.2.911-nightly

What's Changed

Exciting New Features ✨

• feat(storage): add role_arn support for OSS connections by @everpcpc in #19824
• feat(query): add geometry scalar functions by @TCeason in #19847
• feat: add tenant dump filtering by @drmingdrmer in #19868
• feat(query): add is_role_in_session funciton by @TCeason in #19867

Thoughtful Bug Fix 🔧

• fix(query): improve empty stage select error by @youngsofun in #19846
• fix(storage): prune integer columns with string literals by @SkyFan2002 in #19852
• fix(query): isolate auto materialized CTE names by @SkyFan2002 in #19853

Code Refactor 🎉

• refactor: meta: Use released databend-meta optimization tags by @drmingdrmer in #19861
• refactor: use base2 histogram in metabench by @drmingdrmer in #19864
• refactor(optimize): ST_COVERS, ST_COVEREDBY support spatial index by @TCeason in #19866

Build/Testing/CI Infra Changes 🔌

• ci: stabilize admin status test by @youngsofun in #19849

Documentation 📔

• docs: clarify PR title format by @youngsofun in #19850

Others 📒

• chore(ci): fix flaky ci by @TCeason in #19851

Full Changelog: v1.2.910-nightly...v1.2.911-nightly

v1.2.910-nightly

What's Changed

Exciting New Features ✨

• feat(storage): use from_slice instead of from_reader for NDJSON parsing by @bohutang in #19843

Thoughtful Bug Fix 🔧

• fix(query): drop window aggregate state before reset by @sundy-li in #19841
• fix(iceberg): handle s3 credential aliases by @sundy-li in #19818
• fix(query): refine infer filter type compatibility by @KKould in #19816
• fix(query): publish http stream errors before abort by @youngsofun in #19839
• fix(query): avoid group by alias shadowing by @dantengsky in #19814

Others 📒

• chore(storage): Support table-level auto compaction threshold after write by @zhyass in #19842

Full Changelog: v1.2.909-nightly...v1.2.910-nightly