v1.2.889-nightly

What's Changed

Thoughtful Bug Fix 🔧

• fix(query): avoid reinitializing nullable aggregate states during merge by @dqhl76 in #19544
• fix(query): builtin function names should be case-insensitive regardless of unquoted_ident_case_sensitive by @TCeason in #19537
• fix(http): skip S3 refresh for attached tables in HTTP catalog endpoints by @TCeason in #19548
• fix(planner): decorrelate correlated scalar subquery limit (#13716) by @sundy-li in #19532
• fix(sql): add missing SExpr import in type_check.rs by @zhang2014 in #19550
• fix: flatten IN-list OR predicates by @SkyFan2002 in #19546
• fix(query): scope runtime filter selectivity to bloom by @SkyFan2002 in #19547

Code Refactor 🎉

• refactor: remove legacy table branch/tag implementation by @zhyass in #19534
• refactor(planner): improve consistency of column references and rewrites by @forsaken628 in #19523
• refactor(query): refactor hash shuffle by @zhang2014 in #19505

Others 📒

• chore(query): bump ast to 0.2.5 for Unicode identifier support by @TCeason in #19541

Full Changelog: v1.2.888-nightly...v1.2.889-nightly

v1.2.888-nightly

What's Changed

Exciting New Features ✨

• feat(perf): add per-plan hardware performance counters to EXPLAIN PERF by @dqhl76 in #19493
• feat: support copy into lance dataset. by @youngsofun in #19495
• feat(query): Add spatial statistics to BlockMeta for geospatial range pruning by @b41sh in #19515

Thoughtful Bug Fix 🔧

• fix(query): improve EXPLAIN ANALYZE profiling for meta-only blocks by @forsaken628 in #19514
• fix: trim CR for TSV CRLF record delimiter by @KKould in #19521
• fix(query): try_to_timestamp should return null when convert error by @TCeason in #19527
• fix(query): avoid merge-into unmatched panic (#16885) by @sundy-li in #19529
• fix(query): support unquoted Unicode aliases and identifiers by @TCeason in #19526
• fix(join): project build columns for fast returning left join by @zhang2014 in #19539

Code Refactor 🎉

• refactor(query): replace usize with Symbol as the global column ID for the SQL layer by @forsaken628 in #19517

Build/Testing/CI Infra Changes 🔌

• ci: upgrade go-version. by @youngsofun in #19540

Others 📒

• chore(ut): fix test_sync_agg_index by @TCeason in #19531

Full Changelog: v1.2.887-nightly...v1.2.888-nightly

v1.2.887-nightly

What's Changed

Exciting New Features ✨

• feat(query): batch rank-limit sort with DataBlockVec and fix single-key LimitRank by @forsaken628 in #19510

Thoughtful Bug Fix 🔧

• fix: isolate recursive CTE internal table names per source by @KKould in #19504
• fix(query): prune runtime inlists with block bloom by @SkyFan2002 in #19516

Others 📒

• chore: makefile add heaptracker by @KKould in #19512

Full Changelog: v1.2.886-nightly...v1.2.887-nightly

v1.2.886-nightly

What's Changed

Exciting New Features ✨

• feat: support TSV FIELD_DELIMITER = '' for line-as-string loading by @KKould in #19492

Thoughtful Bug Fix 🔧

• fix(query): short-circuit runtime filter merge on threshold by @SkyFan2002 in #19509
• fix: enable runtime filter for left semi join by @SkyFan2002 in #19511

Full Changelog: v1.2.885-nightly...v1.2.886-nightly

v1.2.885-nightly

What's Changed

Exciting New Features ✨

• feat(query): Support st_hilbert function by @b41sh in #19500
• feat(query): Implement Spatial Index with R-Tree by @b41sh in #19411
• feat: infer_schema() support TSV by @KKould in #19452
• feat(query): reuse source sort key and compact spilled sort streams by @forsaken628 in #19490
• feat(query): support Roman numeral format in to_char (RN/rn) by @forsaken628 in #19501

Code Refactor 🎉

• refactor(query): refactor flight shuffle by @zhang2014 in #19458

Full Changelog: v1.2.884-nightly...v1.2.885-nightly

v1.2.884-nightly

What's Changed

Exciting New Features ✨

• feat(query): support USER/ROLE/STREAM object tagging and references by @TCeason in #19484
• feat(query): restore prefetch for spilled sort blocks by @forsaken628 in #19409
• feat(meta): add config setting to gate meta value compression by @drmingdrmer in #19496

Thoughtful Bug Fix 🔧

• fix(query): replace regex-based block comment lexer with memchr scanner by @TCeason in #19487
• fix(query): tolerate unknown TaggableObject variants in tag reference listing by @TCeason in #19497

Full Changelog: v1.2.883-nightly...v1.2.884-nightly

v1.2.883-nightly

What's Changed

Exciting New Features ✨

• feat(meta): transparent zstd compression and typed serialization for meta KV values by @drmingdrmer in #19465
• feat(query): extend tag support to view, udf, and procedure objects by @TCeason in #19447
• feat: add default_warehouse option to user settings by @everpcpc in #19456
• feat: add sandbox env injection case via cloud control by @KKould in #19383
• feat(query): Support vacuum virtual column by @b41sh in #19459

Thoughtful Bug Fix 🔧

• fix(proto-conv): replace silent u64->usize casts with checked conversion by @drmingdrmer in #19471
• fix: condition should be || not && by @cuiweixie in #19461
• fix: surface errors silently swallowed in log-storage config and grant entries by @drmingdrmer in #19474
• fix: r_cte wrong/flaky results under concurrency by @KKould in #19439
• fix: some queries print query log and profile twice by @dqhl76 in #19455

Code Refactor 🎉

• refactor: merge external-meta-version into MetaClient/MetaService columns by @drmingdrmer in #19460
• refactor: clean up meta crates — simplify Cargo.toml, remove unused deps, and deduplicate code by @drmingdrmer in #19462
• refactor: move meta plugin crates and eliminate unnecessary clones in UserGrantSet by @drmingdrmer in #19466
• refactor(meta): minor structural cleanups in process, control, admin, semaphore by @drmingdrmer in #19470
• refactor(app): deduplicate IdGenerator constructors via new() helper by @drmingdrmer in #19475
• refactor(proto-conv): extract convert_field helper to deduplicate TryFrom boilerplate by @drmingdrmer in #19476
• refactor(proto-conv): standardize BTreeMap conversions to iterator pattern by @drmingdrmer in #19472
• refactor(control): extract lua_call helper to deduplicate Lua API wrappers by @drmingdrmer in #19473
• refactor(api): split create_table into focused sub-functions by @drmingdrmer in #19477
• refactor: optimize final aggregation for large datasets by @dqhl76 in #19360
• refactor(query): optimize system.tables for account_admin with precise filters by @TCeason in #19480
• refactor: replace handle_write with direct MetaNode::write call by @drmingdrmer in #19483
• refactor(query): normalize role mgr api boundaries by @TCeason in #19437

Build/Testing/CI Infra Changes 🔌

• ci(benchmark): enable internal benchmark and reduce load size by @TCeason in #19482

Documentation 📔

• docs(meta): fix broken README links for relocated directories by @drmingdrmer in #19469

Others 📒

• chore: revert Cargo.toml to pre-refactor state for selective review by @drmingdrmer in #19463
• chore: add databend-meta-kv-tests integration test crate for compression by @drmingdrmer in #19467

New Contributors

• @cuiweixie made their first contribution in #19461

Full Changelog: v1.2.882-nightly...v1.2.883-nightly

v1.2.882-nightly

What's Changed

Exciting New Features ✨

• feat: add async function read_file. by @youngsofun in #19426
• feat(query): add privilege check for system.procedures table by @TCeason in #19406
• feat: add --decode-values flag to metactl dump-raft-log-wal by @drmingdrmer in #19448
• feat(copy): support partition by for copy into location by @sundy-li in #19390

Thoughtful Bug Fix 🔧

• fix: upgrade databend-meta crates to v260205.3.0 by @drmingdrmer in #19438
• fix: Eliminate RwLock in SequenceCounter to avoid read-write deadlock issues by @KKould in #19432

Code Refactor 🎉

• refactor(config): dedup query config inner/outer by @dantengsky in #19446
• refactor: meta/proto-conv: simplify conversions and reorganize into submodules by @drmingdrmer in #19453
• refactor: reorganize meta/api into submodules by @drmingdrmer in #19454
• refactor: extract fuse compat test matrix into test_cases.yaml by @dantengsky in #19441

Full Changelog: v1.2.881-nightly...v1.2.882-nightly

v1.2.881-nightly

What's Changed

Thoughtful Bug Fix 🔧

• fix(query): data lost in new hash join caused by spill by @dqhl76 in #19415

Code Refactor 🎉

• refactor(management): simplify UserApi using upsert_pb/get_pb patterns by @TCeason in #19413

Full Changelog: v1.2.880-nightly...v1.2.881-nightly

v1.2.880-nightly

What's Changed

Exciting New Features ✨

• feat: add query-meta version compatibility documentation by @drmingdrmer in #19421
• feat(query): expression evaluator initially support the computation of column statistics by @forsaken628 in #19368

Thoughtful Bug Fix 🔧

• fix(mysql): avoid NOT_NULL for NULL columns by @dantengsky in #19416

Code Refactor 🎉

• refactor(query): Refactor virtual columns refresh into prepare/commit phases by @b41sh in #19395

Full Changelog: v1.2.879-nightly...v1.2.880-nightly