v1.2.879-nightly

What's Changed

Exciting New Features ✨

• feat(query): add procedure admin APIs by @everpcpc in #19396
• feat: CSV/TSV encode tuple/map/array as JSON. by @youngsofun in #19393

Thoughtful Bug Fix 🔧

• fix(query): fix lost data in new join spill by @zhang2014 in #19405
• fix(query): try fix lost data when new join spilled by @dqhl76 in #19408

Others 📒

• chore(ci): apply settings before role validation in session restore by @TCeason in #19358
• chore(tests): batch slow sql suites by @sundy-li in #19386

Full Changelog: v1.2.878-nightly...v1.2.879-nightly

v1.2.878-nightly

What's Changed

Thoughtful Bug Fix 🔧

• fix(mysql): set UNSIGNED_FLAG for unsigned integer columns by @TCeason in #19400
• fix: upgrade raft-log: use pread to prevent race condition in concurrent chunk reads by @drmingdrmer in #19401

Full Changelog: v1.2.877-nightly...v1.2.878-nightly

v1.2.877-nightly

What's Changed

Code Refactor 🎉

• refactor: unify gRPC message size into single config value by @drmingdrmer in #19397

Full Changelog: v1.2.876-nightly...v1.2.877-nightly

v1.2.876-nightly

What's Changed

Thoughtful Bug Fix 🔧

• fix: on_error_mode not work in transform. by @youngsofun in #19387
• fix: empty database name by @SkyFan2002 in #19389

Full Changelog: v1.2.875-nightly...v1.2.876-nightly

v1.2.875-nightly

What's Changed

Thoughtful Bug Fix 🔧

• fix: fix and polish format settings. by @youngsofun in #19373

Code Refactor 🎉

• refactor(query): Refactor virtual columns storage & read planning by @b41sh in #19284
• refactor(query): enable experimental new join by default by @zhang2014 in #19388

Others 📒

• chore(ci): Optimize the tests related to stateless permissions by @TCeason in #19382

Full Changelog: v1.2.874-nightly...v1.2.875-nightly

v1.2.874-nightly

What's Changed

Exciting New Features ✨

• feat: support independent schema for table branches by @zhyass in #19269
• feat: preliminary support for common subexpression elimination by @SkyFan2002 in #19351
• feat: CSV support multi-bytes field delimiter. by @youngsofun in #19355
• feat: support LATERAL for generate_series by @KKould in #19349
• feat: Sandbox UDF by @KKould in #19301
• feat(query): Support Geography functions by @b41sh in #19320
• feat: support prune columns for materialized cte by @SkyFan2002 in #19362

Thoughtful Bug Fix 🔧

• fix(query): respect null ordering in topn pruner by @sundy-li in #19317
• fix: enhance feature verification logic by @dqhl76 in #19359

Code Refactor 🎉

• refactor: extract HTTP admin API to standalone crate databend-meta-admin by @drmingdrmer in #19335
• refactor: group gRPC and admin config fields into nested structs by @drmingdrmer in #19336
• refactor: use TlsConfig in HttpServiceConfig by @drmingdrmer in #19337
• refactor: embed KvApiArgs in Config by @drmingdrmer in #19338
• refactor: move CLI config parsing to separate crate by @drmingdrmer in #19339
• refactor: remove databend-common-base dependency from raft-store by @drmingdrmer in #19341
• refactor: move CLI fields out of MetaServiceConfig into MetaConfig by @drmingdrmer in #19342
• refactor: replace local count module with databend-base counter by @drmingdrmer in #19343
• refactor: add trace_request to SpawnApi for server-side tracing by @drmingdrmer in #19346
• refactor: simplify port allocation in meta-store to use OS-assigned ports by @drmingdrmer in #19352
• refactor(meta): reorganize tests and use lightweight runtime for meta service by @drmingdrmer in #19354
• refactor: move HTTP endpoint tests to admin crate by @drmingdrmer in #19356
• refactor: move module tag registration from client to store crate by @drmingdrmer in #19365
• refactor: add connect method to SpawnApi for channel creation by @drmingdrmer in #19370
• refactor: decouple meta core crates from databend dependencies by @drmingdrmer in #19372
• refactor: remove databend-common-meta-api dependency from meta-service by @drmingdrmer in #19374

Documentation 📔

• docs: update meta README to reflect current directory structure by @drmingdrmer in #19348
• docs: rebrand Databend as AI agent-ready enterprise data warehouse by @bohutang in #19379

Others 📒

• chore: set correct engine name for StageTable and StageSinkTable by @SkyFan2002 in #19347
• chore(query): replacing closures in FunctionEval with traits by @forsaken628 in #19316
• chore(sqllogic): add tutorial test by @TCeason in #19353
• chore: fix lint by @drmingdrmer in #19361
• chore: fix lint by @drmingdrmer in #19363
• chore: fix stateless test timeout by @b41sh in #19367
• chore: fix lint by @drmingdrmer in #19371

Full Changelog: v1.2.873-nightly...v1.2.874-nightly

v1.2.873-nightly

What's Changed

Code Refactor 🎉

• refactor: decouple meta-service from databend-common-base runtime by @drmingdrmer in #19319
• refactor: remove MetaStorageError and delete stoerr crate by @drmingdrmer in #19322
• refactor: use DatabendRuntime::spawn in meta binaries by @drmingdrmer in #19324
• refactor: make meta-client generic over RuntimeApi by @drmingdrmer in #19327
• refactor: add SpawnApi::prepare_request() for gRPC metadata injection by @drmingdrmer in #19329
• refactor: move 7 server-side meta crates to src/meta/core/ by @drmingdrmer in #19332
• refactor: remove environment variable configuration for metasrv by @drmingdrmer in #19333

Documentation 📔

• docs: clean up and improve README formatting by @bohutang in #19331

Others 📒

• chore: adjust lazy read setting by @SkyFan2002 in #19318

Full Changelog: v1.2.872-nightly...v1.2.873-nightly

v1.2.872-nightly

What's Changed

Exciting New Features ✨

• feat(query): add nested loop join for new experimental hash join by @forsaken628 in #18961
• feat: support prewhere for fuse parquet by @SkyFan2002 in #19209
• feat(query): Support CREATE/DROP SPATIAL INDEX (Geometry/Geography types) by @b41sh in #19314

Thoughtful Bug Fix 🔧

• ci(test): enable profile configuration during test runs by @dqhl76 in #19245
• fix: preserve IO error kind in codec decoder for raft log recovery by @drmingdrmer in #19315
• fix: drop/replace stage fail to delete files on OSS. by @youngsofun in #19321

Code Refactor 🎉

• refactor(query): refactor hybrid hash join for new join by @zhang2014 in #19307
• refactor(query): optimize system tables filter with lightweight permission check by @TCeason in #19293

Build/Testing/CI Infra Changes 🔌

• ci: reopen compat tests for py driver. by @youngsofun in #19310

Full Changelog: v1.2.871-nightly...v1.2.872-nightly

v1.2.871-nightly

What's Changed

Exciting New Features ✨

• feat: add table function for inspecting Parquet pages by @SkyFan2002 in #19278
• feat: introducing DataBlockVec to optimize multiple data block take by @forsaken628 in #19249
• feat: eliminate constant subquery by @KKould in #19289
• feat: enhance binary input and output format by @KKould in #19246
• feat: enable lazy materialization across joins with outer-join NULL handling by @SkyFan2002 in #19295

Thoughtful Bug Fix 🔧

• fix: compile error by @SkyFan2002 in #19298
• fix: add TrackingPayloadExt trait for ergonomic future tracking by @drmingdrmer in #19296
• fix: drain gRPC stream in get_kv() to prevent h2 reset errors by @drmingdrmer in #19302
• fix(cloud): clamp task run pagination by @sundy-li in #19297
• fix: in_memory_table_data_cache should use memory size of array instead of buffer size. by @youngsofun in #19305
• fix: cluster key consistency during ALTER TABLE column by @zhyass in #19300
• chore(query): reapply iceberg bump by @sundy-li in #19304

Code Refactor 🎉

• refactor: use hickory-resolver directly in raft-store for DNS resolution by @drmingdrmer in #19288
• refactor: replace custom JoinHandle wrapper with From impl by @drmingdrmer in #19291
• refactor(query): support pushdown rules with SecureFilter for row access policy by @TCeason in #19274
• refactor: use io::Error instead of MetaStorageError in sled-store by @drmingdrmer in #19292

Full Changelog: v1.2.870-nightly...v1.2.871-nightly

v1.2.870-nightly

What's Changed

Exciting New Features ✨

• feat: table branch support insert by @zhyass in #19225
• feat: adjust columns of system.stages and show stages by @youngsofun in #19257

Thoughtful Bug Fix 🔧

• fix: out of bound on recursive cte & coercion_types left right not match on recursive scan by @KKould in #19212
• fix: send responses only after state machine commit by @drmingdrmer in #19286

Code Refactor 🎉

• refactor(meta): decouple meta crates and improve stream error handling by @drmingdrmer in #19263
• refactor: simplify location capture in location_future by @drmingdrmer in #19267
• refactor: move Pool from common-base to meta-client by @drmingdrmer in #19273
• refactor: remove implicit From<MetaError> for ErrorCode trait by @drmingdrmer in #19275
• refactor: simplify Pool struct and retry loop by @drmingdrmer in #19276
• refactor: replace BuildInfoRef with semver::Version in meta-client by @drmingdrmer in #19277
• refactor: simplify KVAppError handling with into_nested() by @drmingdrmer in #19280
• refactor: replace local uniq_id and drop_callback with databend-base by @drmingdrmer in #19279
• refactor: replace BuildInfoRef with semver::Version in RpcClientConf by @drmingdrmer in #19281
• refactor: simplify Runtime by extracting common spawn and builder logic by @drmingdrmer in #19282
• refactor: use anyhow::Result for test function return types by @drmingdrmer in #19283
• refactor: simplify control flow in Runtime methods by @drmingdrmer in #19285

Others 📒

• chore: update version for kv_list and kv_get_many features by @drmingdrmer in #19270
• chore: remove sqllogicttest warnings by @KKould in #19256

Full Changelog: v1.2.869-nightly...v1.2.870-nightly