Releases: Altinity/ClickHouse
25.2.2.28788 Altinity Antalya
Changes compared to v25.2.2.27772.altinityantalya (319e424)
New Feature
- Cache for listobjects calls. (#743 by @arthurpassos)
Improvement
- Iceberg table pruning in cluster requests. (#770 by @ianton-ru)
Bug Fix (user-visible misbehavior in an official stable release)
- Fixed format detection for table function
iceberg
(fixes #732). (#746 by @ianton-ru) - Fix filling addresses_with_failover with correct addresses. (#750 by @ianton-ru)
- Fix macros for autodiscovery clusters. (#757 by @ianton-ru)
- Rendevous hashing was not work properly in complex queries. (#760 by @ianton-ru)
- Fix some tests and virtual methods. (#761 by @ianton-ru)
Build/Testing/Packaging Improvement
- Migrate the GitLab CI/CD to GitHub and remove most jobs to focus on sign and release task. (#758 by @MyroTk)
- Fix build. (#747 by @ianton-ru)
Full Changelog: v25.2.2.27772.altinityantalya...v25.2.2.28788.altinityantalya
Packages
Available for both AMD64 and Aarch64 from https://builds.altinity.cloud/ as either .deb
, .rpm
, or .tgz
Docker images
Available for both AMD64 and Aarch64: altinity/clickhouse-server:25.2.2.28788.altinityantalya
25.2.2.27772 Altinity Antalya
Changes compared to v25.2.2.27732.altinityantalya (11d0423)
Performance Improvement
- Lazy load metadata for metadata for DataLake. (#742 by @ianton-ru)
Improvement
- Improve performance of hive path parsing by using extractKeyValuePairs instead of regex (ClickHouse#79067 by @arthurpassos via #734)
Bug Fix (user-visible misbehavior in an official stable release)
- Fix reading iceberg failed when min-max value is null. (ClickHouse#78764 by @ucasfl via #738)
Full Changelog: v25.2.2.27732.altinityantalya...v25.2.2.27772.altinityantalya
Packages
Available for both AMD64 and Aarch64 from https://builds.altinity.cloud/ as either .deb
, .rpm
, or .tgz
Docker images
Available for both AMD64 and Aarch64: altinity/clickhouse-server:25.2.2.27772.altinityantalya
25.2.2.27732 Altinity Antalya
Changes compared to v25.2.2.27662.altinityantalya (b9b80e4c)
Performance improvements
- Support Iceberg data pruning based on lower_bound and uppert_bound values for columns (ClickHouse#78242 by @alesapin via #733)
- Implement trivial count optimization for Iceberg. Now queries with count() and without any filters should be faster. (ClickHouse#78090 by @alesapin via #733)
Improvements
- Support partition pruning in delta lake. (ClickHouse#78486 by @kssenii via #733)
- In StorageDeltaLake with delta-kernel-rs implementation, fix performance and progress bar (ClickHouse#78368 by @kssenii via #733)
- Allow to explicitly specify metadata file to read for Iceberg with storage/table function setting
iceberg_metadata_file_path
(ClickHouse#77318 by @alesapin via #733) - Implemented parsing enhancements (Sequence ID parsing: Added functionality to parse sequence identifiers in manifest files AND Avro metadata parsing: Redesigned the Avro metadata parser to be easily extendable for future enhancements) (ClickHouse#75010 by @divanik via #733)
New features
- Support IcebergMetadataFilesCache, which will store manifest files/list and metadata.json in one cache. (ClickHouse#77156 by @hanfei1991 via #733)
- Allows a user to query the state of an Iceberg table as it existed at a previous point in time. (ClickHouse#77439 by @divanik via #733)
- Add 3 new functions.
icebergTruncate
according to specification. https://iceberg.apache.org/spec/#truncate-transform-details,toYearNumSinceEpoch
andtoMonthNumSinceEpoch
. Support truncate transform in partition pruning forIceberg
engine. (ClickHouse#77403 by @alesapin via #733)
Bug fixes
- The subpath inside the table directory is chosen in a more profound way (ClickHouse#76681 by @divanik via #733)
Full Changelog: v25.2.2.27662.altinityantalya...v25.2.2.27732.altinityantalya
Packages
Available for both AMD64 and Aarch64 from https://builds.altinity.cloud/ as either .deb
, .rpm
, or .tgz
Docker images
Available for both AMD64 and Aarch64: altinity/clickhouse-server:25.2.2.27732.altinityantalya
25.2.2.27662 Altinity Antalya
Changes compared to v24.12.2.20203.altinityantalya (4ef80639)
Improvements
- Use Iceberg function/engine with storage type as parameter instead of IcebergS3/IcebergAzure/IcebergHDFS (#675 by @ianton-ru)
- Convert functions with object_storage_cluster setting to cluster functions (#712 by @ianton-ru)
- object_storage_max_nodes (#677 by @ianton-ru)
- Better object storage cache locality with Rendezvous hashing (#709 by @ianton-ru)
- s3Cluster hive partitioning for old analyzer (#703 by @ianton-ru)
- Fix incorrect S3 uri parsing when key is not specified on path style. (ClickHouse#78185 by @arthurpassos via #700)
New features
- Added AWS IAM role assumption in
s3
table function when explicit AWS credentials are specified andextra_credentials
argument containsroleARN
(#688 by @zvonand) - Parquet File Metadata caching (#586, #636, #662, and #674 by @arthurpassos)
SYSTEM DROP PARQUET METADATA CACHE
command (#713 by @arthurpassos)
Bug fixes
- Fix usage S3 table function as table (#719 by @ianton-ru)
- Fix s3 partition wildcard (#720 by @ianton-ru)
- Fix initialization order of metadata (#710 by @arthurpassos)
Full Changelog: v24.12.2.20203.altinityantalya...v25.2.2.27662.altinityantalya
Packages
Available for both AMD64 and Aarch64 from https://builds.altinity.cloud/ as either .deb
, .rpm
, or .tgz
Docker images
Available for both AMD64 and Aarch64: altinity/clickhouse-server:25.2.2.27662.altinityantalya
24.8.14.10459 Altinity Stable update
Changes compared to upstream's v24.8.14.39-lts
Bug Fixes (user-visible misbehavior in an official stable release)
- To avoid spamming the server logs, failing authentication attempts are now logged at level
DEBUG
instead ofERROR
. (ClickHouse#71405 by @rschu1ze via #651) - Fix an exception of TOO_LARGE_ARRAY_SIZE caused when a column of arrayWithConstant evaluation is mistaken to cross the array size limit. (ClickHouse#71894 by @udiz via #650)
- Cross port of the fix to avoid reusing connections that had been left in the intermediate state. (ClickHouse#74749 by @azat via #678)
Improvements
ALTER TABLE .. REPLACE PARTITION
doesn't wait anymore for mutations/merges that happen in other partitions (ClickHouse#59138 by @Enmk & @zvonand via #638)- Respect
prefer_locahost_replica
when building plan for distributedINSERT ... SELECT.
(ClickHouse#72190 by @filimonov via #657) - Support parquet integer logical types on native reader. (ClickHouse#72105 by @arthurpassos via #680)
- Evaluate parquet bloom filters and min/max indexes together. (ClickHouse#71383 by @arthurpassos via #681)
- Improve query_plan_merge_filters optimization (ClickHouse#71539 by @KochetovNicolai via #640)
Packages
Available for both AMD64 and Aarch64 from https://builds.altinity.cloud/ as either .deb
, .rpm
, or .tgz
Docker images
Available for both AMD64 and Aarch64: altinity/clickhouse-server:24.8.14.10459.altinitystable
New Contributors
Full Changelog: v24.8.11.51285.altinitystable...v24.8.14.10459.altinitystable
24.12.2.20203 Altinity Antalya
Changes compared to v24.12.2.20101.altinityantalya (15e2755f888)
Bug Fix (user-visible misbehavior in an official stable release)
- Limit parsing threads for distributed case. (#648 by @ianton-ru)
Improvement
- Use ParquetMetadataCache for ParquetMetadata format as well. (#636 by @arthurpassos)
- Distributed object storage table engines. (#615 by @ianton-ru)
- Turn parquet metadata cache on by default. (#669, #674 by @arthurpassos)
Experimental Feature
- Fix the bug of leaking keeper watches when enable Cluster Discovery. (ClickHouse#74521 by @RinChanNOWWW via #629)
Full Changelog: v24.12.2.20203.altinityantalya...v24.12.2.20101.altinityantalya
Packages
Available for both AMD64 and Aarch64 from https://builds.altinity.cloud/ as either .deb
, .rpm
, or .tgz
Docker images
Available for both AMD64 and Aarch64: altinity/clickhouse-server:24.12.2.20203.altinityantalya
24.12.2.20101 Altinity Antalya
Changes compared to upstream's v24.12.2.29-stable
Bug Fixes (user-visible misbehavior in an official stable release)
- Fix remote call of s3Cluster function (#583 by @ianton-ru)
Performance improvements
- s3Cluster hive partitioning (#584 by @ianton-ru)
Improvements
- Support parquet integer logical types on native reader (#589 by @arthurpassos)
- Merge parquet bloom filter and min/max evaluation (#590 by @arthurpassos)
New features
- Alternative syntax for object storage cluster functions (#592 by @ianton-ru)
- Parquet File Metadata caching implementation (#586 by @arthurpassos)
Build/Testing/Packaging Improvement
Packages
Available for both AMD64 and Aarch64 from https://builds.altinity.cloud/ as either .deb
, .rpm
, or .tgz
Docker images
Available for both AMD64 and Aarch64: altinity/clickhouse-server:24.12.2.20101.altinityantalya
24.8.11.51285 Altinity Stable
Changes compared to upstream's v24.8.11.5-lts
Bug Fixes (user-visible misbehavior in an official stable release)
- Fix crash on drop or rename a role that is used in LDAP external user directory (ClickHouse#68355 by @zvonand via #542)
- Fix advanced SSL configuration for Keeper's internal communication (ClickHouse#72730 and ClickHouse#72584 by @antonio2368 via #579)
- Fix for S3 Express Disk Initialization Issue (ClickHouse#73777 by @stamsekar via #580)
Performance improvements
- Add support for parquet bloom filters (ClickHouse#62966 by @arthurpassos via #556)
- Optimized thread creation in the ThreadPool to minimize lock contention. (ClickHouse#68694 by @filimonov via #573)
- Adaptive mark_segment_size for parallel replicas (ClickHouse#68424, ClickHouse#69744 by @nickitat via #542)
Improvements
- Added a new set of metrics for Thread Pool introspection, providing deeper insights into thread pool performance and behavior. (ClickHouse#68674 by @filimonov via #567)
- Support for Parquet page V2 on native reader (ClickHouse#70807 by @arthurpassos via #558)
- Fix the issue where ClickHouse in Docker containers printed "get_mempolicy: Operation not permitted" into stderr due to restricted syscalls. (ClickHouse#70900 by @filimonov via #568)
- Support more advanced SSL options for Keeper internal communication (ClickHouse#69582 by @antonio2368 via #566)
- Read output_format_compression_level on Parquet output (ClickHouse#73651 and ClickHouse#74659 by @arthurpassos via #593)
- Multiple parallel replicas improvements (ClickHouse#63151 by @alexey-milovidov, ClickHouse#64448 by @devcrafter, ClickHouse#69602 by @nickitat, ClickHouse#69706 by @nickitat -- all via #542)
New features
- Push external user roles from query originator to other nodes in cluster. Helpful when only originator has access to the external authenticator (like LDAP). (ClickHouse#70332, ClickHouse#72759, by @zvonand via #542)
Build/Testing/Packaging Improvement
- Port CI/CD to Altinity's infrastructure
- Fixed tests
- Changed version number generation
Changes in upstream since v24.3
https://github.com/ClickHouse/ClickHouse/blob/master/docs/changelogs/v24.4.1.2088-stable.md
https://github.com/ClickHouse/ClickHouse/blob/master/docs/changelogs/v24.5.1.1763-stable.md
https://github.com/ClickHouse/ClickHouse/blob/master/docs/changelogs/v24.6.1.4423-stable.md
https://github.com/ClickHouse/ClickHouse/blob/master/docs/changelogs/v24.7.1.2915-stable.md
https://github.com/ClickHouse/ClickHouse/blob/master/docs/changelogs/v24.8.1.2684-lts.md
Build report
Packages
Available for both AMD64 and Aarch64 from https://builds.altinity.cloud/ as either .deb
, .rpm
, or .tgz
Docker images
Available for both AMD64 and Aarch64: altinity/clickhouse-server/24.8.11.51285.altinitystable
23.8.16.43 Altinity Stable update
New in 23.8.16.43.altinitystable
compared to 23.8.16.42.altinitystable
Bug fixes
- Fixes Crash in Engine Merge if Row Policy does not have expression (ClickHouse#61971 by @ilejn via #534)
Build/Testing/Packaging Improvement
- Pin version of cxx rust package to prevent picking up latest version (#550)
Changes compared to upstream's v23.8.16.40-lts (e143a90)
Bug fixes
- Fixes partition pruning for extra columns in a set. (ClickHouse#55172 by @amosbird via #342)
- Fixed rare bug when we produced invalid read ranges for queries with
FINAL
. Resulted inCannot read out of marks range
exception. (ClickHouse#54934 by @nickitat via #343) - Fix incorrect free space accounting for least_used JBOD policy (ClickHouse#56030 by @azat via #344)
- Fix ALTER COLUMN with ALIAS that previously threw the
NO_SUCH_COLUMN_IN_TABLE
exception. (ClickHouse#57395 by @evillique via #345) - Disable
system.kafka_consumers
by default (due to possible live memory leak) (ClickHouse#57822 by @azat via #346) - Fix expiration in RoleCache (ClickHouse#67748 by @vitibar via #451)
- Fix crash with invalid access to AccessControl instance (ClickHouse#65051 by @davenger via #465)
- fix SIGSEGV due to profiler (ClickHouse#63865 by @azat via #466)
- Projection analysis now comes after partition pruning, resulting in better plan efficiency and better statistic log (ClickHouse#56502 by @amosbird via #391)
- Fix broken partition key analysis when doing projection optimization with
force_index_by_date = 1
(ClickHouse#58638 by @amosbird via #391)*new
Performance improvements
- Fixed filtering by
IN(...)
condition forMerge
table engine. (ClickHouse#54905 by @nickitat via #341)
Improvement
- Support S3 access through AWS Private Link Interface endpoints. (ClickHouse#62208 by @arthurpassos via #389)
- Fixed accounting of memory allocated before attaching thread to a query or a user (ClickHouse#56089 by @nickitat via #388)
- Engine
Merge
filters the records according to the row policies of the underlying tables (ClickHouse#50209 by @ilejn via #446)
Build/Testing/Packaging Improvement
- Make builds possible on Altinity's infrastructure
clickhouse-regression
test suite (#338 by @MyroTk)- Changed "version is not official" log message on failure (#369 by @Enmk)
- Fix kerberized_hadoop docker image build issue (#394 by @ilejn)
- Reuse unchanged images #455 by @MyroTk
- Pinned version of pip packet requests==2.31.0 in attempt to fix: 'Error while fetching server API version: Not supported URL scheme http+docker' (#409 by @Enmk)
- Aarch64 builds with better introspection (
-no-pie
) (#396 by @Enmk) - Fixed the docker tag for docker server test image (#463 by @MyroTk)
- Add
SignAarch64
job to match SignRelease (#462 by @MyroTk) - Fix
test_distributed_directory_monitor_split_batch_on_failure_OFF
(#464 by @Enmk) - Fix
kererberized_hadoop
tests (#468, #459 by @ilejn) - Updated reference to clickhouse-regression suite (#467 by @MyroTk)
- Scheduled run + CI/CD fixups (#402 by @MyroTk)
- Fixed some dependencies versions (#507)
- Snapshot runners and other infrastructure improvements (#506)
- Updated package metadata (#505)
Build report
Packages
Available for both AMD64 and Aarch64 from https://builds.altinity.cloud/ as either .deb
, .rpm
, or .tgz
Docker images
Available for both AMD64 and Aarch64: altinity/clickhouse-server/23.8.16.43.altinitystable
24.3.12.76 Altinity Stable
Changes compared to upstream's v24.3.12.75-lts
Build/Testing/Packaging Improvement
- Enable building and testing on Altinity infrastructure (#413)
Bug fix
- 🆕 Support executing function during assignment of parameterized view value (ClickHouse#63502 by @SmitaRKulkarni via #444)
- 🆕 Fix serialization of parameterized view parameters (ClickHouse#67654 by @shiyer7474 via #502)
- 🆕 fix intersect parts when restart after drop range (ClickHouse#63202 by @hanfei1991 via #495)
- Fix the crash loop when restoring from backup is blocked by creating an MV with a definer that hasn't been restored yet. (ClickHouse#64595 by @pufit via #412)
- Fix moving partition to itself ClickHouse#62459 (ClickHouse#62524 by @helifu via #411)
- Fix detection of number of CPUs in containers. In the case when the 'root' cgroup was used (i.e. name of cgroup was empty, which is common for containers ) ClickHouse was ignoring the CPU limits set for the container. (ClickHouse#66237 by @filimonov via #420)
Improvement
- 🆕 Support aliases in parametrized view function (ClickHouse#65190 via @kssenii #500)
- 🆕 Ignore
allow_suspicious_primary_key
onATTACH
and verify onALTER
(ClickHouse#64202 by @azat via #494) - 🆕 Thread pool metrics (ClickHouse#68674 by @filimonov via #503)
- 🆕 more advanced SSL options for Keeper (ClickHouse#69582 by @antonio2368 via #496)
- 🆕 Add fault injection for "Cannot allocate thread" (ClickHouse#62266 by @tavplubix via #508)
- 🆕 Support S3 access through AWS Private Link Interface endpoints. (ClickHouse#62208 by @arthurpassos via #498)
- 🆕 Set
input_format_parquet_filter_push_down
default value tofalse
#511
Build/Testing/Packaging Improvement
- 🆕
ubuntu:22.04
as a base image forclickhouse-server
docker image #497 - 🆕
alpine:3.20.3
as clickhouse-keeper base image to (lowest number of CVEs) #517
🆕 — new in 24.3.12.76.altinitystable
compared to 24.3.5.47.altinitystable
Build report
Packages
Available for both AMD64 and Aarch64 from https://builds.altinity.cloud/ as either .deb
, .rpm
, or .tgz
Docker images
Available for both AMD64 and Aarch64: altinity/clickhouse-server/24.3.12.76.altinitystable