v0.10.0

What's Changed

• Add Spark 4.0 examples for debugging and testing by @ShimonSte in #473
• Fix UInt64 type mapping to prevent data loss and overflow by @ShimonSte in #477
• Feature/variant type support by @ShimonSte in #456
• Update java client to 0.9.5 by @mzitnik in #484
• Add TableProvider implementation with predicate pushdown and column p… by @ShimonSte in #471
• Add CHANGELOG.md and CONTRIBUTING.md by @ShimonSte in #478
• allow macros in cluster name in Distributed engine by @crazy-genius in #400
• Fix typo in NodeSpec.toString: remove extra closing brace by @ShimonSte in #498
• fix: gracefully handle unsupported partition expressions like tuple() by @ShimonSte in #499
• Add DOCKER_API_VERSION environment variable support by @ShimonSte in #504

New Contributors

• @crazy-genius made their first contribution in #400

Full Changelog: v0.9.0...v0.10.0

v0.9.0

What's Changed

• Spark: Support read with settings by @harryshi10 in #367
• Update configuration file by @mzitnik in #372
• Build: Bump actions/upload-artifacts@v4 by @pan3793 in #396
• Spark: Binary reader supports String for Array/Map reading by @huashi-st in #395
• add workflow_dispatch to build-and-test by @BentsiLeviav in #417
• Fix tests by @BentsiLeviav in #419
• add workflow dispatch to the cloud workflow by @BentsiLeviav in #421
• Fix SonarQube by @BentsiLeviav in #422
• Fix sonarqube by @BentsiLeviav in #423
• Update supported clickhouse versions by @BentsiLeviav in #425
• fix resources by @BentsiLeviav in #426
• Detect runtime env by @BentsiLeviav in #427
• Wake up ClickHouse Cloud instance before tests by @BentsiLeviav in #429
• Update java client version by @mzitnik in #428
• Spark 4 support by @ShimonSte in #452
• Feature/struct type support by @ShimonSte in #453
• Align Spark 4.0 dependencies with Spark 4.0.1 release by @ShimonSte in #458
• Update publish-release.yml by @BentsiLeviav in #460
• Update publish-snapshot.yml by @BentsiLeviav in #462
• Update publish workflow by @mzitnik in #463

New Contributors

• @huashi-st made their first contribution in #395

Full Changelog: v0.8.1...v0.9.0

v0.8.1

• Protect from ArrayIndexOutOfBoundsException exception when extracting values for user agent. (#360)

v0.8.0

Breaking Changes

• gRPC support is removed, now HTTP is the only option
• project groupId is renamed from com.github.housepower to com.clickhouse.spark
• class xenon.clickhouse.ClickHouseCatalog is renamed to com.clickhouse.spark.ClickHouseCatalog

What's Changed

• Support Spark 3.5
• Upgrade to Java client version 0.6.3
• Tested against cloud
• Added dedicated user agent

v0.7.3

This release built against clickhouse-java 0.4.6, should also work with clickhouse-java 0.5.0 and 0.6.0

Change Logs

• Core: Remove usage of ClickHouse client deprecated API (#291)
• Spark: Add int long BigInteger cases for Decimal (#266)

v0.7.2

Change Logs

• Build: Upgrade clickhouse-java 0.4.6 (#235)
• Test: Upload ClickHouse server logs when CI failed (#249)
• Spark: ClickHouse FixedString map to Spark BinaryType (#251)
• Spark: Fix ArrayIndexOutOfBoundsException when all columns are pruned and agg pushdown does not take effects (#256)
• Core: Support parse Date64 which contains nano seconds (#258)

v0.7.1

Change Logs

• Spark: Fix Decimal precision in JSON mode on reading

v0.7.0

Notable Changes

This release supports Spark 3.3 and 3.4, and is compatible w/ clickhouse-jdbc:0.4.5.

Since this version, gRPC is deprecated, and may be removed in the future.

Change Logs

• Core: Bump clickhouse-java 0.4.5 (#211)
• Core: Deprecate gRPC protocol (#233)
• Spark: Initial support Spark 3.4 (#228)
• Spark: Polish configuration's doc
• Spark: Fix custom options (#231)
• Spark 3.3: Remove ConfigurationSuite
• Docs: Mention 0.6.0 important changes
• Docs: Add Compatible Matrix
• Docs: Fix link for configuration page
• Docs: Correct the Spark version for integration tests
• Test: Test against ClickHouse 23.3 (#232)
• Playground: Update Kyuubi 1.7.0

v0.6.1

Change Logs

• Spark 3.3: Fix custom options (#234)
• Build: Enable CI on release branch

v0.6.0

Notable Changes

This release only supports Spark 3.3, and is compatible w/ clickhouse-jdbc:0.3.2-patch11.

The default protocol is changed to HTTP, as suggested by ClickHouse/clickhouse-java#1252 (comment)

gRPC is experimental and problematic, I should probably drop it someday to avoid confusion.

Change Logs

• Core: Respect ClickHouse ORDER BY Clause default behavior
• Spark: Change default protocol to HTTP (#190)
• Spark: Fix Decimal reading in JSON format (#220)
• Spark: Support Date type as partition column in dropPartition (#218)
• Spark: Support tcp_port in catalog option (#223)
• Spark: Fix timestamp value transformation (#216)
• Spark: Use clickhouse java client to parse schema (#215)
• Spark: Allow setting arbitrary options for ClickHouseClient (#203)
• Spark: Support reading Bool type (#207)
• Spark: Rename and reorganize functions (#198)
• Spark: Simplify spark.clickhouse.write.format values
• Spark: Support RowBinary format in reading (#195)
• Spark: Support read metrics (#191)
• Spark: Test parse LowCardinality column definition (#217)
• Playground: Switch minio image back to bitnami/minio
• Playground: Restructure directories and upgrade components (#212)
• Playground: Remove python
• Playground: Fix S3 magic committer confs
• Playground: Use eclipse-temurin:8-focal as base image (#188)
• Docs: Syntax improvements
• Docs: Remove incubating from Kyuubi reference (#209)
• Docs: Bump mkdocs-material 9.0.9
• Docs: Remove unused var spark_version
• Docs: Auto generate configuration docs
• Docs: Fix documentation --jars/--packages usage (#186)
• Docs: polish sentence
• Docs: Supply demo for native SQL execution
• Docs: Use docker compose V2 command
• Docs: Update Rebalance image
• Docs: Improve sentence
• Docs: Enrich Catalog Management
• Infra: Enable spotless (#208)
• Infra: Upgrade CI runner image and actions (#214)
• Build: Polish gradle scripts
• Build: Bump Spark 3.3.2 (#219)
• Build: Bump Gradle 7.6 (#213)
• Build: Bump testcontainers-scala 0.40.12
• Build: Bump gradle rat plugin 0.8.0
• Build: Bump gradle scoverage plugin 7.0.1 (#193)
• Build: Remove unused snapshot repo
• Build: Remove Spark 3.2 support (#189)
• Build: Bump Jackson 2.13.4 (#192)
• Build: Rename SonarQube workflow
• Build: Testing w/ multi clickhouse versions (#183)
• Test: Allow testing w/ non-grpc versions (#182)
• Test: Correct configuring log4j2