Bump io.delta:delta-kernel-api from 4.0.0 to 4.0.1

[dependabot]

Bumps io.delta:delta-kernel-api from 4.0.0 to 4.0.1.

Release notes

Sourced from io.delta:delta-kernel-api's releases.

v4.0.1

We are excited to announce the release of Delta Lake 4.0.1! This release contains important bug fixes to 4.0.0 and it is recommended that users update to 4.0.1.

Highlights

• [Spark] Breaking change: rename managed table feature from catalogOwned-preview to catalogManaged; legacy ucTableId has also transitioned to the new managed-table io.unitycatalog.tableId
• [Spark] Unity Catalog OAuth: add OAuth authentication via catalog-scoped auth.* configs; tokens are acquired and refreshed automatically; static tokens remain supported.
• [Spark] Unity Catalog managed table table creation: enable creating UC-managed Delta table and always send table properties to the UC server as source of truth.
• [Spark] Spark compatibility fix: addressed NoSuchMethodError in REORG TABLE … APPLY (PURGE) when running with Spark 4.0.1.

Component-specific bug fixes are detailed below.

Delta Spark

Delta Spark 4.0.1 is built on Apache Spark™ 4.0.1. Similar to Apache Spark, we have released Maven artifacts for Scala 2.13.

• Maven artifacts: delta-spark_2.13, delta_contribs_2.13, delta-storage, delta-storage-s3-dynamodb, delta-connect-client_2.13, delta-connect-common_2.13, delta-connect-server_2.13
• Python artifacts: https://pypi.org/project/delta-spark/4.0.1/

The key features of this release are:

• Catalog Managed Tables: managed table feature rename. The feature formerly named catalogOwned‑preview is standardized as catalogManaged. The associated Unity Catalog table ID property is updated accordingly (ucTableId → io.unitycatalog.tableId) ; calls that still send the legacy key are handled for compatibility during creation.
• Fix Spark binary compatibility issue that caused REORG TABLE … APPLY (PURGE) to fail with NoSuchMethodError on Spark 4.0.1 by switching to the stable constructor and retrieving SQL configs via SparkSession.active.sessionState.conf in executors
• Introduced end‑to‑end tests for Unity Catalog DML on the 4.0.x line to validate UC‑backed execution paths; scope is test‑only with no public API changes.

Unity Catalog Support

• Official compatibility with UC 0.3.1. Delta 4.0.1 is officially tested with UC integration tests validating end‑to‑end behavior with UC 0.3.1. See the UC 0.3.1 release for the corresponding connector capabilities and APIs.

• Support Unity Catalog OAuth authentication. Use catalog‑scoped auth.* configuration; tokens are automatically acquired and refreshed, avoiding embedded static tokens. Legacy static‑token configs continue to work for backward compatibility.

  Enable OAuth on a Spark catalog alias that points to UC:

  # Point a Spark catalog alias at Unity Catalog
  spark.sql.catalog.mycatalog = "io.unitycatalog.connectors.spark.UCSingleCatalog"
  spark.sql.catalog.mycatalog.uri = "https://<your-workspace-host>"
  OAuth (dynamic tokens) — supported keys
  spark.sql.catalog.mycatalog.auth.type               = "oauth"
  spark.sql.catalog.mycatalog.auth.oauth.uri          = "https://&lt;auth-server-endpoint>"
  spark.sql.catalog.mycatalog.auth.oauth.clientId     = "<client-id>"
  spark.sql.catalog.mycatalog.auth.oauth.clientSecret = "<client-secret>"
  Static token (legacy-compatible)
  spark.sql.catalog.mycatalog.auth.type  = "static"
  spark.sql.catalog.mycatalog.auth.token = "<personal-access-token>"
  Legacy key also supported: spark.sql.catalog.mycatalog.token

  And run with Delta’s Spark extensions as usual:

... (truncated)

Commits

• 14460c1 Setting version to 4.0.1
• 3c30782 [Spark] Upgrade the spark to 4.0.1 (#5809)
• a0267cb [0.4][Build] Update the oss.sonatype service to Central Publisher Portal. (#5...
• 775f4c0 [0.4][Spark] Add Streaming write integration tests. (#5801)
• adcce52 [Backport 4.0][Spark][UC] Expand UC managed table creation tests with compreh...
• bd714d1 [0.4][Spark] Support the spark-uc tests run on various env. (#5786)
• 8d2a5a9 [4.0] [Spark] Support UnityCatalog OAuth authentication. (#5742)
• bf6b370 [Backport 4.0][Spark] Always send table properties to server when creating ma...
• 808b01c [Backport 4.0][Spark] Unity Catalog managed table support (#5736)
• a11f143 [Fix][Spark] REORG TABLE fails with NoSuchMethodError in Delta 4.0.0 with Spa...
• Additional commits viewable in compare view

Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.

---

Dependabot commands and options

You can trigger Dependabot actions by commenting on this PR:

• @dependabot rebase will rebase this PR
• @dependabot recreate will recreate this PR, overwriting any edits that have been made to it
• @dependabot merge will merge this PR after your CI passes on it
• @dependabot squash and merge will squash and merge this PR after your CI passes on it
• @dependabot cancel merge will cancel a previously requested merge and block automerging
• @dependabot reopen will reopen this PR if it is closed
• @dependabot close will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually
• @dependabot show <dependency name> ignore conditions will show all of the ignore conditions of the specified dependency
• @dependabot ignore this major version will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)
• @dependabot ignore this minor version will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)
• @dependabot ignore this dependency will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)