Skip to content

Release Spark Connector 2.9.2

Compare
Choose a tag to compare
@sfc-gh-mrui sfc-gh-mrui released this 05 Nov 00:19
· 80 commits to master since this release

Fixed some critical issues:

  1. For the DataFrame read and write queries, the connector now logs the query ID and the URL to display the query details.
  2. When a Spark application fails or is cancelled, the connector now cancels all running queries executed by that Spark application.
  3. Added the configuration options timestamp_ntz_output_format, timestamp_ltz_output_format, and timestamp_tz_output_format for specifying the output format for timestamp values. By default, these are set as "YYYY-MM-DD HH24:MI:SS.FF3", "TZHTZM YYYY-MM-DD HH24:MI:SS.FF3", and "TZHTZM YYYY-MM-DD HH24:MI:SS.FF3". If they are set to “sf_current”, which means that the connector uses the formats specified for the session.
  4. Updated the connector to use the latest version of the Snowflake JDBC Driver (3.13.10).