Skip to content

Release Spark Connector 2.11.1
Compare
Choose a tag to compare
@sfc-gh-mrui sfc-gh-mrui released this 13 Dec 21:28
· 41 commits to master since this release
v2.11.1-spark_3.3
995a23b

Added support for AWS VPCE deployments and fixed some bugs:

  1. Support AWS VPCE. Added the configuration option S3_STAGE_VPCE_DNS_NAME for specifying the VPCE DNS name at the session level.
  2. Updated the connector to close JDBC connections to avoid connection leakage.
  3. Fixed a NullPointerException issue when sending telemetry messages.
  4. Added a new configuration option treat_decimal_as_long to enable the Spark Connector to return Long values instead of BigDecimal values, if the query returns Decimal(<any_precision>, 0). WARNING: If the value is greater than the maximum value of Long, an error will be raised.
  5. Added a new option proxy_protocol for specifying the proxy protocol (http or https) with AWS deployments. (The option has no effect on Azure and GCP deployments.)
  6. Added support for counting rows in a table where the row count is greater than the maximum value of Integer.
  7. Updated the connector to use the Snowflake JDBC driver 3.13.24.
Assets 2
Loading