Skip to content

Commit ee2de89

Browse files
authored
Merge pull request #9050 from NvTimLiu/release-tmp
Merge branch 'branch-23.08' into main [skip ci]
2 parents b33605a + 10540ba commit ee2de89

File tree

35 files changed

+144
-77
lines changed

35 files changed

+144
-77
lines changed

CHANGELOG.md

Lines changed: 9 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1,5 +1,5 @@
11
# Change log
2-
Generated on 2023-08-14
2+
Generated on 2023-08-15
33

44
## Release 23.08
55

@@ -31,6 +31,9 @@ Generated on 2023-08-14
3131
### Bugs Fixed
3232
|||
3333
|:---|:---|
34+
|[#9034](https://github.com/NVIDIA/spark-rapids/issues/9034)|[BUG] java.lang.ClassCastException: com.nvidia.spark.rapids.RuleNotFoundExprMeta cannot be cast to com.nvidia.spark.rapids.GeneratorExprMeta|
35+
|[#9032](https://github.com/NVIDIA/spark-rapids/issues/9032)|[BUG] Multiple NDS queries fail with Spark-3.4.1 with bloom filter exception|
36+
|[#8962](https://github.com/NVIDIA/spark-rapids/issues/8962)|[BUG] Nightly build failed: ExecutionPlanCaptureCallback$.class is not bitwise-identical across shims|
3437
|[#9021](https://github.com/NVIDIA/spark-rapids/issues/9021)|[BUG] test_map_scalars_supported_key_types failed in dataproc 2.1|
3538
|[#9020](https://github.com/NVIDIA/spark-rapids/issues/9020)|[BUG] auto-disable snapshot shims test in github action for pre-release branch|
3639
|[#9010](https://github.com/NVIDIA/spark-rapids/issues/9010)|[BUG] Customer failure 23.08: Cannot compute hash of a table with a LIST of STRUCT columns.|
@@ -85,6 +88,11 @@ Generated on 2023-08-14
8588
### PRs
8689
|||
8790
|:---|:---|
91+
|[#9044](https://github.com/NVIDIA/spark-rapids/pull/9044)|[DOC] update release version from v2308.0 to 2308.1 [skip ci]|
92+
|[#9036](https://github.com/NVIDIA/spark-rapids/pull/9036)|Fix meta class cast exception when generator not supported|
93+
|[#9042](https://github.com/NVIDIA/spark-rapids/pull/9042)|Bump up project version to 23.08.1-SNAPSHOT|
94+
|[#9035](https://github.com/NVIDIA/spark-rapids/pull/9035)|Handle null values when merging Bloom filters|
95+
|[#9029](https://github.com/NVIDIA/spark-rapids/pull/9029)|Update 23.08 changelog to latest [skip ci]|
8896
|[#9023](https://github.com/NVIDIA/spark-rapids/pull/9023)|Allow WindowLocalExec to run on CPU for a map test.|
8997
|[#9024](https://github.com/NVIDIA/spark-rapids/pull/9024)|Do not trigger snapshot spark version test in pre-release maven-verify checks [skip ci]|
9098
|[#8975](https://github.com/NVIDIA/spark-rapids/pull/8975)|Init 23.08 changelog [skip ci]|

CONTRIBUTING.md

Lines changed: 4 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -113,15 +113,15 @@ mvn -pl dist -PnoSnapshots package -DskipTests
113113
Verify that shim-specific classes are hidden from a conventional classloader.
114114

115115
```bash
116-
$ javap -cp dist/target/rapids-4-spark_2.12-23.08.0-cuda11.jar com.nvidia.spark.rapids.shims.SparkShimImpl
116+
$ javap -cp dist/target/rapids-4-spark_2.12-23.08.1-cuda11.jar com.nvidia.spark.rapids.shims.SparkShimImpl
117117
Error: class not found: com.nvidia.spark.rapids.shims.SparkShimImpl
118118
```
119119

120120
However, its bytecode can be loaded if prefixed with `spark3XY` not contained in the package name
121121

122122
```bash
123-
$ javap -cp dist/target/rapids-4-spark_2.12-23.08.0-cuda11.jar spark320.com.nvidia.spark.rapids.shims.SparkShimImpl | head -2
124-
Warning: File dist/target/rapids-4-spark_2.12-23.08.0-cuda11.jar(/spark320/com/nvidia/spark/rapids/shims/SparkShimImpl.class) does not contain class spark320.com.nvidia.spark.rapids.shims.SparkShimImpl
123+
$ javap -cp dist/target/rapids-4-spark_2.12-23.08.1-cuda11.jar spark320.com.nvidia.spark.rapids.shims.SparkShimImpl | head -2
124+
Warning: File dist/target/rapids-4-spark_2.12-23.08.1-cuda11.jar(/spark320/com/nvidia/spark/rapids/shims/SparkShimImpl.class) does not contain class spark320.com.nvidia.spark.rapids.shims.SparkShimImpl
125125
Compiled from "SparkShims.scala"
126126
public final class com.nvidia.spark.rapids.shims.SparkShimImpl {
127127
```
@@ -163,7 +163,7 @@ mvn package -pl dist -am -Dbuildver=340 -DallowConventionalDistJar=true
163163
Verify `com.nvidia.spark.rapids.shims.SparkShimImpl` is conventionally loadable:
164164
165165
```bash
166-
$ javap -cp dist/target/rapids-4-spark_2.12-23.08.0-cuda11.jar com.nvidia.spark.rapids.shims.SparkShimImpl | head -2
166+
$ javap -cp dist/target/rapids-4-spark_2.12-23.08.1-cuda11.jar com.nvidia.spark.rapids.shims.SparkShimImpl | head -2
167167
Compiled from "SparkShims.scala"
168168
public final class com.nvidia.spark.rapids.shims.SparkShimImpl {
169169
```

README.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -73,7 +73,7 @@ as a `provided` dependency.
7373
<dependency>
7474
<groupId>com.nvidia</groupId>
7575
<artifactId>rapids-4-spark_2.12</artifactId>
76-
<version>23.08.0</version>
76+
<version>23.08.1</version>
7777
<scope>provided</scope>
7878
</dependency>
7979
```

aggregator/pom.xml

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -22,12 +22,12 @@
2222
<parent>
2323
<groupId>com.nvidia</groupId>
2424
<artifactId>rapids-4-spark-parent</artifactId>
25-
<version>23.08.0</version>
25+
<version>23.08.1</version>
2626
</parent>
2727
<artifactId>rapids-4-spark-aggregator_2.12</artifactId>
2828
<name>RAPIDS Accelerator for Apache Spark Aggregator</name>
2929
<description>Creates an aggregated shaded package of the RAPIDS plugin for Apache Spark</description>
30-
<version>23.08.0</version>
30+
<version>23.08.1</version>
3131

3232
<properties>
3333
<!--

api_validation/pom.xml

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -22,10 +22,10 @@
2222
<parent>
2323
<groupId>com.nvidia</groupId>
2424
<artifactId>rapids-4-spark-parent</artifactId>
25-
<version>23.08.0</version>
25+
<version>23.08.1</version>
2626
</parent>
2727
<artifactId>rapids-4-spark-api-validation</artifactId>
28-
<version>23.08.0</version>
28+
<version>23.08.1</version>
2929

3030
<profiles>
3131
<profile>

delta-lake/delta-20x/pom.xml

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -22,14 +22,14 @@
2222
<parent>
2323
<groupId>com.nvidia</groupId>
2424
<artifactId>rapids-4-spark-parent</artifactId>
25-
<version>23.08.0</version>
25+
<version>23.08.1</version>
2626
<relativePath>../../pom.xml</relativePath>
2727
</parent>
2828

2929
<artifactId>rapids-4-spark-delta-20x_2.12</artifactId>
3030
<name>RAPIDS Accelerator for Apache Spark Delta Lake 2.0.x Support</name>
3131
<description>Delta Lake 2.0.x support for the RAPIDS Accelerator for Apache Spark</description>
32-
<version>23.08.0</version>
32+
<version>23.08.1</version>
3333

3434
<properties>
3535
<rapids.compressed.artifact>false</rapids.compressed.artifact>

delta-lake/delta-21x/pom.xml

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -22,14 +22,14 @@
2222
<parent>
2323
<groupId>com.nvidia</groupId>
2424
<artifactId>rapids-4-spark-parent</artifactId>
25-
<version>23.08.0</version>
25+
<version>23.08.1</version>
2626
<relativePath>../../pom.xml</relativePath>
2727
</parent>
2828

2929
<artifactId>rapids-4-spark-delta-21x_2.12</artifactId>
3030
<name>RAPIDS Accelerator for Apache Spark Delta Lake 2.1.x Support</name>
3131
<description>Delta Lake 2.1.x support for the RAPIDS Accelerator for Apache Spark</description>
32-
<version>23.08.0</version>
32+
<version>23.08.1</version>
3333

3434
<properties>
3535
<rapids.compressed.artifact>false</rapids.compressed.artifact>

delta-lake/delta-22x/pom.xml

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -22,14 +22,14 @@
2222
<parent>
2323
<groupId>com.nvidia</groupId>
2424
<artifactId>rapids-4-spark-parent</artifactId>
25-
<version>23.08.0</version>
25+
<version>23.08.1</version>
2626
<relativePath>../../pom.xml</relativePath>
2727
</parent>
2828

2929
<artifactId>rapids-4-spark-delta-22x_2.12</artifactId>
3030
<name>RAPIDS Accelerator for Apache Spark Delta Lake 2.2.x Support</name>
3131
<description>Delta Lake 2.2.x support for the RAPIDS Accelerator for Apache Spark</description>
32-
<version>23.08.0</version>
32+
<version>23.08.1</version>
3333

3434
<properties>
3535
<rapids.compressed.artifact>false</rapids.compressed.artifact>

delta-lake/delta-24x/pom.xml

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -22,14 +22,14 @@
2222
<parent>
2323
<groupId>com.nvidia</groupId>
2424
<artifactId>rapids-4-spark-parent</artifactId>
25-
<version>23.08.0</version>
25+
<version>23.08.1</version>
2626
<relativePath>../../pom.xml</relativePath>
2727
</parent>
2828

2929
<artifactId>rapids-4-spark-delta-24x_2.12</artifactId>
3030
<name>RAPIDS Accelerator for Apache Spark Delta Lake 2.4.x Support</name>
3131
<description>Delta Lake 2.4.x support for the RAPIDS Accelerator for Apache Spark</description>
32-
<version>23.08.0</version>
32+
<version>23.08.1</version>
3333

3434
<properties>
3535
<rapids.compressed.artifact>false</rapids.compressed.artifact>

delta-lake/delta-spark321db/pom.xml

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -22,14 +22,14 @@
2222
<parent>
2323
<groupId>com.nvidia</groupId>
2424
<artifactId>rapids-4-spark-parent</artifactId>
25-
<version>23.08.0</version>
25+
<version>23.08.1</version>
2626
<relativePath>../../pom.xml</relativePath>
2727
</parent>
2828

2929
<artifactId>rapids-4-spark-delta-spark321db_2.12</artifactId>
3030
<name>RAPIDS Accelerator for Apache Spark Databricks 10.4 Delta Lake Support</name>
3131
<description>Databricks 10.4 Delta Lake support for the RAPIDS Accelerator for Apache Spark</description>
32-
<version>23.08.0</version>
32+
<version>23.08.1</version>
3333

3434
<properties>
3535
<rapids.compressed.artifact>false</rapids.compressed.artifact>

0 commit comments

Comments
 (0)