Skip to content

Commit 145f4fd

Browse files
nvautonvauto
authored
Merge pull request #11356 from NVIDIA/merge-branch-24.08-to-main
Merge branch-24.08 into main
2 parents 52b43d6 + 34facb0 commit 145f4fd

File tree

65 files changed

+140
-138
lines changed

Some content is hidden

Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.

65 files changed

+140
-138
lines changed

‎CHANGELOG.md

Lines changed: 3 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1,5 +1,5 @@
11
# Change log
2-
Generated on 2024-08-16
2+
Generated on 2024-08-18
33

44
## Release 24.08
55

@@ -88,6 +88,8 @@ Generated on 2024-08-16
8888
### PRs
8989
|||
9090
|:---|:---|
91+
|[#11353](https://github.com/NVIDIA/spark-rapids/pull/11353)|Update download doc for v24.08.1 [skip ci]|
92+
|[#11352](https://github.com/NVIDIA/spark-rapids/pull/11352)|Update version to 24.08.1-SNAPSHOT [skip ci]|
9193
|[#11335](https://github.com/NVIDIA/spark-rapids/pull/11335)|Fix Delta Lake truncation of min/max string values|
9294
|[#11304](https://github.com/NVIDIA/spark-rapids/pull/11304)|Update changelog for v24.08.0 release [skip ci]|
9395
|[#11303](https://github.com/NVIDIA/spark-rapids/pull/11303)|Update rapids JNI and private dependency to 24.08.0|

‎CONTRIBUTING.md

Lines changed: 4 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -127,15 +127,15 @@ mvn -pl dist -PnoSnapshots package -DskipTests
127127
Verify that shim-specific classes are hidden from a conventional classloader.
128128

129129
```bash
130-
$ javap -cp dist/target/rapids-4-spark_2.12-24.08.0-cuda11.jar com.nvidia.spark.rapids.shims.SparkShimImpl
130+
$ javap -cp dist/target/rapids-4-spark_2.12-24.08.1-cuda11.jar com.nvidia.spark.rapids.shims.SparkShimImpl
131131
Error: class not found: com.nvidia.spark.rapids.shims.SparkShimImpl
132132
```
133133

134134
However, its bytecode can be loaded if prefixed with `spark3XY` not contained in the package name
135135

136136
```bash
137-
$ javap -cp dist/target/rapids-4-spark_2.12-24.08.0-cuda11.jar spark320.com.nvidia.spark.rapids.shims.SparkShimImpl | head -2
138-
Warning: File dist/target/rapids-4-spark_2.12-24.08.0-cuda11.jar(/spark320/com/nvidia/spark/rapids/shims/SparkShimImpl.class) does not contain class spark320.com.nvidia.spark.rapids.shims.SparkShimImpl
137+
$ javap -cp dist/target/rapids-4-spark_2.12-24.08.1-cuda11.jar spark320.com.nvidia.spark.rapids.shims.SparkShimImpl | head -2
138+
Warning: File dist/target/rapids-4-spark_2.12-24.08.1-cuda11.jar(/spark320/com/nvidia/spark/rapids/shims/SparkShimImpl.class) does not contain class spark320.com.nvidia.spark.rapids.shims.SparkShimImpl
139139
Compiled from "SparkShims.scala"
140140
public final class com.nvidia.spark.rapids.shims.SparkShimImpl {
141141
```
@@ -178,7 +178,7 @@ mvn package -pl dist -am -Dbuildver=340 -DallowConventionalDistJar=true
178178
Verify `com.nvidia.spark.rapids.shims.SparkShimImpl` is conventionally loadable:
179179
180180
```bash
181-
$ javap -cp dist/target/rapids-4-spark_2.12-24.08.0-cuda11.jar com.nvidia.spark.rapids.shims.SparkShimImpl | head -2
181+
$ javap -cp dist/target/rapids-4-spark_2.12-24.08.1-cuda11.jar com.nvidia.spark.rapids.shims.SparkShimImpl | head -2
182182
Compiled from "SparkShims.scala"
183183
public final class com.nvidia.spark.rapids.shims.SparkShimImpl {
184184
```

‎README.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -73,7 +73,7 @@ as a `provided` dependency.
7373
<dependency>
7474
<groupId>com.nvidia</groupId>
7575
<artifactId>rapids-4-spark_2.12</artifactId>
76-
<version>24.08.0</version>
76+
<version>24.08.1</version>
7777
<scope>provided</scope>
7878
</dependency>
7979
```

‎aggregator/pom.xml

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -22,13 +22,13 @@
2222
<parent>
2323
<groupId>com.nvidia</groupId>
2424
<artifactId>rapids-4-spark-jdk-profiles_2.12</artifactId>
25-
<version>24.08.0</version>
25+
<version>24.08.1</version>
2626
<relativePath>../jdk-profiles/pom.xml</relativePath>
2727
</parent>
2828
<artifactId>rapids-4-spark-aggregator_2.12</artifactId>
2929
<name>RAPIDS Accelerator for Apache Spark Aggregator</name>
3030
<description>Creates an aggregated shaded package of the RAPIDS plugin for Apache Spark</description>
31-
<version>24.08.0</version>
31+
<version>24.08.1</version>
3232

3333
<properties>
3434
<rapids.module>aggregator</rapids.module>

‎api_validation/pom.xml

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -22,11 +22,11 @@
2222
<parent>
2323
<groupId>com.nvidia</groupId>
2424
<artifactId>rapids-4-spark-shim-deps-parent_2.12</artifactId>
25-
<version>24.08.0</version>
25+
<version>24.08.1</version>
2626
<relativePath>../shim-deps/pom.xml</relativePath>
2727
</parent>
2828
<artifactId>rapids-4-spark-api-validation_2.12</artifactId>
29-
<version>24.08.0</version>
29+
<version>24.08.1</version>
3030

3131
<properties>
3232
<rapids.module>api_validation</rapids.module>

‎datagen/README.md

Lines changed: 3 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -24,12 +24,12 @@ Where `$SPARK_VERSION` is a compressed version number, like 330 for Spark 3.3.0.
2424

2525
After this the jar should be at
2626
`target/datagen_2.12-$PLUGIN_VERSION-spark$SPARK_VERSION.jar`
27-
for example a Spark 3.3.0 jar for the 24.08.0 release would be
28-
`target/datagen_2.12-24.08.0-spark330.jar`
27+
for example a Spark 3.3.0 jar for the 24.08.1 release would be
28+
`target/datagen_2.12-24.08.1-spark330.jar`
2929

3030
To get a spark shell with this you can run
3131
```shell
32-
spark-shell --jars target/datagen_2.12-24.08.0-spark330.jar
32+
spark-shell --jars target/datagen_2.12-24.08.1-spark330.jar
3333
```
3434

3535
After that you should be good to go.

‎datagen/ScaleTest.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -44,7 +44,7 @@ $SPARK_HOME/bin/spark-submit \
4444
--conf spark.sql.parquet.datetimeRebaseModeInWrite=CORRECTED \
4545
--class com.nvidia.rapids.tests.scaletest.ScaleTestDataGen \ # the main class
4646
--jars $SPARK_HOME/examples/jars/scopt_2.12-3.7.1.jar \ # one dependency jar just shipped with Spark under $SPARK_HOME
47-
./target/datagen_2.12-24.08.0-spark332.jar \
47+
./target/datagen_2.12-24.08.1-spark332.jar \
4848
1 \
4949
10 \
5050
parquet \

‎datagen/pom.xml

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -21,13 +21,13 @@
2121
<parent>
2222
<groupId>com.nvidia</groupId>
2323
<artifactId>rapids-4-spark-shim-deps-parent_2.12</artifactId>
24-
<version>24.08.0</version>
24+
<version>24.08.1</version>
2525
<relativePath>../shim-deps/pom.xml</relativePath>
2626
</parent>
2727
<artifactId>datagen_2.12</artifactId>
2828
<name>Data Generator</name>
2929
<description>Tools for generating large amounts of data</description>
30-
<version>24.08.0</version>
30+
<version>24.08.1</version>
3131
<properties>
3232
<rapids.module>datagen</rapids.module>
3333
<target.classifier/>

‎delta-lake/delta-20x/pom.xml

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -22,14 +22,14 @@
2222
<parent>
2323
<groupId>com.nvidia</groupId>
2424
<artifactId>rapids-4-spark-jdk-profiles_2.12</artifactId>
25-
<version>24.08.0</version>
25+
<version>24.08.1</version>
2626
<relativePath>../../jdk-profiles/pom.xml</relativePath>
2727
</parent>
2828

2929
<artifactId>rapids-4-spark-delta-20x_2.12</artifactId>
3030
<name>RAPIDS Accelerator for Apache Spark Delta Lake 2.0.x Support</name>
3131
<description>Delta Lake 2.0.x support for the RAPIDS Accelerator for Apache Spark</description>
32-
<version>24.08.0</version>
32+
<version>24.08.1</version>
3333

3434
<properties>
3535
<rapids.module>../delta-lake/delta-20x</rapids.module>

‎delta-lake/delta-21x/pom.xml

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -22,14 +22,14 @@
2222
<parent>
2323
<groupId>com.nvidia</groupId>
2424
<artifactId>rapids-4-spark-jdk-profiles_2.12</artifactId>
25-
<version>24.08.0</version>
25+
<version>24.08.1</version>
2626
<relativePath>../../jdk-profiles/pom.xml</relativePath>
2727
</parent>
2828

2929
<artifactId>rapids-4-spark-delta-21x_2.12</artifactId>
3030
<name>RAPIDS Accelerator for Apache Spark Delta Lake 2.1.x Support</name>
3131
<description>Delta Lake 2.1.x support for the RAPIDS Accelerator for Apache Spark</description>
32-
<version>24.08.0</version>
32+
<version>24.08.1</version>
3333

3434
<properties>
3535
<rapids.module>../delta-lake/delta-21x</rapids.module>

‎delta-lake/delta-22x/pom.xml

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -22,14 +22,14 @@
2222
<parent>
2323
<groupId>com.nvidia</groupId>
2424
<artifactId>rapids-4-spark-jdk-profiles_2.12</artifactId>
25-
<version>24.08.0</version>
25+
<version>24.08.1</version>
2626
<relativePath>../../jdk-profiles/pom.xml</relativePath>
2727
</parent>
2828

2929
<artifactId>rapids-4-spark-delta-22x_2.12</artifactId>
3030
<name>RAPIDS Accelerator for Apache Spark Delta Lake 2.2.x Support</name>
3131
<description>Delta Lake 2.2.x support for the RAPIDS Accelerator for Apache Spark</description>
32-
<version>24.08.0</version>
32+
<version>24.08.1</version>
3333

3434
<properties>
3535
<rapids.module>../delta-lake/delta-22x</rapids.module>

‎delta-lake/delta-23x/pom.xml

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -22,14 +22,14 @@
2222
<parent>
2323
<groupId>com.nvidia</groupId>
2424
<artifactId>rapids-4-spark-parent_2.12</artifactId>
25-
<version>24.08.0</version>
25+
<version>24.08.1</version>
2626
<relativePath>../../pom.xml</relativePath>
2727
</parent>
2828

2929
<artifactId>rapids-4-spark-delta-23x_2.12</artifactId>
3030
<name>RAPIDS Accelerator for Apache Spark Delta Lake 2.3.x Support</name>
3131
<description>Delta Lake 2.3.x support for the RAPIDS Accelerator for Apache Spark</description>
32-
<version>24.08.0</version>
32+
<version>24.08.1</version>
3333

3434
<properties>
3535
<rapids.module>../delta-lake/delta-23x</rapids.module>

‎delta-lake/delta-24x/pom.xml

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -22,14 +22,14 @@
2222
<parent>
2323
<groupId>com.nvidia</groupId>
2424
<artifactId>rapids-4-spark-jdk-profiles_2.12</artifactId>
25-
<version>24.08.0</version>
25+
<version>24.08.1</version>
2626
<relativePath>../../jdk-profiles/pom.xml</relativePath>
2727
</parent>
2828

2929
<artifactId>rapids-4-spark-delta-24x_2.12</artifactId>
3030
<name>RAPIDS Accelerator for Apache Spark Delta Lake 2.4.x Support</name>
3131
<description>Delta Lake 2.4.x support for the RAPIDS Accelerator for Apache Spark</description>
32-
<version>24.08.0</version>
32+
<version>24.08.1</version>
3333

3434
<properties>
3535
<rapids.module>../delta-lake/delta-24x</rapids.module>

‎delta-lake/delta-spark330db/pom.xml

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -22,14 +22,14 @@
2222
<parent>
2323
<groupId>com.nvidia</groupId>
2424
<artifactId>rapids-4-spark-jdk-profiles_2.12</artifactId>
25-
<version>24.08.0</version>
25+
<version>24.08.1</version>
2626
<relativePath>../../jdk-profiles/pom.xml</relativePath>
2727
</parent>
2828

2929
<artifactId>rapids-4-spark-delta-spark330db_2.12</artifactId>
3030
<name>RAPIDS Accelerator for Apache Spark Databricks 11.3 Delta Lake Support</name>
3131
<description>Databricks 11.3 Delta Lake support for the RAPIDS Accelerator for Apache Spark</description>
32-
<version>24.08.0</version>
32+
<version>24.08.1</version>
3333

3434
<properties>
3535
<rapids.module>../delta-lake/delta-spark330db</rapids.module>

‎delta-lake/delta-spark332db/pom.xml

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -22,14 +22,14 @@
2222
<parent>
2323
<groupId>com.nvidia</groupId>
2424
<artifactId>rapids-4-spark-jdk-profiles_2.12</artifactId>
25-
<version>24.08.0</version>
25+
<version>24.08.1</version>
2626
<relativePath>../../jdk-profiles/pom.xml</relativePath>
2727
</parent>
2828

2929
<artifactId>rapids-4-spark-delta-spark332db_2.12</artifactId>
3030
<name>RAPIDS Accelerator for Apache Spark Databricks 12.2 Delta Lake Support</name>
3131
<description>Databricks 12.2 Delta Lake support for the RAPIDS Accelerator for Apache Spark</description>
32-
<version>24.08.0</version>
32+
<version>24.08.1</version>
3333

3434
<properties>
3535
<rapids.module>../delta-lake/delta-spark332db</rapids.module>

‎delta-lake/delta-spark341db/pom.xml

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -22,14 +22,14 @@
2222
<parent>
2323
<groupId>com.nvidia</groupId>
2424
<artifactId>rapids-4-spark-jdk-profiles_2.12</artifactId>
25-
<version>24.08.0</version>
25+
<version>24.08.1</version>
2626
<relativePath>../../jdk-profiles/pom.xml</relativePath>
2727
</parent>
2828

2929
<artifactId>rapids-4-spark-delta-spark341db_2.12</artifactId>
3030
<name>RAPIDS Accelerator for Apache Spark Databricks 13.3 Delta Lake Support</name>
3131
<description>Databricks 13.3 Delta Lake support for the RAPIDS Accelerator for Apache Spark</description>
32-
<version>24.08.0</version>
32+
<version>24.08.1</version>
3333

3434
<properties>
3535
<rapids.compressed.artifact>false</rapids.compressed.artifact>

‎delta-lake/delta-stub/pom.xml

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -22,14 +22,14 @@
2222
<parent>
2323
<groupId>com.nvidia</groupId>
2424
<artifactId>rapids-4-spark-jdk-profiles_2.12</artifactId>
25-
<version>24.08.0</version>
25+
<version>24.08.1</version>
2626
<relativePath>../../jdk-profiles/pom.xml</relativePath>
2727
</parent>
2828

2929
<artifactId>rapids-4-spark-delta-stub_2.12</artifactId>
3030
<name>RAPIDS Accelerator for Apache Spark Delta Lake Stub</name>
3131
<description>Delta Lake stub for the RAPIDS Accelerator for Apache Spark</description>
32-
<version>24.08.0</version>
32+
<version>24.08.1</version>
3333

3434
<properties>
3535
<rapids.module>../delta-lake/delta-stub</rapids.module>

‎dist/pom.xml

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -22,13 +22,13 @@
2222
<parent>
2323
<groupId>com.nvidia</groupId>
2424
<artifactId>rapids-4-spark-jdk-profiles_2.12</artifactId>
25-
<version>24.08.0</version>
25+
<version>24.08.1</version>
2626
<relativePath>../jdk-profiles/pom.xml</relativePath>
2727
</parent>
2828
<artifactId>rapids-4-spark_2.12</artifactId>
2929
<name>RAPIDS Accelerator for Apache Spark Distribution</name>
3030
<description>Creates the distribution package of the RAPIDS plugin for Apache Spark</description>
31-
<version>24.08.0</version>
31+
<version>24.08.1</version>
3232
<dependencies>
3333
<dependency>
3434
<groupId>com.nvidia</groupId>

‎docs/configs.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -10,7 +10,7 @@ The following is the list of options that `rapids-plugin-4-spark` supports.
1010
On startup use: `--conf [conf key]=[conf value]`. For example:
1111

1212
```
13-
${SPARK_HOME}/bin/spark-shell --jars rapids-4-spark_2.12-24.08.0-cuda11.jar \
13+
${SPARK_HOME}/bin/spark-shell --jars rapids-4-spark_2.12-24.08.1-cuda11.jar \
1414
--conf spark.plugins=com.nvidia.spark.SQLPlugin \
1515
--conf spark.rapids.sql.concurrentGpuTasks=2
1616
```

‎docs/dev/shims.md

Lines changed: 6 additions & 6 deletions
Original file line numberDiff line numberDiff line change
@@ -68,17 +68,17 @@ Using JarURLConnection URLs we create a Parallel World of the current version wi
6868
Spark 3.0.2's URLs:
6969

7070
```text
71-
jar:file:/home/spark/rapids-4-spark_2.12-24.08.0.jar!/
72-
jar:file:/home/spark/rapids-4-spark_2.12-24.08.0.jar!/spark-shared/
73-
jar:file:/home/spark/rapids-4-spark_2.12-24.08.0.jar!/spark302/
71+
jar:file:/home/spark/rapids-4-spark_2.12-24.08.1.jar!/
72+
jar:file:/home/spark/rapids-4-spark_2.12-24.08.1.jar!/spark-shared/
73+
jar:file:/home/spark/rapids-4-spark_2.12-24.08.1.jar!/spark302/
7474
```
7575

7676
Spark 3.2.0's URLs :
7777

7878
```text
79-
jar:file:/home/spark/rapids-4-spark_2.12-24.08.0.jar!/
80-
jar:file:/home/spark/rapids-4-spark_2.12-24.08.0.jar!/spark-shared/
81-
jar:file:/home/spark/rapids-4-spark_2.12-24.08.0.jar!/spark320/
79+
jar:file:/home/spark/rapids-4-spark_2.12-24.08.1.jar!/
80+
jar:file:/home/spark/rapids-4-spark_2.12-24.08.1.jar!/spark-shared/
81+
jar:file:/home/spark/rapids-4-spark_2.12-24.08.1.jar!/spark320/
8282
```
8383

8484
### Late Inheritance in Public Classes

‎docs/download.md

Lines changed: 8 additions & 8 deletions
Original file line numberDiff line numberDiff line change
@@ -18,7 +18,7 @@ cuDF jar, that is either preinstalled in the Spark classpath on all nodes or sub
1818
that uses the RAPIDS Accelerator For Apache Spark. See the [getting-started
1919
guide](https://docs.nvidia.com/spark-rapids/user-guide/latest/getting-started/overview.html) for more details.
2020

21-
## Release v24.08.0
21+
## Release v24.08.1
2222
### Hardware Requirements:
2323

2424
The plugin is tested on the following architectures:
@@ -68,14 +68,14 @@ for your hardware's minimum driver version.
6868
### RAPIDS Accelerator's Support Policy for Apache Spark
6969
The RAPIDS Accelerator maintains support for Apache Spark versions available for download from [Apache Spark](https://spark.apache.org/downloads.html)
7070

71-
### Download RAPIDS Accelerator for Apache Spark v24.08.0
71+
### Download RAPIDS Accelerator for Apache Spark v24.08.1
7272

7373
| Processor | Scala Version | Download Jar | Download Signature |
7474
|-----------|---------------|--------------|--------------------|
75-
| x86_64 | Scala 2.12 | [RAPIDS Accelerator v24.08.0](https://repo1.maven.org/maven2/com/nvidia/rapids-4-spark_2.12/24.08.0/rapids-4-spark_2.12-24.08.0.jar) | [Signature](https://repo1.maven.org/maven2/com/nvidia/rapids-4-spark_2.12/24.08.0/rapids-4-spark_2.12-24.08.0.jar.asc) |
76-
| x86_64 | Scala 2.13 | [RAPIDS Accelerator v24.08.0](https://repo1.maven.org/maven2/com/nvidia/rapids-4-spark_2.13/24.08.0/rapids-4-spark_2.13-24.08.0.jar) | [Signature](https://repo1.maven.org/maven2/com/nvidia/rapids-4-spark_2.13/24.08.0/rapids-4-spark_2.13-24.08.0.jar.asc) |
77-
| arm64 | Scala 2.12 | [RAPIDS Accelerator v24.08.0](https://repo1.maven.org/maven2/com/nvidia/rapids-4-spark_2.12/24.08.0/rapids-4-spark_2.12-24.08.0-cuda11-arm64.jar) | [Signature](https://repo1.maven.org/maven2/com/nvidia/rapids-4-spark_2.12/24.08.0/rapids-4-spark_2.12-24.08.0-cuda11-arm64.jar.asc) |
78-
| arm64 | Scala 2.13 | [RAPIDS Accelerator v24.08.0](https://repo1.maven.org/maven2/com/nvidia/rapids-4-spark_2.13/24.08.0/rapids-4-spark_2.13-24.08.0-cuda11-arm64.jar) | [Signature](https://repo1.maven.org/maven2/com/nvidia/rapids-4-spark_2.13/24.08.0/rapids-4-spark_2.13-24.08.0-cuda11-arm64.jar.asc) |
75+
| x86_64 | Scala 2.12 | [RAPIDS Accelerator v24.08.1](https://repo1.maven.org/maven2/com/nvidia/rapids-4-spark_2.12/24.08.1/rapids-4-spark_2.12-24.08.1.jar) | [Signature](https://repo1.maven.org/maven2/com/nvidia/rapids-4-spark_2.12/24.08.1/rapids-4-spark_2.12-24.08.1.jar.asc) |
76+
| x86_64 | Scala 2.13 | [RAPIDS Accelerator v24.08.1](https://repo1.maven.org/maven2/com/nvidia/rapids-4-spark_2.13/24.08.1/rapids-4-spark_2.13-24.08.1.jar) | [Signature](https://repo1.maven.org/maven2/com/nvidia/rapids-4-spark_2.13/24.08.1/rapids-4-spark_2.13-24.08.1.jar.asc) |
77+
| arm64 | Scala 2.12 | [RAPIDS Accelerator v24.08.1](https://repo1.maven.org/maven2/com/nvidia/rapids-4-spark_2.12/24.08.1/rapids-4-spark_2.12-24.08.1-cuda11-arm64.jar) | [Signature](https://repo1.maven.org/maven2/com/nvidia/rapids-4-spark_2.12/24.08.1/rapids-4-spark_2.12-24.08.1-cuda11-arm64.jar.asc) |
78+
| arm64 | Scala 2.13 | [RAPIDS Accelerator v24.08.1](https://repo1.maven.org/maven2/com/nvidia/rapids-4-spark_2.13/24.08.1/rapids-4-spark_2.13-24.08.1-cuda11-arm64.jar) | [Signature](https://repo1.maven.org/maven2/com/nvidia/rapids-4-spark_2.13/24.08.1/rapids-4-spark_2.13-24.08.1-cuda11-arm64.jar.asc) |
7979

8080
This package is built against CUDA 11.8. It is tested on V100, T4, A10, A100, L4 and H100 GPUs with
8181
CUDA 11.8 through CUDA 12.0.
@@ -84,9 +84,9 @@ CUDA 11.8 through CUDA 12.0.
8484
* Download the [PUB_KEY](https://keys.openpgp.org/[email protected]).
8585
* Import the public key: `gpg --import PUB_KEY`
8686
* Verify the signature for Scala 2.12 jar:
87-
`gpg --verify rapids-4-spark_2.12-24.08.0.jar.asc rapids-4-spark_2.12-24.08.0.jar`
87+
`gpg --verify rapids-4-spark_2.12-24.08.1.jar.asc rapids-4-spark_2.12-24.08.1.jar`
8888
* Verify the signature for Scala 2.13 jar:
89-
`gpg --verify rapids-4-spark_2.13-24.08.0.jar.asc rapids-4-spark_2.13-24.08.0.jar`
89+
`gpg --verify rapids-4-spark_2.13-24.08.1.jar.asc rapids-4-spark_2.13-24.08.1.jar`
9090

9191
The output of signature verify:
9292

‎integration_tests/README.md

Lines changed: 3 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -263,7 +263,7 @@ individually, so you don't risk running unit tests along with the integration te
263263
http://www.scalatest.org/user_guide/using_the_scalatest_shell
264264

265265
```shell
266-
spark-shell --jars rapids-4-spark-tests_2.12-24.08.0-tests.jar,rapids-4-spark-integration-tests_2.12-24.08.0-tests.jar,scalatest_2.12-3.0.5.jar,scalactic_2.12-3.0.5.jar
266+
spark-shell --jars rapids-4-spark-tests_2.12-24.08.1-tests.jar,rapids-4-spark-integration-tests_2.12-24.08.1-tests.jar,scalatest_2.12-3.0.5.jar,scalactic_2.12-3.0.5.jar
267267
```
268268

269269
First you import the `scalatest_shell` and tell the tests where they can find the test files you
@@ -286,7 +286,7 @@ If you just want to verify the SQL replacement is working you will need to add t
286286
assumes CUDA 11.0 is being used and the Spark distribution is built with Scala 2.12.
287287

288288
```
289-
$SPARK_HOME/bin/spark-submit --jars "rapids-4-spark_2.12-24.08.0-cuda11.jar" ./runtests.py
289+
$SPARK_HOME/bin/spark-submit --jars "rapids-4-spark_2.12-24.08.1-cuda11.jar" ./runtests.py
290290
```
291291

292292
You don't have to enable the plugin for this to work, the test framework will do that for you.
@@ -443,7 +443,7 @@ To run cudf_udf tests, need following configuration changes:
443443
As an example, here is the `spark-submit` command with the cudf_udf parameter on CUDA 11.0:
444444

445445
```
446-
$SPARK_HOME/bin/spark-submit --jars "rapids-4-spark_2.12-24.08.0-cuda11.jar,rapids-4-spark-tests_2.12-24.08.0.jar" --conf spark.rapids.memory.gpu.allocFraction=0.3 --conf spark.rapids.python.memory.gpu.allocFraction=0.3 --conf spark.rapids.python.concurrentPythonWorkers=2 --py-files "rapids-4-spark_2.12-24.08.0-cuda11.jar" --conf spark.executorEnv.PYTHONPATH="rapids-4-spark_2.12-24.08.0-cuda11.jar" ./runtests.py --cudf_udf
446+
$SPARK_HOME/bin/spark-submit --jars "rapids-4-spark_2.12-24.08.1-cuda11.jar,rapids-4-spark-tests_2.12-24.08.1.jar" --conf spark.rapids.memory.gpu.allocFraction=0.3 --conf spark.rapids.python.memory.gpu.allocFraction=0.3 --conf spark.rapids.python.concurrentPythonWorkers=2 --py-files "rapids-4-spark_2.12-24.08.1-cuda11.jar" --conf spark.executorEnv.PYTHONPATH="rapids-4-spark_2.12-24.08.1-cuda11.jar" ./runtests.py --cudf_udf
447447
```
448448

449449
### Enabling fuzz tests

0 commit comments

Comments
 (0)