Skip to content

Commit 0c3fc03

Browse files
committed
Clarified docs about Scala version
1 parent 1fcec39 commit 0c3fc03

File tree

2 files changed

+4
-2
lines changed

2 files changed

+4
-2
lines changed

docs/getting-started/pyspark.md

Lines changed: 2 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -16,7 +16,8 @@ obtaining the connector and deploying an example application to MarkLogic.
1616
The [PySpark installation guide](https://spark.apache.org/docs/latest/api/python/getting_started/install.html) describes
1717
how to install PySpark. As noted in that guide, you will need to install Python 3 first if you do not already have it
1818
installed. [pyenv](https://github.com/pyenv/pyenv#installation) is a popular choice for doing so, as it simplifies
19-
installing and switching between multiple versions of Python.
19+
installing and switching between multiple versions of Python. Additionally, be sure to select a PySpark installation
20+
that depends on Scala 2.12 and not Scala 2.13.
2021

2122
Once you have installed PySpark, run the following from a command line to ensure PySpark is installed correctly:
2223

docs/index.md

Lines changed: 2 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -12,7 +12,8 @@ from any data source that Spark supports and then writing it to MarkLogic.
1212

1313
The connector has the following system requirements:
1414

15-
* Apache Spark 3.3.0 or higher. The connector has been tested with the latest versions of Spark 3.3.x of 3.4.x.
15+
* Apache Spark 3.5.3 is recommended, but earlier versions of Spark 3.4.x and 3.3.x should work as well. When choosing
16+
[a Spark distribution](https://spark.apache.org/downloads.html), you must select a distribution that uses Scala 2.12 and not Scala 2.13.
1617
* For writing data, MarkLogic 9.0-9 or higher.
1718
* For reading data, MarkLogic 10.0-9 or higher.
1819

0 commit comments

Comments
 (0)