File tree 2 files changed +4
-2
lines changed
2 files changed +4
-2
lines changed Original file line number Diff line number Diff line change @@ -16,7 +16,8 @@ obtaining the connector and deploying an example application to MarkLogic.
16
16
The [ PySpark installation guide] ( https://spark.apache.org/docs/latest/api/python/getting_started/install.html ) describes
17
17
how to install PySpark. As noted in that guide, you will need to install Python 3 first if you do not already have it
18
18
installed. [ pyenv] ( https://github.com/pyenv/pyenv#installation ) is a popular choice for doing so, as it simplifies
19
- installing and switching between multiple versions of Python.
19
+ installing and switching between multiple versions of Python. Additionally, be sure to select a PySpark installation
20
+ that depends on Scala 2.12 and not Scala 2.13.
20
21
21
22
Once you have installed PySpark, run the following from a command line to ensure PySpark is installed correctly:
22
23
Original file line number Diff line number Diff line change @@ -12,7 +12,8 @@ from any data source that Spark supports and then writing it to MarkLogic.
12
12
13
13
The connector has the following system requirements:
14
14
15
- * Apache Spark 3.3.0 or higher. The connector has been tested with the latest versions of Spark 3.3.x of 3.4.x.
15
+ * Apache Spark 3.5.3 is recommended, but earlier versions of Spark 3.4.x and 3.3.x should work as well. When choosing
16
+ [ a Spark distribution] ( https://spark.apache.org/downloads.html ) , you must select a distribution that uses Scala 2.12 and not Scala 2.13.
16
17
* For writing data, MarkLogic 9.0-9 or higher.
17
18
* For reading data, MarkLogic 10.0-9 or higher.
18
19
You can’t perform that action at this time.
0 commit comments