@@ -116,7 +116,7 @@ This will produce a single jar file for the connector in the `./build/libs` dire
116
116
117
117
You can then launch PySpark with the connector available via:
118
118
119
- pyspark --jars build/libs/marklogic-spark-connector-2.3.0.rc1. jar
119
+ pyspark --jars build/libs/marklogic-spark-connector-2.3.0.jar
120
120
121
121
The below command is an example of loading data from the test application deployed via the instructions at the top of
122
122
this page.
@@ -192,7 +192,7 @@ The Spark master GUI is at <http://localhost:8080>. You can use this to view det
192
192
193
193
Now that you have a Spark cluster running, you just need to tell PySpark to connect to it:
194
194
195
- pyspark --master spark://NYWHYC3G0W:7077 --jars build/libs/marklogic-spark-connector-2.3.0.rc1. jar
195
+ pyspark --master spark://NYWHYC3G0W:7077 --jars build/libs/marklogic-spark-connector-2.3.0.jar
196
196
197
197
You can then run the same commands as shown in the PySpark section above. The Spark master GUI will allow you to
198
198
examine details of each of the commands that you run.
@@ -211,12 +211,12 @@ You will need the connector jar available, so run `./gradlew clean shadowJar` if
211
211
You can then run a test Python program in this repository via the following (again, change the master address as
212
212
needed); note that you run this outside of PySpark, and ` spark-submit ` is available after having installed PySpark:
213
213
214
- spark-submit --master spark://NYWHYC3G0W:7077 --jars build/libs/marklogic-spark-connector-2.3.0.rc1. jar src/test/python/test_program.py
214
+ spark-submit --master spark://NYWHYC3G0W:7077 --jars build/libs/marklogic-spark-connector-2.3.0.jar src/test/python/test_program.py
215
215
216
216
You can also test a Java program. To do so, first move the ` com.marklogic.spark.TestProgram ` class from ` src/test/java `
217
217
to ` src/main/java ` . Then run ` ./gradlew clean shadowJar ` to rebuild the connector jar. Then run the following:
218
218
219
- spark-submit --master spark://NYWHYC3G0W:7077 --class com.marklogic.spark.TestProgram build/libs/marklogic-spark-connector-2.3.0.rc1. jar
219
+ spark-submit --master spark://NYWHYC3G0W:7077 --class com.marklogic.spark.TestProgram build/libs/marklogic-spark-connector-2.3.0.jar
220
220
221
221
Be sure to move ` TestProgram ` back to ` src/test/java ` when you are done.
222
222
0 commit comments