Spark-submit: Examples and Reference
Source

Spark-submit: Examples and Reference

Last updated:

WIP ALERT this is a work in progress

Simplest possible example

Using a Scala Jar file and running locally (no cluster) using 2 threads.

$ spark-submit  --class name.space.to.MyMainClass \
                --master local[2] \
                path/to/my-spark-jar.jar \
                argument1 \
                argument2 \
                argument3

References

Dialogue & Discussion