Spark configure.sh
Starting in the MEP 4.0 release, run configure.sh -R
to complete your
Spark configuration when manually installing Spark or upgrading to a new version.
The command is the following:
/opt/mapr/server/configure.sh -R
In the case of Spark Standalone and Spark on YARN, this is the last step in the configuration process. In the case of Spark on Mesos, run the script as the first step in Configuring Spark on Mesos. Running this script enables Spark security features if you have enabled security on your cluster.
SPARK_HOME/conf/spark-defaults.conf
file:#SECURITY BLOCK
...
#END OF THE SECURITY CONFIGURATION BLOCK
configure.sh
. The script uses these
comments to locate security properties.spark.driver.port
and spark.blockManager.port
properties.