HOWTO bind spark ui to an other address
Description¶
Access to Spark ui from a specific IP adress instead of localhost.
Prerequisite¶
Your standalone is installed.
What to do ?¶
Update your standalone:
Open the following file¶
1 2 | cd $PUNCHPLATFORM_CONF_DIR/../external/spark-2.3.2-bin-hadoop2.7/conf vim spark-env.sh |
Add and modify the following lines¶
1 2 3 | #YOUR_IP = IP were you deployed spark SPARK_MASTER_HOST=<YOUR_IP> SPARK_LOCAL_IP=<YOUR_IP> |
Deploy Spark¶
1 2 3 | punchplatform-spark --start or punchplatform-standalone --start |
Check Spark ui¶
1 2 | Spark Master UI: http://<YOUR_IP>:8081 Spark Worker UI: http://<YOUR_IP>:8084 |
Warning
You can't replace YOUR_IP by 0.0.0.0 (because the worker and the spark master must communicate between them)