Skip to content

Sparkline

Description

An extended version of Spark3 image with additional punch dependencies.

This image can be used to launch:

  • punchlines using pyspark or spark runtime
  • plan that schedules pyspark or spark punchlines

The provided image is opinionated as described below:

and all the punch environment variables needed during runtime execution of a punch application:

ENV SPARK_HOME=/opt/spark \
    PUNCHPLATFORM_INSTALL_DIR=/punchplatform \
    PUNCHPLATFORM_LOG_DIR=/punchplatform/conf/logs \
    PUNCHPLATFORM_LOG4J_CONF_DIR=$PUNCHPLATFORM_LOG4J_CONF_DIR \
    PUNCHPLATFORM_PEX_CACHE_DIR=/punchplatform/cache_dir \
    PUNCHPLATFORM_CONF_DIR=/punchplatform/conf \
    PUNCHPLATFORM_PROPERTIES_FILE=/punchplatform/conf/punchplatform.properties \
    PUNCHPLATFORM_SPARK_INSTALL_DIR=$SPARK_HOME

Usage

This image is used in sparkline helm

Get it !

docker pull gitlab.thalesdigital.io:5005/punch/product/pp-punch/sparkline