Overview

Abstract

This guide explain how to add your own processing nodes or functions to the punch.

The punch provides you with easy ways to add you own modules as part of the Punchline DAG nodes or functions. The punch is designed so as to minimize adherence to proprietary punch APIs in a way to not make you punch-locked. You basically program using plain python, spark or py-spark APIs, and use our APIs only to make you modules appear as punchline nodes. The benefits are:

1. you focus on your business processing, not on packaging dependencies, security, monitoring, deployment.
2. your modules can be easily shipped to a production punch through a safe, robust and well defined contract.
3. you can easily share your module with the punch user community. The punch is designed for sharing and reusing modules. Just like security parsers, you can design generic anomaly detection jobs, stream or batch components very easily.