Skip to content

Track 8 Advanced topics

Abstract

aim-track8 track shows how to write ingest/sink/processing nodes

Processing Nodes

shows a processing node with some static data. Goal is to explain best practices when you want to develop your own node (split cleaning and processing steps for example)

Classic

UDF (Spark SQL)

JAVA

read the doc

PYTHON

read the doc

Input & Output Nodes

An example on how to ingest stored data from an SQL-like database and how to store in it.

SQL-lite is used for demonstration

follow track 2 to install the nodes

ingest

sink

configuration

doc1

doc2