Track 8 Advanced topics¶
Abstract
aim-track8 track shows how to write ingest/sink/processing nodes
Processing Nodes¶
shows a processing node with some static data. Goal is to explain best practices when you want to develop your own node (split cleaning and processing steps for example)
Classic¶
UDF (Spark SQL)¶
JAVA¶
PYTHON¶
Input & Output Nodes¶
An example on how to ingest stored data from an SQL-like database and how to store in it.
SQL-lite is used for demonstration