File Model Input

Overview

This node is designed to take load in memory a machine learning model generated by an mllib pipeline. The file should be binary blob.

Warning

For the sake of keeping consistency across nodes name parameter, we have decided to keep file_path as the naming convention. As you can guess from the below example, what is expected is only the file name. The absolute or relative path of the model file should be set inside your settings as shown in the example below.

Runtime Compatibility

• PySpark : ❌
• Spark : ✅

Example

---
type: punchline
version: '6.0'
runtime: spark
dag:
- type: file_model_input
  component: file_model_input
  settings:
    file_path: "/data/model.bin"
  publish:
  - stream: model

Parameters

Name	Type	mandatory	Default value	Description
file_path	String	true	NONE	The name of the file specified within spark.files parameter.