Skip to content

File Model Input

Overview

This node is designed to take load in memory a machine learning model generated by an mllib pipeline. The file should be binary blob.

Warning

For the sake of keeping consistency across nodes name parameter, we have decided to keep file_path as the naming convention. As you can guess from the below example, what is expected is only the file name. The absolute or relative path of the model file should be set inside your settings as shown in the example below.

Runtime Compatibility

  • PySpark :
  • Spark :

Example

{
    type: punchline
    version: "6.0"
    runtime: spark
    tenant: default
    dag: [
        { 
            type: file_model_input
            component: file_model_input
            settings: {
                file_path: /data/model.bin
            }
            publish: [
                {
                    // Most probably you will use the mllib node
                    // You must therefore name its model as explained in
                    // the mllib node documentation. 
                    stream: model
                }
            ]
        }
    ]
}

Parameters

Name Type mandatory Default value Description
file_path String true NONE The name of the file specified within spark.files parameter.