Skip to content

Console Stream Output

Overview

The console_stream_output node prints useful information on whatever data it receives. It works in streaming sparklines; i.e. an ever running sparkline that continuously read in data and never stops.

Runtime Compatibility

  • PySpark :
  • Spark :

Example

- component: console
  type: console_stream_output
  settings:
    mode: Update
    truncate: false
  subscribe:
  - component: input
    stream: data

Parameters

Name Type mandatory Default value Description
truncate Boolean false false truncate column size if values are too big
mode String true - 'Update' 'Complete' or 'Append'.

The effect of the mode parameter is the following:

  • Append mode only the new rows in the streaming DataFrame/Dataset will be written.
  • Complete: all the rows in the streaming DataFrame/Dataset will be written every time there are some updates.
  • Update: only the rows that were updated in the streaming DataFrame/Dataset will be written to the sink every time there are some updates.