Skip to content

DistinctLogCounterBolt

Overview

The Distinct Log Counter Bolt accumulates all incoming tuples in map with a key corresponding to the number in the sequence indicated in the tuple. Useful when testing the connection between an external tool and Punchplatform.

Bolt-level parameters

  • checking_period

    Integer
    Default : 30
    Period in seconds to check and emit the current size of the map

  • field_to_split

    String

    Field in the log to analyze. By default, we will check all fields to find the sequence number

  • separator

    string

    Split separator to analyze the value of the field in the log

  • sequence_attribute

    Long

    Field name with the number in sequence as value

Configuration example

 1
 2
 3
 4
 5
 6
 7
 8
 9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
{
     "tenant": ...,
     "channel": ...,
     "name": ...,
     "meta": {...},

     "spouts": [...],

     "bolts": [
        ...,
        {
         "type" : "distinct_log_counter_bolt",
         "bolt_settings" : {             
         },
         "storm_settings" : {
            "executors": 1,
            "component" : "distinct_log_counter",
            "subscribe" : [
              { 
                "component" : "syslog_spout_lumberjack", 
                "stream" : "logs",
                "grouping": "localOrShuffle" 
              }
            ],
             "publish" : [ 
              { 
                "stream" : "logs", 
                "fields" : ["seq"]
              }
            ]  
          }
      },
        ...
     ],
 }

Use cases

See HOW TO check if my platform receives all the logs