DistinctLogCounterBolt¶
Overview¶
The Distinct Log Counter Bolt accumulates all incoming tuples in map with a key corresponding to the number in the sequence indicated in the tuple. Useful when testing the connection between an external tool and Punchplatform.
Bolt-level parameters¶
-
checking_period
Integer
Default : 30
Period in seconds to check and emit the current size of the map -
field_to_split
String
Field in the log to analyze. By default, we will check all fields to find the sequence number
-
separator
string
Split separator to analyze the value of the field in the log
-
sequence_attribute
Long
Field name with the number in sequence as value
Configuration example¶
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 | { "tenant": ..., "channel": ..., "name": ..., "meta": {...}, "spouts": [...], "bolts": [ ..., { "type" : "distinct_log_counter_bolt", "bolt_settings" : { }, "storm_settings" : { "executors": 1, "component" : "distinct_log_counter", "subscribe" : [ { "component" : "syslog_spout_lumberjack", "stream" : "logs", "grouping": "localOrShuffle" } ], "publish" : [ { "stream" : "logs", "fields" : ["seq"] } ] } }, ... ], } |