Skip to content

Log Collector

Abstract

This chapter explain the recommended deployment of a resilient punch log collector.

One Node Setup

  • The collector is deployed on a single physical servers
  • If log buffering is required a single node Kafka broker is required
  • A single node Shiva cluster is in charge of starting the punchlines
  • Punchlines are in charge of
    • receiving the traffic from the collected zone and saving it into Kafka
    • consuming Kafka and forwarding the traffic to the central punch site

Three Nodes Setup

  • The collector must be deployed on three physical servers
  • The Kafka and Shiva cluster are deployed on three VMs or containers.
  • Punchlines are in charge of
    • receiving the traffic from the collected zone and saving it into Kafka
    • consuming Kafka and forwarding the traffic to the central punch site