org.thales.punch.kafka.impl

Class StandardPartitionImpl<K,V>

java.lang.Object

org.thales.punch.kafka.impl.MonitoredPartition

org.thales.punch.kafka.impl.AbstractPartition<K,V>

org.thales.punch.kafka.impl.StandardPartitionImpl<K,V>

Type Parameters:

K - record key type

V - record value type

All Implemented Interfaces:

IPartition

public class StandardPartitionImpl<K,V>
extends AbstractPartition<K,V>

Our IPartition implementation when consumer work with a straigth commit strategy, not requesting the fancy offset tree mode.

This implementation is ok with auto commit strategy, or if it is good for you to commit all the records that have been polled up to some point.

Author:

dimi, cedric

Field Summary

Fields inherited from class org.thales.punch.kafka.impl.AbstractPartition

consumer, earliestOffset, latestOffset, partitionNumber, topic

Fields inherited from class org.thales.punch.kafka.impl.MonitoredPartition

commitLatency, committedOffsetGauge, currentDelayGauge, currentTimestampGauge, earliestOffsetGauge, fetchSize, latestOffsetGauge, messagesCommitBacklogGauge, messagesFetchBacklogGauge, messagesPersistedBacklogGauge, messagesReplayableGauge, metricsContext, msgFetchRate, offsetAckRate, offsetFailRate

Constructor Summary

Constructors

Modifier	Constructor and Description
protected	StandardPartitionImpl(org.thales.punch.libraries.metrics.api.IMetricContext metricContext, String topic, int partitionNumber, org.apache.kafka.clients.consumer.KafkaConsumer<K,V> consumer, long offsetToRead, Long offsetWatchDogTimeout) constructor

Method Summary

Modifier and Type	Method and Description
void	commit(long offset, String metaData) Commit an explicit offset for the given partition.
void	commit(String metadata) Commit the latest acknowledged offset for the given partition.
protected void	onReceive(IRecordHandler<K,V> receiver, org.apache.kafka.clients.consumer.ConsumerRecord<K,V> record) Transfer the record to the receiver.
String	toString()

Methods inherited from class org.thales.punch.kafka.impl.AbstractPartition

attach, getAttachment, getPartitionNumber, getTopic, setEarliestOffset, setLatestOffset

Methods inherited from class org.thales.punch.kafka.impl.MonitoredPartition

close

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Methods inherited from interface org.thales.punch.kafka.api.IPartition

ack, close, fail, rewind

Constructor Detail

StandardPartitionImpl

protected StandardPartitionImpl(org.thales.punch.libraries.metrics.api.IMetricContext metricContext,
                                String topic,
                                int partitionNumber,
                                org.apache.kafka.clients.consumer.KafkaConsumer<K,V> consumer,
                                long offsetToRead,
                                Long offsetWatchDogTimeout)

constructor

Parameters:

topic - the target topic

partitionNumber - the partition number.

consumer - the associated KafkaConsumer

offsetToRead - : the current offset at which the consumer is configured to fetch data for this partition.

offsetWatchDogTimeout - the watchdog committed offset timeout in ms.

Method Detail

toString

public String toString()

Overrides:

toString in class Object

onReceive

protected void onReceive(IRecordHandler<K,V> receiver,
                         org.apache.kafka.clients.consumer.ConsumerRecord<K,V> record)

Transfer the record to the receiver.

Specified by:

onReceive in class AbstractPartition<K,V>

Parameters:

receiver - the record receiver

record - the record

commit

public void commit(String metadata)

Description copied from interface: IPartition

Commit the latest acknowledged offset for the given partition.

Parameters:

metadata - an optional metadata, can be null. If not it will be saved along with the commit

commit

public void commit(long offset,
                   String metaData)

Description copied from interface: IPartition

Commit an explicit offset for the given partition.

Parameters:

offset - the offset to commit. Remember you should always commit +1 the latest processed message (this is the kafka way).

metaData - an optional metadata, can be null. If not it will be saved along with the commit. It should relate to the NEXT data to read and process