org.thales.punch.libraries.storm.bolt.file.buffer

Class PlainArchiveBuffer

java.lang.Object

org.thales.punch.libraries.storm.bolt.file.buffer.AbstractArchiveBuffer

org.thales.punch.libraries.storm.bolt.file.buffer.PlainArchiveBuffer

All Implemented Interfaces:

IArchiveBuffer

Direct Known Subclasses:

GzipArchiveBuffer

public class PlainArchiveBuffer
extends AbstractArchiveBuffer

The plain archiver simply creates a RAM byte array with the batch content.

This can only be used for testing or if you have at hand a filesystem based compression support.

This is also the base for all non-streaming buffers.

Author:

dimi

Field Summary

Fields

Modifier and Type	Field and Description
protected boolean	createRoot
protected ByteArrayOutputStream	outputStream

Fields inherited from class org.thales.punch.libraries.storm.bolt.file.buffer.AbstractArchiveBuffer

destinations, filename, maxWrites, minWrites, pool

Constructor Summary

Constructors

Constructor and Description
PlainArchiveBuffer(int minWrites, int maxWrites, List<org.thales.punch.libraries.objectstorage.tuples.ArchiveDevice> destinations, org.thales.punch.libraries.record.client.encoder.api.IRecordEncoder<Map<String,Object>> encoder, org.thales.punch.libraries.record.client.encoder.api.IRecordEncoder.RecordFormat format, boolean createRoot) Ctor

Method Summary

Modifier and Type	Method and Description
void	close(List<String> successAddresses) Close this archive buffer.
protected byte[]	getByteArray() Get final byte array
String	getDigest() Return the digest of written bytes
long	getSize() Return the size, compressed if compression enabled, of written bytes
long	getUncompressedSize() Return the size, uncompressed if compression enabled, of written bytes
void	put(Map<String,Object> record) Add a single item in the archive buffer.
protected void	putBytes(byte[] bytes) Write bytes to correct buffer
protected void	writeToDestination(org.thales.punch.libraries.objectstorage.tuples.ArchiveDevice destination, byte[] bb) Write byte array to provided destination.

Methods inherited from class org.thales.punch.libraries.storm.bolt.file.buffer.AbstractArchiveBuffer

exit, getBatchOutputPath, handleDeviceFailure, prepare

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

outputStream

protected final ByteArrayOutputStream outputStream

createRoot

protected final boolean createRoot

Constructor Detail

PlainArchiveBuffer

public PlainArchiveBuffer(int minWrites,
                          int maxWrites,
                          List<org.thales.punch.libraries.objectstorage.tuples.ArchiveDevice> destinations,
                          org.thales.punch.libraries.record.client.encoder.api.IRecordEncoder<Map<String,Object>> encoder,
                          org.thales.punch.libraries.record.client.encoder.api.IRecordEncoder.RecordFormat format,
                          boolean createRoot)

Ctor

Parameters:

createRoot - true to create the root directory

Method Detail

getByteArray

protected byte[] getByteArray()

Get final byte array

Returns:

output stream content

writeToDestination

protected void writeToDestination(org.thales.punch.libraries.objectstorage.tuples.ArchiveDevice destination,
                                  byte[] bb)
                           throws IOException

Write byte array to provided destination.

Parameters:

destination - target

bb - content to write

Throws:

IOException - Unable to write

put

public void put(Map<String,Object> record)

Description copied from interface: IArchiveBuffer

Add a single item in the archive buffer. Watch out here an item means a csv line or one column.

Parameters:

record - the input record

putBytes

protected void putBytes(byte[] bytes)
                 throws IOException

Write bytes to correct buffer

Parameters:

bytes - content to write

Throws:

IOException - Unable to write

getSize

public long getSize()

Description copied from interface: IArchiveBuffer

Return the size, compressed if compression enabled, of written bytes

Returns:

compressed size

getUncompressedSize

public long getUncompressedSize()

Description copied from interface: IArchiveBuffer

Return the size, uncompressed if compression enabled, of written bytes

Returns:

uncompressed size

close

public void close(List<String> successAddresses)

Description copied from interface: IArchiveBuffer

Close this archive buffer. You cannot use it anymore after calling this. You of course MUST call this once done writing to an archive.

Parameters:

successAddresses - in case of success the returned list of where the writes were successful.

getDigest

public String getDigest()

Description copied from interface: IArchiveBuffer

Return the digest of written bytes

Returns:

SHA256 Digest