public class AvroParquetArchiveBuffer extends AbstractArchiveBuffer
AvroParquetArchiveBuffer
writes its content into S3 cluster or Filesystem.destinations, filename, maxWrites, minWrites, pool
Constructor and Description |
---|
AvroParquetArchiveBuffer(int minWrites,
int maxWrites,
List<org.thales.punch.libraries.objectstorage.tuples.ArchiveDevice> destinations,
org.thales.punch.libraries.record.client.builder.api.IRecordWriterBuilder<Map<String,Object>> builder,
boolean createRoot) |
Modifier and Type | Method and Description |
---|---|
void |
close(List<String> successAddresses)
Close this archive buffer.
|
String |
getDigest()
Return the digest of written bytes
|
long |
getSize()
Return the size, compressed if compression enabled, of written bytes
|
long |
getUncompressedSize()
Return the size, uncompressed if compression enabled, of written bytes
|
IArchiveBuffer |
prepare(org.thales.punch.libraries.objectstorage.indexing.BatchMetadata metaData)
Before using the archive buffer call this.
|
void |
put(Map<String,Object> record)
Add a single item in the archive buffer.
|
exit, getBatchOutputPath, handleDeviceFailure
public IArchiveBuffer prepare(org.thales.punch.libraries.objectstorage.indexing.BatchMetadata metaData)
IArchiveBuffer
prepare
in interface IArchiveBuffer
prepare
in class AbstractArchiveBuffer
metaData
- the provided context information.public long getSize()
IArchiveBuffer
public long getUncompressedSize()
IArchiveBuffer
public void put(Map<String,Object> record)
IArchiveBuffer
record
- the input recordpublic void close(List<String> successAddresses)
IArchiveBuffer
successAddresses
- in case of success the returned list of where the writes were successful.public String getDigest()
IArchiveBuffer
Copyright © 2023. All rights reserved.