org.thales.punch.libraries.punchlang.resource.builder

Class CsvToMapInPlaceResourceBuilder

java.lang.Object

org.thales.punch.libraries.punchlang.resource.builder.AbstractCsvLineResourceBuilder

org.thales.punch.libraries.punchlang.resource.builder.AbstractCsvResourceBuilder

org.thales.punch.libraries.punchlang.resource.builder.CsvToMapInPlaceResourceBuilder

All Implemented Interfaces:

IResourceBuilder

public class CsvToMapInPlaceResourceBuilder
extends AbstractCsvResourceBuilder

Load a CSV file into a dictionary Tuple. One of the CSV column is used as the hash key. Ths CSV file is read using a streaming strategy and parsed on the fly.

This builder always returns the same resource Tuple, to avoid twice the memory for the current and the newly loaded copy.

Author:

dimi

Nested Class Summary

Nested classes/interfaces inherited from interface org.thales.punch.libraries.punchlang.api.IResourceBuilder

IResourceBuilder.CompactionType

Field Summary

Fields inherited from class org.thales.punch.libraries.punchlang.resource.builder.AbstractCsvLineResourceBuilder

columns, csvOperator

Constructor Summary

Constructors

Constructor and Description
CsvToMapInPlaceResourceBuilder(Supplier<IResourceTuple> supplier, List<String> columns, String delimiter, boolean inferTypes, String hashKey, boolean lowerCase, boolean hasHeader) Ctor.

Method Summary

Modifier and Type	Method and Description
void	onStart() The same resource tuple is kept in memory, we simply signal a new loading is about to happen.

Methods inherited from class org.thales.punch.libraries.punchlang.resource.builder.AbstractCsvResourceBuilder

onEnd

Methods inherited from class org.thales.punch.libraries.punchlang.resource.builder.AbstractCsvLineResourceBuilder

onStream

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.thales.punch.libraries.punchlang.api.IResourceBuilder

prepare

Constructor Detail

CsvToMapInPlaceResourceBuilder

public CsvToMapInPlaceResourceBuilder(Supplier<IResourceTuple> supplier,
                                      List<String> columns,
                                      String delimiter,
                                      boolean inferTypes,
                                      String hashKey,
                                      boolean lowerCase,
                                      boolean hasHeader)

Ctor.

Parameters:

supplier - the tuple supplier. It is invoked at every re‚Singsource loading.

isLazy - true to make the tuple contain only strings, to avoid costly inner tuples. This is backed by special tuple implementations.

hashKey - the key to be used as a hash key for the resource tuple.

lowerCaseKeys - true to convert all keys to lower case‚

Method Detail

onStart

public void onStart()

The same resource tuple is kept in memory, we simply signal a new loading is about to happen.

Specified by:

onStart in interface IResourceBuilder

Overrides:

onStart in class AbstractCsvLineResourceBuilder