datafu.hourglass.mapreduce

Class CollapsingMapper

java.lang.Object

datafu.hourglass.mapreduce.ObjectProcessor

datafu.hourglass.mapreduce.ObjectMapper

datafu.hourglass.mapreduce.CollapsingMapper

All Implemented Interfaces:

java.io.Serializable

public class CollapsingMapper
extends ObjectMapper
implements java.io.Serializable

The mapper used by AbstractPartitionCollapsingIncrementalJob and its derived classes.

An implementation of Mapper is used for the map operation, which produces key and intermediate value pairs from the input.

See Also:

Serialized Form

Constructor Summary

Constructors

Constructor and Description
CollapsingMapper()

Method Summary

Methods

Modifier and Type	Method and Description
Mapper<org.apache.avro.generic.GenericRecord,org.apache.avro.generic.GenericRecord,org.apache.avro.generic.GenericRecord>	getMapper() Gets the mapper.
boolean	getReuseOutput() Gets whether previous output is being reused.
PartitionCollapsingSchemas	getSchemas() Gets the Avro schemas.
void	map(java.lang.Object inputObj, org.apache.hadoop.mapreduce.MapContext<java.lang.Object,java.lang.Object,java.lang.Object,java.lang.Object> context)
void	setContext(org.apache.hadoop.mapreduce.TaskInputOutputContext<java.lang.Object,java.lang.Object,java.lang.Object,java.lang.Object> context)
void	setMapper(Mapper<org.apache.avro.generic.GenericRecord,org.apache.avro.generic.GenericRecord,org.apache.avro.generic.GenericRecord> mapper) Sets the mapper.
void	setReuseOutput(boolean reuseOutput) Sets whether previous output is being reused.
void	setSchemas(PartitionCollapsingSchemas schemas) Sets the Avro schemas.

Methods inherited from class datafu.hourglass.mapreduce.ObjectProcessor

close, getContext

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

CollapsingMapper

public CollapsingMapper()

Method Detail

map

public void map(java.lang.Object inputObj,
       org.apache.hadoop.mapreduce.MapContext<java.lang.Object,java.lang.Object,java.lang.Object,java.lang.Object> context)
         throws java.io.IOException,
                java.lang.InterruptedException

Specified by:

map in class ObjectMapper

Throws:

java.io.IOException

java.lang.InterruptedException

getReuseOutput

public boolean getReuseOutput()

Gets whether previous output is being reused.

Returns:

true if previous output is reused

setReuseOutput

public void setReuseOutput(boolean reuseOutput)

Sets whether previous output is being reused.

Parameters:

reuseOutput - true if previous output is reused

setContext

public void setContext(org.apache.hadoop.mapreduce.TaskInputOutputContext<java.lang.Object,java.lang.Object,java.lang.Object,java.lang.Object> context)

Overrides:

setContext in class ObjectProcessor

getMapper

public Mapper<org.apache.avro.generic.GenericRecord,org.apache.avro.generic.GenericRecord,org.apache.avro.generic.GenericRecord> getMapper()

Gets the mapper.

Returns:

mapper the mapper

setMapper

public void setMapper(Mapper<org.apache.avro.generic.GenericRecord,org.apache.avro.generic.GenericRecord,org.apache.avro.generic.GenericRecord> mapper)

Sets the mapper.

Parameters:

mapper - the mapper

setSchemas

public void setSchemas(PartitionCollapsingSchemas schemas)

Sets the Avro schemas.

Parameters:

schemas - the schemas

getSchemas

public PartitionCollapsingSchemas getSchemas()

Gets the Avro schemas.

Returns:

schemas the schemas