|
||||||||||
PREV CLASS NEXT CLASS | FRAMES NO FRAMES | |||||||||
SUMMARY: NESTED | FIELD | CONSTR | METHOD | DETAIL: FIELD | CONSTR | METHOD |
java.lang.Object datafu.hourglass.mapreduce.ObjectProcessor datafu.hourglass.mapreduce.ObjectReducer datafu.hourglass.mapreduce.CollapsingCombiner
public class CollapsingCombiner
The combiner used by AbstractPartitionCollapsingIncrementalJob
and its derived classes.
An implementation of Accumulator
is used to perform aggregation and produce the
intermediate value.
Constructor Summary | |
---|---|
CollapsingCombiner()
|
Method Summary | |
---|---|
Accumulator<org.apache.avro.generic.GenericRecord,org.apache.avro.generic.GenericRecord> |
getAccumulator()
Gets the accumulator used to perform aggregation. |
boolean |
getReuseOutput()
Gets whether previous output is being reused. |
PartitionCollapsingSchemas |
getSchemas()
Gets the schemas. |
void |
reduce(java.lang.Object keyObj,
java.lang.Iterable<java.lang.Object> values,
org.apache.hadoop.mapreduce.ReduceContext<java.lang.Object,java.lang.Object,java.lang.Object,java.lang.Object> context)
|
void |
setAccumulator(Accumulator<org.apache.avro.generic.GenericRecord,org.apache.avro.generic.GenericRecord> acc)
Sets the accumulator used to perform aggregation. |
void |
setOutputDateRange(DateRange dateRange)
Sets the date range for the output. |
void |
setReuseOutput(boolean reuseOutput)
Sets whether previous output is being reused. |
void |
setSchemas(PartitionCollapsingSchemas schemas)
Sets the schemas. |
Methods inherited from class datafu.hourglass.mapreduce.ObjectProcessor |
---|
close, getContext, setContext |
Methods inherited from class java.lang.Object |
---|
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait |
Constructor Detail |
---|
public CollapsingCombiner()
Method Detail |
---|
public void reduce(java.lang.Object keyObj, java.lang.Iterable<java.lang.Object> values, org.apache.hadoop.mapreduce.ReduceContext<java.lang.Object,java.lang.Object,java.lang.Object,java.lang.Object> context) throws java.io.IOException, java.lang.InterruptedException
reduce
in class ObjectReducer
java.io.IOException
java.lang.InterruptedException
public void setSchemas(PartitionCollapsingSchemas schemas)
schemas
- public PartitionCollapsingSchemas getSchemas()
public boolean getReuseOutput()
public void setReuseOutput(boolean reuseOutput)
reuseOutput
- true if previous output is reusedpublic Accumulator<org.apache.avro.generic.GenericRecord,org.apache.avro.generic.GenericRecord> getAccumulator()
public void setAccumulator(Accumulator<org.apache.avro.generic.GenericRecord,org.apache.avro.generic.GenericRecord> acc)
acc
- The accumulatorpublic void setOutputDateRange(DateRange dateRange)
DateRangeConfigurable
setOutputDateRange
in interface DateRangeConfigurable
dateRange
- output date range
|
||||||||||
PREV CLASS NEXT CLASS | FRAMES NO FRAMES | |||||||||
SUMMARY: NESTED | FIELD | CONSTR | METHOD | DETAIL: FIELD | CONSTR | METHOD |