Package datafu.hourglass.mapreduce

Implementations of mappers, combiners, and reducers used by incremental jobs.

See:
          Description

Class Summary
AvroKeyValueIdentityMapper A mapper which outputs key-value pairs as-is.
CollapsingCombiner The combiner used by AbstractPartitionCollapsingIncrementalJob and its derived classes.
CollapsingMapper The mapper used by AbstractPartitionCollapsingIncrementalJob and its derived classes.
CollapsingReducer The reducer used by AbstractPartitionCollapsingIncrementalJob and its derived classes.
DelegatingCombiner A Hadoop combiner which delegates to an implementation read from the distributed cache.
DelegatingMapper A Hadoop mapper which delegates to an implementation read from the distributed cache.
DelegatingReducer A Hadoop reducer which delegates to an implementation read from the distributed cache.
DistributedCacheHelper Methods for working with the Hadoop distributed cache.
ObjectMapper Defines the interface for a mapper implementation that DelegatingMapper delegates to.
ObjectProcessor Base class for ObjectMapper and ObjectReducer.
ObjectReducer Defines the interface for combiner and reducer implementations that DelegatingCombiner and DelegatingReducer delegate to.
Parameters Parameters used by the jobs to pass configuration settings to the mappers, combiners, and reducers.
PartitioningCombiner The combiner used by AbstractPartitionPreservingIncrementalJob and its derived classes.
PartitioningMapper The mapper used by AbstractPartitionPreservingIncrementalJob and its derived classes.
PartitioningReducer The reducer used by AbstractPartitionPreservingIncrementalJob and its derived classes.
 

Package datafu.hourglass.mapreduce Description

Implementations of mappers, combiners, and reducers used by incremental jobs. These are used internally by AbstractPartitionPreservingIncrementalJob and AbstractPartitionCollapsingIncrementalJob.



Matthew Hayes