datafu.hourglass.avro

Class AvroMultipleInputsUtil

java.lang.Object

datafu.hourglass.avro.AvroMultipleInputsUtil

public class AvroMultipleInputsUtil
extends java.lang.Object

Helper methods for dealing with multiple Avro input schemas. A mapping is stored in the configuration that maps each input path to its corresponding schema. Methods in this class help with loading and storing these schema mappings.

Constructor Summary

Constructors

Constructor and Description
AvroMultipleInputsUtil()

Method Summary

Methods

Modifier and Type	Method and Description
static org.apache.avro.Schema	getInputKeySchemaForSplit(org.apache.hadoop.conf.Configuration conf, org.apache.hadoop.mapreduce.InputSplit split) Gets the schema for a particular input split.
static void	setInputKeySchemaForPath(org.apache.hadoop.mapreduce.Job job, org.apache.avro.Schema schema, java.lang.String path) Sets the job input key schema for a path.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

AvroMultipleInputsUtil

public AvroMultipleInputsUtil()

Method Detail

getInputKeySchemaForSplit

public static org.apache.avro.Schema getInputKeySchemaForSplit(org.apache.hadoop.conf.Configuration conf,
                                               org.apache.hadoop.mapreduce.InputSplit split)

Gets the schema for a particular input split.

Parameters:

conf - configuration to get schema from

split - input split to get schema for

Returns:

schema

setInputKeySchemaForPath

public static void setInputKeySchemaForPath(org.apache.hadoop.mapreduce.Job job,
                            org.apache.avro.Schema schema,
                            java.lang.String path)

Sets the job input key schema for a path.

Parameters:

job - The job to configure.

schema - The input key schema.

path - the path to set the schema for