datafu.pig.sets

Class SetIntersect

java.lang.Object

org.apache.pig.EvalFunc<org.apache.pig.data.DataBag>

datafu.pig.sets.SetOperationsBase

datafu.pig.sets.SetIntersect

public class SetIntersect
extends SetOperationsBase

Computes the set intersection of two or more bags. Duplicates are eliminated. The input bags must be sorted.

Example:

 
 define SetIntersect datafu.pig.sets.SetIntersect();

 -- input:
 -- ({(1,10),(2,20),(3,30),(4,40)},{(2,20),(4,40),(8,80)})
 input = LOAD 'input' AS (B1:bag{T:tuple(val1:int,val2:int)},B2:bag{T:tuple(val1:int,val2:int)});

 input = FOREACH input {
   B1 = ORDER B1 BY val1 ASC, val2 ASC;
   B2 = ORDER B2 BY val1 ASC, val2 ASC;

   -- output:
   -- ({(2,20),(4,40)})
   GENERATE SetIntersect(B1,B2);
 }
 

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.pig.EvalFunc

org.apache.pig.EvalFunc.SchemaType

Field Summary

Fields inherited from class org.apache.pig.EvalFunc

log, pigLogger, reporter, returnType

Constructor Summary

Constructors

Constructor and Description
SetIntersect()

Method Summary

Modifier and Type	Method and Description
boolean	all_equal(java.util.PriorityQueue<datafu.pig.sets.SetIntersect.pair> pq)
org.apache.pig.data.DataBag	exec(org.apache.pig.data.Tuple input)

Methods inherited from class datafu.pig.sets.SetOperationsBase

outputSchema

Methods inherited from class org.apache.pig.EvalFunc

allowCompileTimeCalculation, finish, getArgToFuncMapping, getCacheFiles, getInputSchema, getLogger, getPigLogger, getReporter, getReturnType, getSchemaName, getSchemaType, getShipFiles, isAsynchronous, progress, setInputSchema, setPigLogger, setReporter, setUDFContextSignature, warn

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

SetIntersect

public SetIntersect()

Method Detail

all_equal

public boolean all_equal(java.util.PriorityQueue<datafu.pig.sets.SetIntersect.pair> pq)

exec

public org.apache.pig.data.DataBag exec(org.apache.pig.data.Tuple input)
                                 throws java.io.IOException

Specified by:

exec in class org.apache.pig.EvalFunc<org.apache.pig.data.DataBag>

Throws:

java.io.IOException