See: Description
| Class | Description |
|---|---|
| AppendToBag |
Appends a tuple to a bag.
|
| BagConcat |
Unions all input bags to produce a single bag containing all tuples.
|
| BagGroup |
Performs an in-memory group operation on a bag.
|
| BagJoin |
Performs an in-memory join across multiple bags.
|
| BagLeftOuterJoin |
Performs an in-memory left outer join across multiple bags.
|
| BagSplit |
Splits a bag of tuples into a bag of bags, where the inner bags collectively contain
the tuples from the original bag.
|
| CountDistinctUpTo |
Generates a count of the number of distinct tuples in a bag, up to a preset limit.
|
| CountDistinctUpTo.Final |
Receives output either from initial results or intermediate
Outputs an integer with the number of distinct tuples, up to the maximum desired.
|
| CountDistinctUpTo.Initial |
Outputs a tuple containing a DataBag containing a single tuple T (the original schema) or an empty bag
T -> ({T})
|
| CountDistinctUpTo.Intermediate |
Receives a bag of bags, each containing a single tuple with the original input schema T
Outputs a bag of distinct tuples each with the original schema T: {({T}),({T}),({T})} -> ({T, T, T})
or if the maximum is reached, null: {({T}),({T}),({T}) ..} -> (null)
|
| CountEach |
Generates a count of the number of times each distinct tuple appears in a bag.
|
| DistinctBy |
Get distinct elements in a bag by a given set of field positions.
|
| EmptyBagToNull |
Returns null if the input is an empty bag; otherwise,
returns the input bag unchanged.
|
| EmptyBagToNullFields |
For an empty bag, inserts a tuple having null values for all fields;
otherwise, the input bag is returned unchanged.
|
| Enumerate |
Enumerate a bag, appending to each tuple its index within the bag.
|
| FirstTupleFromBag |
Returns the first tuple from a bag.
|
| NullToEmptyBag |
Returns an empty bag if the input is null; otherwise,
returns the input bag unchanged.
|
| PrependToBag |
Prepends a tuple to a bag.
|
| ReverseEnumerate |
Enumerate a bag, appending to each tuple its index within the bag, with indices being produced in
descending order.
|
| TupleFromBag |
This UDF will extract a tuple from a bag based on a specified index.
|
| UnorderedPairs |
Generates pairs of all items in a bag.
|
| ZipBags |
This udf takes any number of bags and allows you to zip them into one bag
with the tuples inside each bag concatenated to each other.
|
| Enum | Description |
|---|---|
| BagJoin.JoinType |