I'd like to announce the release of Apache DataFu 1.4.0. This is the first release since graduating from Apache Incubator. Note that the artifacts now begin with apache-datafu instead of apache-datafu-incubating.
Changes:
I'd like to announce the release of Apache DataFu (incubating) 1.3.3.
Additions:
count_all_non_distinct and...I'd like to announce the release of Apache DataFu (incubating) 1.3.2.
Improvements:
I'd like to announce the release of Apache DataFu (incubating) 1.3.1.
Additions:
Improvements:
I'd like to announce the release of Apache DataFu (incubating) 1.3.0. This is the first release since entering the Apache Incubator. Thanks to all who contributed!
Apache DataFu is a collection of libraries for working with large-scale data in Hadoop...
Read more...William Vaughan gave a presentation at ApacheCon North America on Apache DataFu. Check out the slides and video for a great overview of Apache DataFu and some of the cool things you can do with it.
Read more...For a large scale site such as LinkedIn, tracking metrics accurately and efficiently is an important task. For example, imagine we need a dashboard that shows the number of visitors to every page on the site over the last thirty days. To keep this...
Read more...DataFu is an open-source collection of user-defined functions for working with large-scale data in Hadoop and Pig.
About two years ago, we recognized a need for a stable, well-tested library of Pig UDFs that could assist in common data mining and...
Read more...If Pig is the “duct tape for big data“, then DataFu is the WD-40. Or something.
No, seriously, DataFu is a collection of Pig UDFs for data analysis on Hadoop. DataFu includes routines for common statistics tasks (e.g., median, variance), PageRank...
Read more...At LinkedIn, we make extensive use of Apache Pig for performing data analysis on Hadoop. Pig is a simple, high-level programming language that consists of just a few dozen operators and makes it easy to write MapReduce jobs. For more advanced tasks...
Read more...