https://github.com/mmcc007/mapreduceaggregate

TDD Mapreduce Aggregate Example
https://github.com/mmcc007/mapreduceaggregate

Last synced: 7 months ago
JSON representation

TDD Mapreduce Aggregate Example

• Host: GitHub
• URL: https://github.com/mmcc007/mapreduceaggregate
• Owner: mmcc007
• Created: 2015-07-08T09:51:08.000Z (over 10 years ago)
• Default Branch: master
• Last Pushed: 2016-05-28T17:18:53.000Z (over 9 years ago)
• Last Synced: 2024-10-19T03:01:35.040Z (12 months ago)
• Language: Java
• Homepage:
• Size: 6.84 KB
• Stars: 0
• Watchers: 2
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

README

          
#TDD Mapreduce Aggregate Example 

This is a basic [Hadoop](http://hadoop.apache.org/) aggregate example that builds with [Maven](http://maven.apache.org/) and uses [MRUnit](http://incubator.apache.org/projects/mrunit.html) for unit testing.

[![Build Status](https://travis-ci.org/mmcc007/MapReduceAggregate.svg?branch=master&style=flat-square)](https://travis-ci.org/mmcc007/MapReduceAggregate)

To run tests and build jar do

    mvn install

You can then run the jar file on your hadoop cluster.

The main point is to demonstrate a use case that is hard to find online, but is common in practice. An aggregate MapReduce is synonymous to a 'groupBy' in a select statement. 

This aggregate feature is synonymous with SQL tools that resolve to this kind of mapreduce instance.