https://github.com/yangboz/verdant-octo-woof

Spring-boot+Hadoop/HIPI+SwaggerUI RESTful.
https://github.com/yangboz/verdant-octo-woof

Last synced: 3 months ago
JSON representation

Spring-boot+Hadoop/HIPI+SwaggerUI RESTful.

• Host: GitHub
• URL: https://github.com/yangboz/verdant-octo-woof
• Owner: yangboz
• License: mit
• Created: 2015-10-28T00:58:19.000Z (almost 10 years ago)
• Default Branch: master
• Last Pushed: 2016-11-01T07:36:05.000Z (almost 9 years ago)
• Last Synced: 2025-04-02T14:11:51.145Z (6 months ago)
• Language: JavaScript
• Homepage: http://yangboz.github.io
• Size: 1.82 MB
• Stars: 2
• Watchers: 2
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

README

          
# verdant-octo-woof

Spring-boot+SwaggerUI RESTful for Image processing using OpenCV on Hadoop using HIPI.

We can create a Hadoop MapReduce Job with Spring Data Apache Hadoop by following these steps:

##0.Homebrew install hadoop

http://ericlondon.com/2014/08/01/hadoop-pig-ruby-map-reduce-on-osx-via-homebrew.html

http://amodernstory.com/2014/09/23/installing-hadoop-on-mac-osx-yosemite/

##1.Homebrew install open-cv with java

brew tap homebrew/science

brew install opencv --with-java

1.Get the required dependencies by using Maven.

##2.Create the mapper component.

##3.Create the reducer component.

##4.Configure the application context.

##5.Load the application context when the application starts.

##6.SwaggerUI RESTful controllers.

##7.Image processing using OpenCV on Hadoop: 

###Mapper:

    1.Load OpenCV native library

    2.Create CascadeClassifier

    3.onvert HIPI FloatImage to OpenCV Mat

    4.Detect and count faces in the image

    5.Write number of faces detected to context

###Reducer:

    1.Count number of files processed

    2.Count number of faces detected

    3.Output number of files and faces detected

http://dinesh-malav.blogspot.com/2015/05/image-processing-using-opencv-on-hadoop.html

https://github.com/GopiKrishnan-V/hipi-hadoop

# References

http://amodernstory.com/2014/09/23/installing-hadoop-on-mac-osx-yosemite/

http://www.petrikainulainen.net/programming/apache-hadoop/creating-hadoop-mapreduce-job-with-spring-data-apache-hadoop/

https://github.com/yangboz/spring-data-apache-hadoop-examples/tree/master/mapreduce

http://noushinb.blogspot.com/2013/04/reading-writing-hadoop-sequence-files.html

http://hipi.cs.virginia.edu/gettingstarted.html