https://github.com/stigkj/hdfs-indexer-test

https://github.com/stigkj/hdfs-indexer-test

Last synced: about 2 months ago
JSON representation

• Host: GitHub
• URL: https://github.com/stigkj/hdfs-indexer-test
• Owner: stigkj
• Created: 2012-01-23T10:29:25.000Z (about 13 years ago)
• Default Branch: master
• Last Pushed: 2012-01-23T10:30:31.000Z (about 13 years ago)
• Last Synced: 2023-04-11T10:55:53.196Z (almost 2 years ago)
• Language: Java
• Homepage:
• Size: 149 KB
• Stars: 1
• Watchers: 2
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: Readme.md

Awesome Lists containing this project

README

        
# Prerequisites

* Chef >= 0.8.10

* vagrant ruby gem

* [VirtualBox][vb-dl]

If you have trouble with vagrant starting the Virtual Machine correctly, often installing the corresponding [VirtualBox Extension Pack][vb-dl] helps.

[vb-dl]: https://www.virtualbox.org/wiki/Downloads

# Installation

Clone this git repository and run

    rake setup

This tasks initializes the git submodules, which basically are all the chef cookbooks.

After this task has run successfully, you can boot up the virtual machine with

    vagrant up

This downloads an ubuntu box and sets up the virtual machine through chef-solo.

When the machine is ready, you can jump in there with

    vagrant ssh

Vagrant also sets up some port forwarding.

If you visit localhost:8088 on your host system, you should get to a hue web interface.

Hue is a web application by Cloudera and makes browsing jobs and the HDFS more comfortable.

Now if you have run `vagrant ssh` and are in the VM, change to the projects directory with `cd /vagrant`.

Here you can run a basic job with

    gradle runJar

To initiate the performance tests, run

    grade comparePerformance