https://github.com/alokjani/vagrant-hadoop-hive-spark

Single Node Hadoop, Hive and Spark project using Apache BigTop
https://github.com/alokjani/vagrant-hadoop-hive-spark

bigtop hadoop hive spark vagrant

Last synced: 17 days ago
JSON representation

Single Node Hadoop, Hive and Spark project using Apache BigTop

• Host: GitHub
• URL: https://github.com/alokjani/vagrant-hadoop-hive-spark
• Owner: alokjani
• Created: 2024-12-08T04:30:47.000Z (20 days ago)
• Default Branch: main
• Last Pushed: 2024-12-08T04:37:12.000Z (20 days ago)
• Last Synced: 2024-12-08T05:21:38.409Z (20 days ago)
• Topics: bigtop, hadoop, hive, spark, vagrant
• Language: Shell
• Homepage:
• Size: 0 Bytes
• Stars: 0
• Watchers: 1
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

README

        
# Bigtop Hadoop Lab Vagrant Setup

## Prerequisites

- Vagrant (2.3.4 or later)

- VirtualBox (6.1 or later)

## Setup Instructions

1. Clone this repository

2. Place `provision_bigtop.sh` and `bigtop_test_script.sh` in the same directory as the Vagrantfile

3. Run `chmod +x provision_bigtop.sh bigtop_test_script.sh`

4. Execute `vagrant up`

## Post-Installation

- The test script will automatically run during provisioning

- You can manually run it later with `vagrant ssh -c "/vagrant/bigtop_test_script.sh"`

## Troubleshooting

- Ensure you have the latest Vagrant and VirtualBox

- Check system requirements (4GB RAM recommended)

- Verify internet connection for repository downloads

## Components Installed

- Hadoop (HDFS, YARN)

- Zookeeper

- HBase

- Hive

- Spark

- Tez