https://github.com/codingcat/loadweaver
a flexible and lightweight workload generator for Hadoop 1.x
https://github.com/codingcat/loadweaver
Last synced: 8 months ago
JSON representation
a flexible and lightweight workload generator for Hadoop 1.x
- Host: GitHub
- URL: https://github.com/codingcat/loadweaver
- Owner: CodingCat
- Created: 2012-06-18T17:39:03.000Z (over 13 years ago)
- Default Branch: master
- Last Pushed: 2014-03-03T19:35:37.000Z (over 11 years ago)
- Last Synced: 2025-01-26T02:52:20.606Z (9 months ago)
- Language: Java
- Homepage:
- Size: 9.85 MB
- Stars: 2
- Watchers: 3
- Forks: 1
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
### Motivation
LoadWeaver is a lightweight and flexible Hadoop workload generator.
The current Hadoop workload generators is either trace-driven(e.g. ) or model-driven(e.g. ). Both of these two kinds enforce the workload arrival pattern, along with some statistical models or previously generated traces. However, during our works on optimization on Hadoop systems, we always need to make out particular pattern of arrives of Hadoop jobs, which are very hard to extract from huge production trace file or described by certain stochastic model.
LoadWeaver fills the hole. LoadWeaver cannot only generates workloads along with statistical models to provide similar workloads in production clusters, but also enable users to give their synthetic trace to generate workloads with specified arrival pattern, size, resource using characteristics, etc.
### Features
### User Guide
### Example Cases
### Authors and Contributors
### Support or Contact