Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/drylikov/hbase-compact
HBase offline compacter.
https://github.com/drylikov/hbase-compact
Last synced: 8 days ago
JSON representation
HBase offline compacter.
- Host: GitHub
- URL: https://github.com/drylikov/hbase-compact
- Owner: drylikov
- License: mit
- Created: 2024-08-25T21:17:44.000Z (3 months ago)
- Default Branch: drylikov
- Last Pushed: 2024-08-25T21:19:05.000Z (3 months ago)
- Last Synced: 2024-08-25T23:05:39.274Z (3 months ago)
- Language: Java
- Size: 13.7 KB
- Stars: 3
- Watchers: 4
- Forks: 3
- Open Issues: 0
-
Metadata Files:
- Readme: README
- License: LICENSE
Awesome Lists containing this project
README
Source code for the internal HBase offline compacter. This runs
during off-peak hours and cycles through all the region servers and
kicks off region compactions, one region at a time. It then pauses
for a few seconds (configurable) and repeats the process till all the
regions are done. The program also queries the current compaction
queue on the servers (via jmx) and skips the server if the queue size
is too high (configurable). Also, it only runs during off-peak hours
(configurable as well).The program expects JMX credentials in a text file with the format
role password
The name of this text file is hard coded in the JMXQuery.java file.
You will probably need the following libraries to get this to run.
JSAP-2.1.jar
commons-collections-3.2.1.jar
commons-lang-2.6.jar
commons-logging-1.1.1.jar
hadoop-core-0.20.2-cdh3u3-x.jar
hbase-0.92.x.jar
log4j-over-slf4j-1.6.1.jar
logback-classic-0.9.24.jar
logback-core-0.9.24.jar
slf4j-api-1.6.1.jar
zookeeper-3.3.1.jar