Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/azkaban/azkaban
Azkaban workflow manager.
https://github.com/azkaban/azkaban
azkaban hacktoberfest scheduling workflow-engine
Last synced: 10 days ago
JSON representation
Azkaban workflow manager.
- Host: GitHub
- URL: https://github.com/azkaban/azkaban
- Owner: azkaban
- License: apache-2.0
- Created: 2012-10-18T01:34:53.000Z (about 12 years ago)
- Default Branch: master
- Last Pushed: 2024-07-03T06:07:59.000Z (4 months ago)
- Last Synced: 2024-10-17T05:18:23.384Z (22 days ago)
- Topics: azkaban, hacktoberfest, scheduling, workflow-engine
- Language: Java
- Homepage: https://azkaban.github.io
- Size: 54.9 MB
- Stars: 4,462
- Watchers: 250
- Forks: 1,587
- Open Issues: 798
-
Metadata Files:
- Readme: README.md
- Contributing: CONTRIBUTING.md
- License: LICENSE
Awesome Lists containing this project
- awesome - azkaban - Azkaban workflow manager. (Java)
- my-awesome - azkaban/azkaban - engine pushed_at:2024-07 star:4.5k fork:1.6k Azkaban workflow manager. (Java)
- awesome-machine-learning-engineering - Azkaban
- awesome-production-machine-learning - Azkaban - Azkaban is a batch workflow job scheduler created at LinkedIn to run Hadoop jobs. Azkaban resolves the ordering through job dependencies and provides an easy to use web user interface to maintain and track your workflows. (Data Pipeline)
- awesome-mlops - Azkaban - Batch workflow job scheduler created at LinkedIn to run Hadoop jobs. (Data Processing)
- awesome-dataops - Azkaban - Batch workflow job scheduler created at LinkedIn to run Hadoop jobs. (Data Workflow)
- awesome-integration - Azkaban (⭐4.4k) - A distributed workflow manager that helps solve the problem of Hadoop job dependencies, making it easier to schedule and manage workflows in large-scale data processing environments. (Projects / Workflow engine)
README
# Azkaban
[](https://travis-ci.com/azkaban/azkaban)[](https://codecov.io/github/azkaban/azkaban)[](https://gitter.im/azkaban-workflow-engine/Lobby?utm_source=badge&utm_medium=badge&utm_campaign=pr-badge&utm_content=badge)[](https://azkaban.readthedocs.org/en/latest/?badge=latest)
## Build
Azkaban builds use Gradle and requires Java 8 or higher.
The following set of commands run on *nix platforms like Linux, OS X.
```
# Build Azkaban
./gradlew build
# Clean the build
./gradlew clean
# Build and install distributions
./gradlew installDist
# Run tests
./gradlew test
# Build without running tests
./gradlew build -x test
```
### Build a release
Pick a release from [the release page](https://github.com/azkaban/azkaban/releases).
Find the tag corresponding to the release.
Check out the source code corresponding to that tag.
e.g.
`
git checkout 3.30.1
`
Build
```
./gradlew clean build
```
## Documentation
The current documentation will be deprecated soon at [azkaban.github.io](https://azkaban.github.io).
The [new Documentation site](https://azkaban.readthedocs.io/en/latest/) is under development.
The source code for the documentation is inside `docs` directory.
For help, please visit the [Azkaban Google Group](https://groups.google.com/forum/?fromgroups#!forum/azkaban-dev).
## Developer Guide
See [the contribution guide](https://github.com/azkaban/azkaban/blob/master/CONTRIBUTING.md).
#### Documentation development
If you want to contribute to the documentation or the release tool (inside the `tools` folder),
please make sure python3 is installed in your environment. python virtual environment is recommended to run these scripts.
To create a venv & install the python3 dependencies inside it, run
```bash
python3 -m venv venv
source venv/bin/activate
pip3 install -r requirements.txt
```
After, enter the documentation folder `docs` and make the build by running
```bash
cd docs
make html
```
Find the built docs under `_build/html/`.
For example on a Mac, open them in browser with:
```bash
open -a "Google Chrome" _build/html/index.html
```
**[July, 2018]** We are actively improving our documentation. Everyone in the AZ community is
welcome to submit a pull request to edit/fix the documentation.