https://github.com/ShopRunner/wildebeest

File processing pipelines
https://github.com/ShopRunner/wildebeest

cv datascience

Last synced: 5 days ago
JSON representation

File processing pipelines

• Host: GitHub
• URL: https://github.com/ShopRunner/wildebeest
• Owner: ShopRunner
• License: bsd-3-clause
• Created: 2019-01-08T20:07:28.000Z (almost 6 years ago)
• Default Branch: main
• Last Pushed: 2022-03-23T21:12:09.000Z (over 2 years ago)
• Last Synced: 2024-11-08T01:08:35.104Z (12 days ago)
• Topics: cv, datascience
• Language: Python
• Homepage: https://wildebeest-library.readthedocs.io/en/latest/
• Size: 4.54 MB
• Stars: 86
• Watchers: 45
• Forks: 8
• Open Issues: 2
• Metadata Files:
  • Readme: README.md
  • Changelog: CHANGELOG.md
  • Contributing: CONTRIBUTING.md
  • License: LICENSE
  • Code of conduct: CODE-OF-CONDUCT.md
  • Codeowners: .github/CODEOWNERS

Awesome Lists containing this project

README

        
# Wildebeest

[![PyPI version](https://badge.fury.io/py/wildebeest.svg)](https://badge.fury.io/py/wildebeest)

[![codecov](https://codecov.io/gh/ShopRunner/wildebeest/branch/main/graph/badge.svg)](https://codecov.io/gh/ShopRunner/wildebeest)

[![Workflows Passing](https://github.com/ShopRunner/wildebeest/workflows/Python%20package/badge.svg)](https://github.com/ShopRunner/wildebeest/actions/workflows/prod.yaml)

[![Documentation Status](https://readthedocs.org/projects/wildebeest-library/badge/?version=latest)](https://wildebeest-library.readthedocs.io/en/latest/?badge=latest)

![wildebeest stampede](https://github.com/ShopRunner/wildebeest/raw/main/docs/images/wildebeest_stampede.jpg)

Wildebeest is a file processing framework. It is designed for IO-bound workflows that involve reading files into memory, processing their contents, and writing out the results. It makes running those workflows faster and more reliable by parallelizing across files, handling errors, making it easy to skip files that have already been processed, and keeping organized records of what was done.

Wildebeest was developed for deep learning computer vision projects, so in addition to the general framework it also provides predefined components for image processing. However, it can be used for any project that involves processing data from many sources.

See [the docs](https://wildebeest-library.readthedocs.io/en/latest/) for more details.

Wildebeest was known as Creevey until version 3.0.0.