https://github.com/fresh2dev/ppqueue

A Parallel Process Queue for Python
https://github.com/fresh2dev/ppqueue

multiprocessing parallel python queue threading visualization

Last synced: 6 months ago
JSON representation

A Parallel Process Queue for Python

• Host: GitHub
• URL: https://github.com/fresh2dev/ppqueue
• Owner: fresh2dev
• License: mit
• Created: 2018-12-14T08:23:39.000Z (almost 7 years ago)
• Default Branch: main
• Last Pushed: 2023-08-09T06:26:22.000Z (about 2 years ago)
• Last Synced: 2025-04-10T22:40:24.091Z (7 months ago)
• Topics: multiprocessing, parallel, python, queue, threading, visualization
• Language: Python
• Homepage: https://www.f2dv.com/r/ppqueue
• Size: 2.02 MB
• Stars: 44
• Watchers: 4
• Forks: 1
• Open Issues: 0
• Metadata Files:
  • Readme: README.md
  • Changelog: CHANGELOG.md
  • Funding: .github/FUNDING.yml
  • License: LICENSE

Awesome Lists containing this project

README

          
# ppqueue

> A Parallel Process Queue for Python.

| Links         |                                          |

|---------------|------------------------------------------|

| Code Repo     | https://www.github.com/fresh2dev/ppqueue |

| Documentation | https://www.f2dv.com/r/ppqueue           |

| Changelog     | https://www.f2dv.com/r/ppqueue/changelog |

| License       | https://www.f2dv.com/r/ppqueue/license   |

| Funding       | https://www.f2dv.com/fund                |

[![GitHub Repo stars](https://img.shields.io/github/stars/fresh2dev/ppqueue?color=blue&style=for-the-badge)](https://star-history.com/#fresh2dev/ppqueue&Date)

[![GitHub release (latest SemVer)](https://img.shields.io/github/v/release/fresh2dev/ppqueue?color=blue&style=for-the-badge)](https://www.f2dv.com/r/ppqueue/changelog)

[![GitHub Release Date](https://img.shields.io/github/release-date/fresh2dev/ppqueue?color=blue&style=for-the-badge)](https://www.f2dv.com/r/ppqueue/changelog)

[![License](https://img.shields.io/github/license/fresh2dev/ppqueue?color=blue&style=for-the-badge)](https://www.f2dv.com/r/ppqueue/license)

---

## Overview

`ppqueue` is a Python module that serves as an abstraction layer to both `multiprocessing.Process` and `threading.Thread`. I built `ppqueue` because I too often notice that parallelizing code results in *ugly* code. With this simple Queue, you can parallelize code easily and attractively. ppqueue offers:

- a single API for parallel execution using processes or threads.

- FIFO priority queueing.

- Gantt charts of job execution (thanks `plotnine` + `pandas`)

- progress bars (thanks to `tqdm`)

![](https://img.fresh2.dev/1687407526_84b23a13b5f.svg)

## Install

Install from PyPi:

```python

pip install ppqueue[plot]

```

## Examples

An notebook of examples is available at:

https://www.f2dv.com/r/ppqueue/page/examples/

And more examples are provided in the reference docs:

https://www.f2dv.com/r/ppqueue/reference/

## Support

If this project delivers value to you, please [provide feedback](https://www.github.com/fresh2dev/ppqueue/issues), code contributions, and/or [funding](https://www.f2dv.com/fund).

---

*Brought to you by...*