https://github.com/ohsu-comp-bio/funnel
Funnel is a toolkit for distributed task execution via a simple, standard API.
https://github.com/ohsu-comp-bio/funnel
aws-batch docker ga4gh google-cloud gridengine kubernetes pbs-torque slurm
Last synced: 25 days ago
JSON representation
Funnel is a toolkit for distributed task execution via a simple, standard API.
- Host: GitHub
- URL: https://github.com/ohsu-comp-bio/funnel
- Owner: ohsu-comp-bio
- License: mit
- Created: 2017-02-03T23:22:07.000Z (about 9 years ago)
- Default Branch: main
- Last Pushed: 2026-02-20T18:51:29.000Z (about 1 month ago)
- Last Synced: 2026-02-20T23:42:42.627Z (about 1 month ago)
- Topics: aws-batch, docker, ga4gh, google-cloud, gridengine, kubernetes, pbs-torque, slurm
- Language: Go
- Homepage: https://ohsu-comp-bio.github.io/funnel
- Size: 59.6 MB
- Stars: 135
- Watchers: 18
- Forks: 42
- Open Issues: 139
-
Metadata Files:
- Readme: README.md
- License: License.txt
- Security: SECURITY.md
Awesome Lists containing this project
README
[![Build Status][build-badge]][build]
[![Compliance Tests Status][compliance-tests-badge]][compliance-tests]
[![Gitter][gitter-badge]][gitter]
[![License: MIT][license-badge]][license]
[![Godoc][godoc-badge]][godoc]
[build-badge]: https://img.shields.io/github/actions/workflow/status/ohsu-comp-bio/funnel/tests.yaml
[build]: https://github.com/ohsu-comp-bio/funnel/actions/workflows/tests.yaml
[compliance-tests]: https://github.com/ohsu-comp-bio/funnel/actions/workflows/compliance-test.yaml
[compliance-tests-badge]: https://img.shields.io/github/actions/workflow/status/ohsu-comp-bio/funnel/compliance-test.yaml?label=Compliance%20Tests
[gitter-badge]: https://badges.gitter.im/ohsu-comp-bio/funnel.svg
[gitter]: https://gitter.im/ohsu-comp-bio/funnel
[license-badge]: https://img.shields.io/badge/License-MIT-yellow.svg
[license]: https://opensource.org/licenses/MIT
[godoc-badge]: https://img.shields.io/badge/godoc-ref-blue.svg
[godoc]: http://godoc.org/github.com/ohsu-comp-bio/funnel
Funnel is a toolkit for distributed, batch task execution, including a server, worker, and a set of compute, storage, and database backends. Given a task description, Funnel will find a worker to execute the task, download inputs, run a series of (Docker) containers, upload outputs, capture logs, and track the whole process.
Funnel is an implementation of the [GA4GH Task Execution Schemas](https://github.com/ga4gh/task-execution-schemas), an effort to standardize the APIs used for task execution across many platforms.
Funnel provides an API server, multiple storage backends (local FS, S3, Google Bucket, etc.), multiple compute backends (local, HTCondor, Google Cloud, etc.), and a web dashboard.
https://ohsu-comp-bio.github.io/funnel/