{"id":37063205,"url":"https://github.com/scailfin/flowserv-core","last_synced_at":"2026-01-14T07:03:35.558Z","repository":{"id":39793819,"uuid":"210942858","full_name":"scailfin/flowserv-core","owner":"scailfin","description":"Reproducible and Reusable Data Analysis Workflow Server","archived":false,"fork":false,"pushed_at":"2022-10-12T09:52:53.000Z","size":4011,"stargazers_count":2,"open_issues_count":7,"forks_count":1,"subscribers_count":1,"default_branch":"master","last_synced_at":"2025-09-28T00:08:28.794Z","etag":null,"topics":["benchmarks","data-analysis","reproducibility","reusability","workflows"],"latest_commit_sha":null,"homepage":"","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/scailfin.png","metadata":{"files":{"readme":"README.rst","changelog":"CHANGELOG.md","contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null}},"created_at":"2019-09-25T21:22:54.000Z","updated_at":"2024-01-10T02:32:58.000Z","dependencies_parsed_at":"2022-08-20T09:01:16.216Z","dependency_job_id":null,"html_url":"https://github.com/scailfin/flowserv-core","commit_stats":null,"previous_names":[],"tags_count":21,"template":false,"template_full_name":null,"purl":"pkg:github/scailfin/flowserv-core","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/scailfin%2Fflowserv-core","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/scailfin%2Fflowserv-core/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/scailfin%2Fflowserv-core/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/scailfin%2Fflowserv-core/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/scailfin","download_url":"https://codeload.github.com/scailfin/flowserv-core/tar.gz/refs/heads/master","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/scailfin%2Fflowserv-core/sbom","scorecard":{"id":803095,"data":{"date":"2025-08-11","repo":{"name":"github.com/scailfin/flowserv-core","commit":"791383085181747cf41c30f6cd13f6762e438d8a"},"scorecard":{"version":"v5.2.1-40-gf6ed084d","commit":"f6ed084d17c9236477efd66e5b258b9d4cc7b389"},"score":2.5,"checks":[{"name":"Code-Review","score":0,"reason":"Found 0/17 approved changesets -- score normalized to 0","details":null,"documentation":{"short":"Determines if the project requires human code review before pull requests (aka merge requests) are merged.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#code-review"}},{"name":"Dangerous-Workflow","score":10,"reason":"no dangerous workflow patterns detected","details":null,"documentation":{"short":"Determines if the project's GitHub Action workflows avoid dangerous patterns.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#dangerous-workflow"}},{"name":"Maintained","score":0,"reason":"0 commit(s) and 0 issue activity found in the last 90 days -- score normalized to 0","details":null,"documentation":{"short":"Determines if the project is \"actively maintained\".","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#maintained"}},{"name":"CII-Best-Practices","score":0,"reason":"no effort to earn an OpenSSF best practices badge detected","details":null,"documentation":{"short":"Determines if the project has an OpenSSF (formerly CII) Best Practices Badge.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#cii-best-practices"}},{"name":"Packaging","score":-1,"reason":"packaging workflow not detected","details":["Warn: no GitHub/GitLab publishing workflow detected."],"documentation":{"short":"Determines if the project is published as a package that others can easily download, install, easily update, and uninstall.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#packaging"}},{"name":"Token-Permissions","score":0,"reason":"detected GitHub workflow tokens with excessive permissions","details":["Warn: no topLevel permission defined: .github/workflows/build.yml:1","Warn: no topLevel permission defined: .github/workflows/pypi.yml:1","Info: no jobLevel write permissions found"],"documentation":{"short":"Determines if the project's workflows follow the principle of least privilege.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#token-permissions"}},{"name":"Binary-Artifacts","score":10,"reason":"no binaries found in the repo","details":null,"documentation":{"short":"Determines if the project has generated executable (binary) artifacts in the source repository.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#binary-artifacts"}},{"name":"Security-Policy","score":0,"reason":"security policy file not detected","details":["Warn: no security policy file detected","Warn: no security file to analyze","Warn: no security file to analyze","Warn: no security file to analyze"],"documentation":{"short":"Determines if the project has published a security policy.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#security-policy"}},{"name":"License","score":10,"reason":"license file detected","details":["Info: project has a license file: LICENSE:0","Info: FSF or OSI recognized license: MIT License: LICENSE:0"],"documentation":{"short":"Determines if the project has defined a license.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#license"}},{"name":"Fuzzing","score":0,"reason":"project is not fuzzed","details":["Warn: no fuzzer integrations found"],"documentation":{"short":"Determines if the project uses fuzzing.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#fuzzing"}},{"name":"Pinned-Dependencies","score":0,"reason":"dependency not pinned by hash detected -- score normalized to 0","details":["Warn: GitHub-owned GitHubAction not pinned by hash: .github/workflows/build.yml:20: update your workflow using https://app.stepsecurity.io/secureworkflow/scailfin/flowserv-core/build.yml/master?enable=pin","Warn: GitHub-owned GitHubAction not pinned by hash: .github/workflows/build.yml:22: update your workflow using https://app.stepsecurity.io/secureworkflow/scailfin/flowserv-core/build.yml/master?enable=pin","Warn: GitHub-owned GitHubAction not pinned by hash: .github/workflows/pypi.yml:16: update your workflow using https://app.stepsecurity.io/secureworkflow/scailfin/flowserv-core/pypi.yml/master?enable=pin","Warn: GitHub-owned GitHubAction not pinned by hash: .github/workflows/pypi.yml:18: update your workflow using https://app.stepsecurity.io/secureworkflow/scailfin/flowserv-core/pypi.yml/master?enable=pin","Warn: containerImage not pinned by hash: Dockerfile:1: pin your Docker image by updating python:3.9 to python:3.9@sha256:b93ed1cb6815be1d99908ab629d49680be28024c4183611ded45c425ecf7b907","Warn: pipCommand not pinned by hash: Dockerfile:6","Warn: pipCommand not pinned by hash: .github/workflows/build.yml:27","Warn: pipCommand not pinned by hash: .github/workflows/build.yml:28","Warn: pipCommand not pinned by hash: .github/workflows/build.yml:29","Warn: pipCommand not pinned by hash: .github/workflows/build.yml:32","Warn: pipCommand not pinned by hash: .github/workflows/pypi.yml:23","Warn: pipCommand not pinned by hash: .github/workflows/pypi.yml:24","Info:   0 out of   4 GitHub-owned GitHubAction dependencies pinned","Info:   0 out of   7 pipCommand dependencies pinned","Info:   0 out of   1 containerImage dependencies pinned"],"documentation":{"short":"Determines if the project has declared and pinned the dependencies of its build process.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#pinned-dependencies"}},{"name":"Signed-Releases","score":-1,"reason":"no releases found","details":null,"documentation":{"short":"Determines if the project cryptographically signs release artifacts.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#signed-releases"}},{"name":"Branch-Protection","score":0,"reason":"branch protection not enabled on development/release branches","details":["Warn: branch protection not enabled for branch 'master'"],"documentation":{"short":"Determines if the default and release branches are protected with GitHub's branch protection settings.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#branch-protection"}},{"name":"SAST","score":0,"reason":"SAST tool is not run on all commits -- score normalized to 0","details":["Warn: 0 commits out of 18 are checked with a SAST tool"],"documentation":{"short":"Determines if the project uses static code analysis.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#sast"}},{"name":"Vulnerabilities","score":0,"reason":"18 existing vulnerabilities detected","details":["Warn: Project is vulnerable to: PYSEC-2022-42991 / GHSA-v3c5-jqr6-7qm8","Warn: Project is vulnerable to: PYSEC-2024-4 / GHSA-2mqj-m65w-jghx","Warn: Project is vulnerable to: PYSEC-2023-165 / GHSA-cwvm-v4w8-q58c","Warn: Project is vulnerable to: PYSEC-2022-42992 / GHSA-hcpj-qp55-gfph","Warn: Project is vulnerable to: PYSEC-2023-137 / GHSA-pr76-5cm5-w9cj","Warn: Project is vulnerable to: PYSEC-2023-161 / GHSA-wfm5-v35h-vwf4","Warn: Project is vulnerable to: PYSEC-2018-19 / GHSA-232r-66cg-79px","Warn: Project is vulnerable to: PYSEC-2008-8 / GHSA-wqmm-q65g-2hqr","Warn: Project is vulnerable to: PYSEC-2022-166","Warn: Project is vulnerable to: PYSEC-2020-176 / GHSA-3pqx-4fqf-j49f","Warn: Project is vulnerable to: PYSEC-2020-96 / GHSA-6757-jp84-gxfx","Warn: Project is vulnerable to: PYSEC-2021-142 / GHSA-8q59-q68h-6hv4","Warn: Project is vulnerable to: PYSEC-2014-14 / GHSA-652x-xj99-gmcc","Warn: Project is vulnerable to: GHSA-9hjg-9r4m-mvj7","Warn: Project is vulnerable to: GHSA-9wx4-h78v-vm56","Warn: Project is vulnerable to: PYSEC-2014-13 / GHSA-cfj3-7x9c-4p3h","Warn: Project is vulnerable to: PYSEC-2018-28 / GHSA-x84v-xcm2-53pg","Warn: Project is vulnerable to: PYSEC-2024-153 / GHSA-rxff-vr5r-8cj5"],"documentation":{"short":"Determines if the project has open, known unfixed vulnerabilities.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#vulnerabilities"}}]},"last_synced_at":"2025-08-23T11:02:07.448Z","repository_id":39793819,"created_at":"2025-08-23T11:02:07.448Z","updated_at":"2025-08-23T11:02:07.448Z"},"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":286080680,"owners_count":28412494,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2026-01-14T05:26:33.345Z","status":"ssl_error","status_checked_at":"2026-01-14T05:21:57.251Z","response_time":107,"last_error":"SSL_connect returned=1 errno=0 peeraddr=140.82.121.5:443 state=error: unexpected eof while reading","robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":false,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["benchmarks","data-analysis","reproducibility","reusability","workflows"],"created_at":"2026-01-14T07:03:35.000Z","updated_at":"2026-01-14T07:03:35.553Z","avatar_url":"https://github.com/scailfin.png","language":"Python","funding_links":[],"categories":[],"sub_categories":[],"readme":"=======================================================\nReproducible and Reusable Data Analysis Workflow Server\n=======================================================\n\n.. image:: https://img.shields.io/pypi/pyversions/flowserv-core.svg\n    :target: https://pypi.org/pypi/flowserv-core\n\n.. image:: https://badge.fury.io/py/flowserv-core.svg\n    :target: https://badge.fury.io/py/flowserv-core\n\n.. image:: https://img.shields.io/badge/License-MIT-yellow.svg\n    :target: https://github.com/scailfin/flowserv-core/blob/master/LICENSE\n\n.. image:: https://github.com/scailfin/flowserv-core/workflows/build/badge.svg\n    :target: https://github.com/scailfin/flowserv-core/actions?query=workflow%3A%22build%22\n\n.. image:: https://readthedocs.org/projects/flowserv-core/badge/?version=latest\n    :target: https://flowserv-core.readthedocs.io/en/latest/?badge=latest\n    :alt: Documentation Status\n\n.. image:: https://codecov.io/gh/scailfin/flowserv-core/branch/master/graph/badge.svg\n    :target: https://codecov.io/gh/scailfin/flowserv-core\n\n\n\n.. figure:: https://github.com/scailfin/flowserv-core/blob/master/docs/figures/logo.png\n    :align: center\n    :alt: flowServ Logo\n\n\n\nAbout\n=====\n\nThis repository contains the implementation of the core infrastructure for the *Reproducible and Reusable Data Analysis Workflow Server* (**flowServ**). This is an experimental prototype to support reuse and evaluation of published data analysis pipelines as well as community benchmarks of data analysis algorithms. **flowServ** is not yet-another workflow engine. The aim instead is to provide a layer between a client (e.g. a Web user interface) and a workflow engine to facilitate the execution of a defined workflow templates (as shown in the figure below). *flowServ* is designed to be independent of the underlying workflow engine.\n\nWorkflow templates contain placeholders for workflow steps and/or input data and parameters that are provided by the user (e.g., by providing Docker containers that satisfy the workflow steps or uploading input data files). **flowServ** triggers and monitors the execution of the workflow for the given input values and maintains the workflow results. The API provides the functionality to submit new workflow runs and to retrieve the evaluation results of completed workflow runs.\n\n\n.. figure:: https://github.com/scailfin/flowserv-core/blob/master/docs/figures/flowserv-overview.png\n    :align: center\n    :alt: ROB Architecture\n\n\n\n**flowServ** was motivated by the `Reproducible Open Benchmarks for Data Analysis Platform (ROB) \u003chttps://github.com/scailfin/rob-ui\u003e`_.  The goal of ROB is to allow user communities to evaluate the performance of their different data analysis algorithms in a controlled competition-style format. In ROB, the benchmark coordinator defines the workflow template along with input data. Benchmark participants provide their own implementation of the variable workfow steps. The workflow engine processes workflows on submission. Execution results are maintained by **flowServ** in an internal database. The goal of **flowServ** is to be a more generic platform that can not only be used for benchmarks but also for other types of data analysis workflows.\n\n\n\nMore Information\n================\n\nWorkflow templates are motivated by the goal to allow users to run pre-defined data analytics workflows while providing their own input data, parameters, as well as their own code modules. Workflow templates are inspired by, but not limited to, workflow specifications for the `Reproducible Research Data Analysis Platform (REANA) \u003chttp://www.reanahub.io/\u003e`_. The `Workflow Templates Section \u003chttps://github.com/scailfin/flowserv-core/blob/master/docs/workflow.rst\u003e`_ provides further information about templates and their syntax. These templates are used by **flowServ** to run workflows and to maintain benchmark results.\n\nThe **flowServ** API defines the main interface to programmatically interact with the underlying database and workflow engine. The API implementation that is included in this repository provides a default serialization of all API resources as Python dictionaries. The API is intended to be used by Web applications. These applications can be build using different frameworks. The `current default Web API implementation for ROB \u003chttps://github.com/scailfin/rob-webapi-flask\u003e`_ uses the `Flask web framework \u003chttps://flask.palletsprojects.com\u003e`_.\n\nROB currently provides two different interfaces to interact with a Web API: the `Command Line Client \u003chttps://github.com/scailfin/rob-client\u003e`_ and the `Web User Interface \u003chttps://github.com/scailfin/rob-ui\u003e`_. See the respective repositories for further information on how to install and use these interfaces.\n\nFor an overview of ROB there are `slides \u003chttps://github.com/scailfin/presentations/blob/master/slides/ROB-Demo-MSDSE2019.pdf\u003e`_ from the ROB Demo at the `Moore-Sloan Data Science Environment's annual summit 2019 \u003chttps://sites.google.com/msdse.org/summit2019/home\u003e`_ and our `presentation \u003chttps://indico.cern.ch/event/822074/contributions/3471463/attachments/1865533/3067815/Reproducible_Benchmarks_for_Data_Analysis-v3.pdf\u003e`_ at the `Analysis Systems Topical Workshop \u003chttps://indico.cern.ch/event/822074/\u003e`_.\n\nThe full documentation is also available on `readthedocs.io \u003chttps://flowserv-core.readthedocs.io/en/latest/\u003e`_.\n\nNote\n====\n\n**flowServ** originated from the Reproducible Open Benchmarks for Data Analysis Platform (ROB). This repository replaces `Workflow Templates \u003chttps://github.com/scailfin/benchmark-templates\u003e`_ and the `Reproducible Benchmark Engine \u003chttps://github.com/scailfin/benchmark-engine\u003e`_ from an earlier version of ROB.\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fscailfin%2Fflowserv-core","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fscailfin%2Fflowserv-core","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fscailfin%2Fflowserv-core/lists"}