https://github.com/urbslab/streamline
Simple Transparent End-To-End Automated Machine Learning Pipeline for Supervised Learning in Tabular Binary Classification Data
https://github.com/urbslab/streamline
automl-pipeline binary-classification data-science data-visualization feature-selection imputation machine-learning model-application statistical-analysis supervised-learning
Last synced: 3 months ago
JSON representation
Simple Transparent End-To-End Automated Machine Learning Pipeline for Supervised Learning in Tabular Binary Classification Data
- Host: GitHub
- URL: https://github.com/urbslab/streamline
- Owner: UrbsLab
- License: gpl-3.0
- Created: 2022-05-07T01:22:20.000Z (over 3 years ago)
- Default Branch: main
- Last Pushed: 2025-04-30T18:09:40.000Z (5 months ago)
- Last Synced: 2025-04-30T18:29:11.569Z (5 months ago)
- Topics: automl-pipeline, binary-classification, data-science, data-visualization, feature-selection, imputation, machine-learning, model-application, statistical-analysis, supervised-learning
- Language: Jupyter Notebook
- Homepage: https://urbslab.github.io/STREAMLINE/
- Size: 595 MB
- Stars: 76
- Watchers: 6
- Forks: 11
- Open Issues: 2
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
# Overview
STREAMLINE is an end-to-end automated machine learning (AutoML) pipeline
that empowers anyone to easily train, interpret, and apply a variety of predictive models as
part of a rigorous and optionally customizable data mining analysis. It is programmed in
Python 3 using many common libraries including [Pandas](https://pandas.pydata.org/)
and [scikit-learn](https://scikit-learn.org/stable/).
The schematic below summarizes the automated STREAMLINE analysis pipeline with individual elements organized into 9 phases.
* Detailed documentation of STREAMLINE is available [here](https://urbslab.github.io/STREAMLINE/index.html).
* A simple demonstration of STREAMLINE on example biomedical data in our ready-to-run Google Colab Notebook [here](https://colab.research.google.com/drive/14AEfQ5hUPihm9JB2g730Fu3LiQ15Hhj2?usp=sharing).
* A video tutorial playlist covering all aspects of STREAMLINE is available [here](https://www.youtube.com/playlist?list=PLafPhSv1OSDcvu8dcbxb-LHyasQ1ZvxfJ)
### YouTube Overview of STREAMLINE
[](https://www.youtube.com/watch?v=xVc4JEbnIs8)
### Pipeline Design
The goal of STREAMLINE is to provide an easy and transparent framework
to reliably learn predictive associations from tabular data with a particular focus on the needs of biomedical data applications.
The design of this pipeline is meant to not only pick a best performing algorithm/model for a given dataset,
but to leverage the different algorithm perspectives (i.e. biases, strengths,
and weaknesses) to gain a broader understanding of the associations in that data.
The overall development of this pipeline focused on:
1. Automation and ease of use
2. Optimizing modeling performance
3. Capturing complex associations in data (e.g. feature interactions)
4. Enhancing interpretability of output throughout the analysis
5. Avoiding and detecting common sources of bias
6. Reproducibility (see STREAMLINE parameter settings)
7. Run mode flexibility (accomodates users with different levels of expertise)
8. More advanced users can easily add their own scikit-learn compatible modeling algorithms to STREAMLINE
See the [About (FAQs)](https://urbslab.github.io/STREAMLINE/about.html) to gain a deeper understanding of STREAMLINE with respect to it's overall design, what it includes, what it can be used for, and implementation highlights that differentiate it from other AutoML tools.
### Current Limitations
* At present, STREAMLINE is limited to supervised learning on tabular,
binary classification data. We are currently expanding STREAMLINE to multi-class
and regression outcome data.
* STREAMLINE also does not automate feature extraction from unstructured data (e.g. text, images, video, time-series data), or handle more advanced aspects of data cleaning or feature engineering that would likely require domain expertise for a given dataset.
* As STREAMLINE is currently in its 'beta' release, we recommend users first check that they have downloaded the
most recent release of STREAMLINE before use. We are actively updating this software as feedback is received.
### Publications and Citations
The most recent publication on STREAMLINE (release Beta 0.3.4) with benchmarking on simulated data and application to investigate obstructive sleep apena risk prediction as a clinical outcome is available as a preprint on arxiv [here](
https://doi.org/10.48550/arXiv.2312.05461).
The first publication detailing the initial implementation of STREAMLINE (release Beta 0.2.4) and applying it to
simulated benchmark data can be found [here](https://link.springer.com/chapter/10.1007/978-981-19-8460-0_9), or as a preprint on arxiv, [here](https://arxiv.org/abs/2206.12002?fbclid=IwAR1toW5AtDJQcna0_9Sj73T9kJvuB-x-swnQETBGQ8lSwBB0z2N1TByEwlw).
See [citations](https://urbslab.github.io/STREAMLINE/citation.html) for more information on citing STREAMLINE, as well as publications applying STREAMLINE and publications on algorithms developed in our research group and incorporated into STREAMLINE.
***
# Installation and Use
STREAMLINE can be run using a variety of modes balancing ease of use and efficiency.
* Google Colab Notebook: runs serially on Google Cloud (best for beginners)
* Jupyter Notebook: runs serially/locally
* Command Line: runs serially or locally
* Locally, serially
* Locally, cpu core in parallel
* CPU Computing Cluster (HPC), in parallel (best for efficiency)
* All phases can be run from a single command (with a job monitor/submitter running on the head node until completion)
* Each phase can be run separately in sequence
See the [documentation](https://urbslab.github.io/STREAMLINE/index.html) for requirements, installation, and use details for each.
Basic installation instructions for use on Google Colab, and local runs are given below.
### Google Colab
There is no local installation or additional steps required to run
STREAMLINE on Google Colab.
Just have a Google Account and open this Colab link to run the demo (takes ~ 6-7 min):
[https://colab.research.google.com/drive/14AEfQ5hUPihm9JB2g730Fu3LiQ15Hhj2?usp=sharing](https://colab.research.google.com/drive/14AEfQ5hUPihm9JB2g730Fu3LiQ15Hhj2?usp=sharing)
### Local
Install STREAMLINE for local use with the following command line commands:
```
git clone --single-branch https://github.com/UrbsLab/STREAMLINE
cd STREAMLINE
pip install -r requirements.txt
```
Now your STREAMLINE package is ready to use from the `STREAMLINE` folder either
from the included [Jupyter Notebook](https://github.com/UrbsLab/STREAMLINE/blob/main/STREAMLINE_Notebook.ipynb) file or the command line.
***
# Other Information
## Demonstration Data
Included with this pipeline is a folder named `DemoData` including [two small datasets](https://urbslab.github.io/STREAMLINE/data.html#demonstration-data) used as a demonstration of
pipeline efficacy. New users can easily test/run STREAMLINE in all run modes set up to run automatically on these datasets.
## List of Run Parameters
A complete list of STREAMLINE Parameters can be found [here](https://urbslab.github.io/STREAMLINE/parameters.html).
***
## Disclaimer
We make no claim that this is the best or only viable way to assemble an ML analysis pipeline for a given
classification problem, nor that the included ML modeling algorithms will yield the best performance possible.
We intend many expansions/improvements to this pipeline in the future. We welcome feedback, suggestions, and contributions for improvement.
***
# Contact
We welcome ideas, suggestions on improving the pipeline, [code-contributions](https://https://urbslab.github.io/STREAMLINE/contributing.html), and collaborations!
* For general questions, or to discuss potential collaborations (applying, or extending STREAMLINE); contact Ryan Urbanowicz at ryan.urbanowicz@cshs.org.
* For questions on the code-base, installing/running STREAMLINE, report bugs, or discuss other troubleshooting issues; contact Harsh Bandhey at harsh.bandhey@cshs.org.
# Other STREAMLINE Tutorial Videos on YouTube
### A Brief Introduction to Automated Machine Learning
[](https://www.youtube.com/watch?v=IjX0phz3LLE)
### A Detailed Walkthrough
[](https://www.youtube.com/watch?v=sAB8d1KnMDw)
### Input Data
[](https://www.youtube.com/watch?v=5HnangrEF5E)
### Run Parameters
[](https://www.youtube.com/watch?v=qMi9vhVag-4)
### Running in Google Colab Notebook
[](https://www.youtube.com/watch?v=nknyJWhm7pg)
### Running in Jupyter Notebook
[](https://www.youtube.com/watch?v=blat3gAfUaI)
### Running From Command Line
[](https://www.youtube.com/watch?v=-5yjGxnJ7eI)
***
# Acknowledgements
The development of STREAMLINE benefited from feedback across multiple biomedical research collaborators at the University of Pennsylvania, Fox Chase Cancer Center, Cedars Sinai Medical Center, and the University of Kansas Medical Center.
The bulk of the coding was completed by Ryan Urbanowicz, Robert Zhang, and Harsh Bandhey. Special thanks to
Yuhan Cui, Pranshu Suri, Patryk Orzechowski, Trang Le, Sy Hwang, Richard Zhang, Wilson Zhang,
and Pedro Ribeiro for their code contributions and feedback.
We also thank the following collaborators for their feedback on application
of the pipeline during development: Shannon Lynch, Rachael Stolzenberg-Solomon,
Ulysses Magalang, Allan Pack, Brendan Keenan, Danielle Mowery, Jason Moore, and Diego Mazzotti.
Funding supporting this work comes from NIH grants: R01 AI173095, U01 AG066833, and P01 HL160471.