Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/edebrouwer/gru_ode_bayes
Pytorch implementation of GRU-ODE-Bayes
https://github.com/edebrouwer/gru_ode_bayes
Last synced: 11 days ago
JSON representation
Pytorch implementation of GRU-ODE-Bayes
- Host: GitHub
- URL: https://github.com/edebrouwer/gru_ode_bayes
- Owner: edebrouwer
- License: mit
- Created: 2019-05-29T12:08:13.000Z (over 5 years ago)
- Default Branch: master
- Last Pushed: 2022-05-26T14:46:48.000Z (over 2 years ago)
- Last Synced: 2024-08-01T16:47:04.449Z (3 months ago)
- Language: Jupyter Notebook
- Size: 6.28 MB
- Stars: 220
- Watchers: 11
- Forks: 50
- Open Issues: 11
-
Metadata Files:
- Readme: README.md
- License: License.md
Awesome Lists containing this project
README
# GRU-ODE-Bayes
This implementation completes the paper : GRU-ODE-Bayes : continuous modeling of sporadically-observed time series.
Modeling real-world multidimensional time series can be particularly challenging when these are *sporadically* observed (i.e., sampling is irregular both in time and across dimensions)---such as in the case of clinical patient data. To address these challenges, we propose (1) a continuous-time version of the Gated Recurrent Unit, building upon the recent Neural Ordinary Differential Equations (Chen et al. 2018), and (2) a Bayesian update network that processes the sporadic observations. We bring these two ideas together in our GRU-ODE-Bayes method.
This repository provides pytorch implementation of the GRU-ODE-Bayes paper.
## Installation
### Requirements
The code uses Python3 and Pytorch as auto-differentiation package. The following python packages are required and will be automatically downloaded when installing the gru_ode_bayes package:
```
numpy
pandas
sklearn
torch
tensorflow (for logging)
tqdm
argparse
```
### Procedure
Install the main package :
```
pip install -e .
```
And also the ODE numerical integration package :
```
cd torchdiffeq
pip install -e .
```
## Run experiments
Experiments folder contains different cases study for the GRU-ODE-Bayes. Each trained model is then stored in the `trained_models` folder.
### 2-D Ornstein-Uhlenbeck SDE
Once in the double_OU folder, you can visualize some predictions of a previously trained model on newly generated data by running :
```
cd experiments/double_OU
python double_ou_gruode.py --demo
```
This will print 10 new realizations of the process along with the model predictions.
For retraining the full model, run:
```
python double_ou_gruode.py
```
### Brusselator SDE
Similarly as for the 2D OU process,
```
cd experiments/Brusselator
python run_gruode.py --demo
```
will plot 10 new realizations of the process along with the model predictions. For retraining the full model :
```
python run_gruode.py
```
### USHCN daily (climate) data
For retraining the model, go to Climate folder and run
```
python climate_gruode.py
```
## Datasets
The datasets for Brusselator, double OU and processed USHCN data have been uploaded on the repo for compatibility.
The MIMIC dataset is not directly publicly available and was thus not pushed. It can be downloaded at : https://physionet.org/physiobank/database/mimic3cdb/
Folder 'data_preproc' contains all steps taken to preprocess the Climate and MIMIC datasets.
## Acknowledgements and References
The torchdiffeq package has been extended from the original version proposed by (Chen et al. 2018)
Chen et al. Neural ordinary differential equations, NeurIPS, 2018.
For climate dataset :
Menne et al., Long-Term Daily Climate Records from Stations Across the Contiguous United States