{"id":21381002,"url":"https://github.com/elisim/piven","last_synced_at":"2025-07-13T13:31:00.659Z","repository":{"id":37414758,"uuid":"302301757","full_name":"elisim/piven","owner":"elisim","description":"Official implementation of the paper \"PIVEN: A Deep Neural Network for Prediction Intervals with Specific Value Prediction\" by Eli Simhayev, Gilad Katz and Lior Rokach.","archived":false,"fork":false,"pushed_at":"2023-03-12T05:51:21.000Z","size":5518,"stargazers_count":30,"open_issues_count":0,"forks_count":4,"subscribers_count":2,"default_branch":"master","last_synced_at":"2023-10-20T19:39:34.594Z","etag":null,"topics":["deep-learning","prediction-intervals","regression","tensorflow","uncertainty-estimation"],"latest_commit_sha":null,"homepage":"","language":"Jupyter Notebook","has_issues":false,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/elisim.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null}},"created_at":"2020-10-08T10:11:37.000Z","updated_at":"2023-10-21T11:03:01.278Z","dependencies_parsed_at":"2022-08-18T03:11:06.201Z","dependency_job_id":"0d94a396-8077-4bdb-ae66-b39d49d16e02","html_url":"https://github.com/elisim/piven","commit_stats":null,"previous_names":[],"tags_count":0,"template":null,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/elisim%2Fpiven","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/elisim%2Fpiven/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/elisim%2Fpiven/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/elisim%2Fpiven/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/elisim","download_url":"https://codeload.github.com/elisim/piven/tar.gz/refs/heads/master","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":225885790,"owners_count":17539640,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["deep-learning","prediction-intervals","regression","tensorflow","uncertainty-estimation"],"created_at":"2024-11-22T10:43:57.005Z","updated_at":"2024-11-22T10:43:57.486Z","avatar_url":"https://github.com/elisim.png","language":"Jupyter Notebook","funding_links":[],"categories":[],"sub_categories":[],"readme":"# PIVEN: A Deep Neural Network for Prediction Intervals with Specific Value Prediction\n\nThe official implementation of the paper [\"PIVEN: A Deep Neural Network for Prediction Intervals with Specific Value Prediction\"](https://arxiv.org/abs/2006.05139)\nby Eli Simhayev, Gilad Katz and Lior Rokach. \n\n## Update 21.6.22\nOur paper has been accepted to Knowledge Based Systems 🙂 \n\nhttps://doi.org/10.1016/j.knosys.2022.108685\n\n\u0026nbsp;\n![The PIVEN schematic architecture](piven_architecture.jpg)\n\n## TL;DR\nA neural network with a PIVEN output layer returns a point prediction as well as a lower and upper prediction interval (PI) for each target in a regression problem. The image below shows how the lower and upper PI change as we keep training the model:\n\n\u003cp align=\"center\"\u003e\n\u003cimg src=\"piven_gif.gif\"\u003e\u003c/img\u003e\n\u003c/p\u003e\n\nWe thank Jasper Ginn (@JasperHG90) from GoDataDriven ([godatadriven/piven](https://github.com/godatadriven/piven)) for the image 🙂\n\n## Quickstart in Google Colab\n\nA simple fast colab demo using Keras is included in [PIVEN_Demo.ipynb](https://colab.research.google.com/github/elisim/piven/blob/master/PIVEN_Demo.ipynb).\n\n## Contents\n```\n├── age\n│   ├── Bone age ground truth.xlsx --- RSNA Bong Age Ground-Truth\n│   ├── get_age_data.sh --- Download dataset from kaggle\n│   ├── main.py --- Run bone age experiment\n├── imdb\n│   ├── densenet.py\n│   ├── generators.py\n│   ├── get_imdb_data.sh --- Download dataset\n│   ├── imdb_create_db.py --- Run after downloading the dataset\n│   ├── main.py --- Run imdb age estimation experiment\n│   ├── model.py\n│   ├── subpixel.py\n│   ├── tensorflow_backend.py\n│   ├── train_callbacks.py\n│   └── utils.py\n└── uci\n    ├── code\n    │   ├── DataGen.py\n    │   ├── DeepNetPI.py\n    │   ├── alpha_experiment.py --- Run alpha experiment on UCI \n    │   ├── main.py --- Run UCI experiments\n    │   ├── params_deep_ens.json --- deep ensembles hyperparameters\n    │   ├── params.json --- piven and qd hyperparameters\n    │   └── utils.py\n    ├── get_song_dataset.sh --- Download Year Prediction MSD dataset\n    └── UCI_Datasets\n```\n\n## Requirements\n* pandas==0.25.2\n* numpy==1.18.1\n* matplotlib==3.0.3\n* tensorflow==1.15.0\n* keras==2.3.1\n* xlrd==1.2.0\n* scikit-learn==0.22\n* tqdm==4.45.0\n* opencv-python==4.2.0.34\n\nTo install requirements:\n\n```setup\npip install -r requirements.txt\n```\n\nAll experiments tested on Ubuntu 18.04 with Python 3.6.\n\n## Acknowledgements\n\nOur UCI experiments were inspired by Tim Pearce's implementation of [High-Quality Prediction Intervals for Deep Learning:\nA Distribution-Free, Ensembled Approach](https://github.com/TeaPearce/Deep_Learning_Prediction_Intervals). Moreover, in \nIMDB age estimation experiment we used the preprocessing implemented in \n[SSR-Net: A Compact Soft Stagewise Regression Network for Age Estimation](https://github.com/shamangary/SSR-Net).\n\n## Citing PIVEN\nIf you use PIVEN in your research please use the following BibTeX entry:\n\n```BibTeX\n@article{simhayev2022integrated,\n  title={Integrated prediction intervals and specific value predictions for regression problems using neural networks},\n  author={Simhayev, Eli and Katz, Gilad and Rokach, Lior},\n  journal={Knowledge-Based Systems},\n  volume={247},\n  pages={108685},\n  year={2022},\n  publisher={Elsevier}\n}\n```\n\n\n\n\n\n\n\n\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Felisim%2Fpiven","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Felisim%2Fpiven","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Felisim%2Fpiven/lists"}