{"id":37642857,"url":"https://github.com/simula-complex/nirvana","last_synced_at":"2026-01-16T11:20:52.540Z","repository":{"id":46009618,"uuid":"429508457","full_name":"Simula-COMPLEX/nirvana","owner":"Simula-COMPLEX","description":"RBF SVM based wrong prediction estimator in deep learning models employed for CPS data","archived":false,"fork":false,"pushed_at":"2022-08-04T18:01:13.000Z","size":67471,"stargazers_count":3,"open_issues_count":0,"forks_count":1,"subscribers_count":2,"default_branch":"main","last_synced_at":"2025-03-25T05:32:10.917Z","etag":null,"topics":["cyber-physical-systems","deep-learning","deep-neural-networks","uncertainty","uncertainty-neural-networks","uncertainty-quantification"],"latest_commit_sha":null,"homepage":"","language":"Jupyter Notebook","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/Simula-COMPLEX.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null}},"created_at":"2021-11-18T16:50:14.000Z","updated_at":"2024-09-13T07:25:59.000Z","dependencies_parsed_at":"2022-09-14T23:33:45.775Z","dependency_job_id":null,"html_url":"https://github.com/Simula-COMPLEX/nirvana","commit_stats":null,"previous_names":[],"tags_count":1,"template":false,"template_full_name":null,"purl":"pkg:github/Simula-COMPLEX/nirvana","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Simula-COMPLEX%2Fnirvana","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Simula-COMPLEX%2Fnirvana/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Simula-COMPLEX%2Fnirvana/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Simula-COMPLEX%2Fnirvana/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/Simula-COMPLEX","download_url":"https://codeload.github.com/Simula-COMPLEX/nirvana/tar.gz/refs/heads/main","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Simula-COMPLEX%2Fnirvana/sbom","scorecard":null,"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":286080680,"owners_count":28478207,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2026-01-16T06:30:42.265Z","status":"ssl_error","status_checked_at":"2026-01-16T06:30:16.248Z","response_time":107,"last_error":"SSL_read: unexpected eof while reading","robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":false,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["cyber-physical-systems","deep-learning","deep-neural-networks","uncertainty","uncertainty-neural-networks","uncertainty-quantification"],"created_at":"2026-01-16T11:20:51.832Z","updated_at":"2026-01-16T11:20:52.527Z","avatar_url":"https://github.com/Simula-COMPLEX.png","language":"Jupyter Notebook","funding_links":[],"categories":[],"sub_categories":[],"readme":"# NIRVANA: Uncertainty-Aware Prediction Validator in Deep Learning Models for Cyber-Physical System Data\n\n## Description\nThe use of Deep learning in Cyber-Physical Systems (CPSs) is gaining popularity due to its ability to bring intelligence to CPS behaviors. However, both CPSs and deep learning have inherent uncertainty. Such uncertainty, if not handled adequately, can lead to unsafe CPS behavior. The first step towards addressing such uncertainty in deep learning is to quantify uncertainty. Hence, we propose a novel method called **NIRVANA** (*uNcertaInty pRediction ValidAtor iN Ai*) for prediction validation based on uncertainty metrics. To this end, we first employ prediction-time Dropout-based Bayesian Neural Networks to quantify uncertainty in deep learning models applied to CPS data, and used two uncertainty metrics, i.e., entropy and variance-based metrics. Second, such quantified uncertainty is taken as the input to predict wrong labels using a support vector machine with radial basis function kernel, with the aim of building a highly discriminating prediction validator model with uncertainty values. In addition, we investigated the relationship between uncertainty quantification and prediction performance, and conducted experiments to obtain optimal dropout ratios. We conducted all the experiments with four real-world CPS datasets. Results show that uncertainty quantification is negatively correlated to prediction performance of a deep learning model of CPS data. Also, our dropout ratio adjustment approach is effective in reducing uncertainty of correct predictions while increasing uncertainty of wrong predictions.\n\n## System overview\n\u003cimg src=\"https://raw.githubusercontent.com/Simula-COMPLEX/nirvana/main/desc_imgs/system_overview.png\" width=\"524\" height=\"600\"\u003e\n\n## Jupyter notebooks\n- [Robot](https://github.com/Simula-COMPLEX/nirvana/blob/main/robot-uncertainty-v2.ipynb)\n- [SWaT](https://github.com/Simula-COMPLEX/nirvana/blob/main/swat-v2.ipynb)\n- [KITTI](https://github.com/Simula-COMPLEX/nirvana/blob/main/KITTI-v2.ipynb)\n- [Video conferencing](https://github.com/Simula-COMPLEX/nirvana/blob/main/Video%20conferencing-v2.ipynb)\n\n## People\n* F. Ozgur Catak https://www.uis.no/nb/profile/ferhat-ozgur-catak-0\n* Tao Yue https://www.simula.no/people/tao\n* Shaukat Ali https://www.simula.no/people/shaukat\n\n## Paper\n* Catak, F. O., Yue, T., \u0026 Ali, S. (2022). Uncertainty-Aware Prediction Validator in Deep Learning Models for Cyber-Physical System Data. *ACM Transactions on Software Engineering and Methodology (TOSEM)*, 31(*4*), 1-31.\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fsimula-complex%2Fnirvana","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fsimula-complex%2Fnirvana","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fsimula-complex%2Fnirvana/lists"}