{"id":18160748,"url":"https://github.com/blankeos/scoliovis","last_synced_at":"2025-07-03T22:34:09.853Z","repository":{"id":193900975,"uuid":"567101373","full_name":"Blankeos/scoliovis","owner":"Blankeos","description":"🦴 Automated Cobb Angle Measurement on Anterior-Posterior Spine X-Rays using Multi-Instance Keypoint Detection with Keypoint RCNN Thesis Package","archived":false,"fork":false,"pushed_at":"2023-09-10T16:47:21.000Z","size":45023,"stargazers_count":19,"open_issues_count":0,"forks_count":11,"subscribers_count":1,"default_branch":"main","last_synced_at":"2025-05-07T08:49:31.985Z","etag":null,"topics":["computer-vision","fastapi","machine-learning","pytorch","react","webapp"],"latest_commit_sha":null,"homepage":"https://scoliovis.app","language":"TypeScript","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/Blankeos.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null}},"created_at":"2022-11-17T04:13:00.000Z","updated_at":"2025-04-17T01:25:33.000Z","dependencies_parsed_at":"2023-09-10T18:09:04.449Z","dependency_job_id":null,"html_url":"https://github.com/Blankeos/scoliovis","commit_stats":null,"previous_names":["blankeos/scoliovis"],"tags_count":0,"template":false,"template_full_name":null,"purl":"pkg:github/Blankeos/scoliovis","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Blankeos%2Fscoliovis","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Blankeos%2Fscoliovis/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Blankeos%2Fscoliovis/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Blankeos%2Fscoliovis/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/Blankeos","download_url":"https://codeload.github.com/Blankeos/scoliovis/tar.gz/refs/heads/main","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Blankeos%2Fscoliovis/sbom","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":263415758,"owners_count":23463104,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["computer-vision","fastapi","machine-learning","pytorch","react","webapp"],"created_at":"2024-11-02T08:09:13.737Z","updated_at":"2025-07-03T22:34:09.829Z","avatar_url":"https://github.com/Blankeos.png","language":"TypeScript","funding_links":[],"categories":[],"sub_categories":[],"readme":"![preview](/assets/preview.png)\n\n\u003ch3 align=\"center\"\u003e✨ ScolioVis ✨\u003c/h3\u003e\n\u003cp align=\"center\"\u003e\n  Automated Cobb Angle Measurement on Anterior-Posterior Spine X-Rays using Multi-Instance Keypoint Detection with Keypoint RCNN\n\u003c/p\u003e\n\u003cp align=\"center\"\u003e\u003ca href=\"https://scoliovis.app/\"\u003ehttps://scoliovis.app\u003c/a\u003e\u003c/p\u003e\n\u003cp align=\"center\"\u003e\n  \u003c!-- \u003ca href=\"https://github.com/sindresorhus/awesome\"\u003e --\u003e\n    \u003cimg alt=\"Awesome Badge\" src=\"https://cdn.rawgit.com/sindresorhus/awesome/d7305f38d29fed78fa85652e3a63e154dd8e8829/media/badge.svg\" height=\"20\"\u003e\n  \u003c!-- \u003c/a\u003e --\u003e\n  \u003ca href=\"https://scoliovis.app\"\u003e\n\t\u003cimg alt=\"Vercel Badge Custom\" src=\"assets/vercel_status.svg\" height=\"20\"\u003e\n  \u003c/a\u003e\n\u003c/p\u003e\n\n## 📖 Summary\n\n![demo](/assets/demo.gif)\n\nThis repository serves as the compiled package of our undergraduate research for West Visayas State University - College of Information and Communications Technology entitled: **_\"ScolioVis:\nAutomated Cobb Angle Measurement on Anterior-Posterior Spine X-Rays using Multi-Instance Keypoint Detection with Keypoint RCNN\"_**\n\nIn this repo, you can:\n\n- [x] Read our research manuscript.\n- [x] Understand our project.\n- [x] Try our live, deployed demo on [scoliovis.app](https://scoliovis.app/)\n- [x] Try running our project locally.\n- [x] Recreate our research/project.\n\n## 📑 Contents\n\n- [:book: About](#book-about)\n- [:toolbox: Setup Instructions](#toolbox-setup-instructions)\n- [:ledger: Colab Notebooks](#ledger-colab-notebooks)\n- [:brain: Models](#brain-models)\n- [:scroll: Important References](#scroll-important-references)\n- [:trophy: Acknowledgements](#trophy-acknowledgements)\n- [:writing_hand: Cite our Project](#writing_hand-cite-our-project)\n\n## :book: About\n\n**ScolioVis** is a tool for automatically measuring the Cobb Angle—the standard measurement to assess Scoliosis. We harness the power of computer vision and machine learning to extract the cobb angles of an anterior-posterior Spine x-ray image. We built this application from the ground-up to an actual implementation in a usable web app.\n\nWe trained a Keypoint RCNN model on the [SpineWeb Dataset 16](http://spineweb.digitalimaginggroup.ca/Index.php?n=Main.Datasets#Dataset_16.3A_609_spinal_anterior-posterior_x-ray_images). Boasting a performance of 93% AP at IoU=0.50 on object detections and 57% AP at IoU=0.50 on keypoint detections. The dataset is also part of the [Accurate Automated Spinal Curvature Estimation (AASCE) 2019 Grand Challenge](https://aasce19.grand-challenge.org/Task/). Atlhough we aren't competing, using the performance metric of the challenge, we have achieved an **SMAPE of 8.97** in cobb angle calculation which means ScolioVis as a whole is able to predict cobb angles at **91.03% accuracy**.\n\nA live deployed version of the application is available at [scoliovis.app](https://scoliovis.app/).\n\n## :toolbox: Setup Instructions\n\n👉 Go to [/src](/src) for detailed instructions on how to setup this project on your machine.\n\nSource Repositories:\n\n1. `🎨` [scoliovis-web](https://github.com/Blankeos/scoliovis-web) - Front End Repo\n2. `⚡` [scoliovis-api](https://github.com/Blankeos/scoliovis-api) - Back End Repo\n3. `🏋️‍♂️` [scoliovis-training](https://github.com/Blankeos/scoliovis-training) - Model Training Repository\n\n## :ledger: Colab Notebooks\n\n1. [Dataset Preprocessing for Keypoint RCNN](https://colab.research.google.com/drive/1Rlt43PWo6NYREuDsGT8K5tRg5QqfFdVc?usp=sharing)\n1. [Keypoint RCNN Training](https://colab.research.google.com/drive/1aaTWt2rZ-M7YlqIus7aC-84SorjNwl8G?usp=sharing)\n1. [Cobb Angle Calculation](https://colab.research.google.com/drive/1Cm32oftsMpsqMH5kLHgr0RtsfLAfiJnF?usp=sharing)\n\n## :brain: Models\n\n- [scoliovis-training/releases/keypointsrcnn-weights.pt](https://github.com/Blankeos/scoliovis-training/releases/download/latest/keypointsrcnn_weights.pt)\n\u003c!-- 2. releases/yolov5-detection.pt _(obsolete)_ --\u003e\n\n## :scroll: Important References\n\n- Any Paper that uses the SpineWeb Dataset 16, must cite the following:\n\n  \u003e Wu, H., Bailey, Chris., Rasoulinejad, Parham., and Li, S., 2017.Automatic landmark estimation for adolescent idiopathic scoliosis assessment using boostnet. Medical Image Computing and Computer Assisted Intervention:127-135. Retrieved from http://www.digitalimaginggroup.ca/members/Shuo/MICCAIAutomatic.pdf\n\n- Our `📄 Thesis Manuscript` and `📘 User Manual` are available on [/doc](/doc).\n\n## :trophy: Acknowledgements\n\n| Name                                                                                        | Contributions                                                                                                                                                                 |\n| ------------------------------------------------------------------------------------------- | ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------- |\n| [👨‍🏫 Dr. Frank I. Elijorde](https://scholar.google.com.ph/citations?user=MbegV1wAAAAJ\u0026hl=en) | Our ever-supportive Thesis Adviser.                                                                                                                                           |\n| [🤵 Dr. Bobby D. Gerardo](https://scholar.google.com.ph/citations?user=JNlh9WMAAAAJ\u0026hl=en)  | Our ever-supportive Thesis Co-Adviser.                                                                                                                                        |\n| [👨‍🔬 Dr. Shuo Li](http://www.digitalimaginggroup.ca/members/Shuo/MICCAIAutomatic.pdf)        | For giving us access to the [SpineWeb Dataset 16](http://spineweb.digitalimaginggroup.ca/Index.php?n=Main.Datasets#Dataset_16.3A_609_spinal_anterior-posterior_x-ray_images). |\n| [👩‍💼 Dr. Julie Ann Salido](https://scholar.google.com/citations?user=xeoUxA0AAAAJ\u0026hl=en)     | For her expertise in computer vision research.                                                                                                                                |\n| [👨‍💼 Mr. Paolo Hilado](https://www.researchgate.net/profile/Paolo-Hilado-2)                  | For his expertise in data science research.                                                                                                                                   |\n| 👩‍⚕️ Dra. Jocelyn F. Villanueva                                                               | For her expertise in radiology.                                                                                                                                               |\n| 👨‍⚕️ Dr. Christopher Barrera                                                                  | For his expertise in radiology.                                                                                                                                               |\n\n\u003c!-- - [👨‍🏫 Dr. Frank I. Elijorde](https://scholar.google.com.ph/citations?user=MbegV1wAAAAJ\u0026hl=en) - Our ever-supportive Thesis Adviser.\n- [🤵 Dr. Bobby D. Gerardo](https://scholar.google.com.ph/citations?user=JNlh9WMAAAAJ\u0026hl=en) - Our ever-supportive Thesis Co-Adviser.\n- [👨‍🔬 Dr. Shuo Li](http://www.digitalimaginggroup.ca/members/Shuo/MICCAIAutomatic.pdf) - for giving us access to the [SpineWeb Dataset 16](http://spineweb.digitalimaginggroup.ca/Index.php?n=Main.Datasets#Dataset_16.3A_609_spinal_anterior-posterior_x-ray_images)\n- [👩‍💼 Dr. Julie Ann Salido](https://scholar.google.com/citations?user=xeoUxA0AAAAJ\u0026hl=en) - for her expertise in computer vision research.\n- [👨‍💼 Mr. Paolo Hilado](https://www.researchgate.net/profile/Paolo-Hilado-2) - for his expertise in data science research.\n- 👩‍⚕️ Dra. Jocelyn F. Villanueva - for her expertise in radiology.\n- 👨‍⚕️ Dr. Christopher Barrera - for his expertise in radiology. --\u003e\n\n## :writing_hand: Cite Our Project\n\nConvert the following `bibtex` to\n\u003ca target=\"_blank\" href=\"https://bibtex.online/?bibtex=%22@article{article,%20type={Bachelor%27s%20Thesis},%20author%20=%20{Taleon,%20Carlo%20Antonio%20and%20Elizalde,%20Glecy%20and%20Rubinos,%20Christopher%20Joseph},%20title%20=%20{ScolioVis:%20Automated%20Cobb%20Angle%20Measurement%20on%20Anterior-Posterior%20Spine%20X-Rays%20using%20Multi-Instance%20Keypoint%20Detection%20with%20Keypoint%20RCNN},%20journal%20=%20{West%20Visayas%20State%20University%20College%20of%20Information%20and%20Communications%20Technology},%20address%20=%20{La%20Paz,%20Iloilo%20City,%20Iloilo,%20Philippines},%20year%20=%20{2023}%20}%22\u0026format=apa\"\u003eAPA\u003c/a\u003e | \u003ca target=\"_blank\" href=\"https://bibtex.online/?bibtex=%22@article{article,%20type={Bachelor%27s%20Thesis},%20author%20=%20{Taleon,%20Carlo%20Antonio%20and%20Elizalde,%20Glecy%20and%20Rubinos,%20Christopher%20Joseph},%20title%20=%20{ScolioVis:%20Automated%20Cobb%20Angle%20Measurement%20on%20Anterior-Posterior%20Spine%20X-Rays%20using%20Multi-Instance%20Keypoint%20Detection%20with%20Keypoint%20RCNN},%20journal%20=%20{West%20Visayas%20State%20University%20College%20of%20Information%20and%20Communications%20Technology},%20address%20=%20{La%20Paz,%20Iloilo%20City,%20Iloilo,%20Philippines},%20year%20=%20{2023}%20}%22\u0026format=mla\"\u003eMLA\u003c/a\u003e\n(Credits to \u003ca target=\"_blank\" href=\"https://bibtex.online\"\u003ebibtex.online\u003c/a\u003e)\n\n```bibtex\n@article{article,\n  type={Bachelor's Thesis},\n  author = {Taleon, Carlo Antonio and Elizalde, Glecy and Rubinos, Christopher Joseph},\n  title = {ScolioVis: Automated Cobb Angle Measurement on Anterior-Posterior Spine X-Rays using Multi-Instance Keypoint Detection with Keypoint RCNN},\n  journal = {West Visayas State University College of Information and Communications Technology},\n  address = {La Paz, Iloilo City, Iloilo, Philippines},\n  year = {2023}\n}\n```\n\n\u003cbr /\u003e\n2023 © Taleon, Elizalde, Rubinos (BSCS4A) - West Visayas State University - College of Information and Communications Technology. All Rights Reserved.\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fblankeos%2Fscoliovis","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fblankeos%2Fscoliovis","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fblankeos%2Fscoliovis/lists"}