{"id":31788525,"url":"https://github.com/vvkmnn/aslai","last_synced_at":"2026-07-22T17:06:23.075Z","repository":{"id":147360245,"uuid":"93641367","full_name":"Vvkmnn/aslAI","owner":"Vvkmnn","description":"A Hidden Markov Machine that recognizes and transcribes ASL. ","archived":false,"fork":false,"pushed_at":"2017-06-07T14:03:18.000Z","size":489,"stargazers_count":0,"open_issues_count":0,"forks_count":0,"subscribers_count":1,"default_branch":"master","last_synced_at":"2026-07-07T13:29:20.411Z","etag":null,"topics":["artificial-intelligence","bayesian-network","hidden-markov-machine"],"latest_commit_sha":null,"homepage":"","language":"Jupyter Notebook","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/Vvkmnn.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null,"zenodo":null,"notice":null,"maintainers":null,"copyright":null,"agents":null,"dco":null,"cla":null}},"created_at":"2017-06-07T13:57:58.000Z","updated_at":"2017-12-11T20:30:16.000Z","dependencies_parsed_at":"2023-07-02T17:15:24.348Z","dependency_job_id":null,"html_url":"https://github.com/Vvkmnn/aslAI","commit_stats":null,"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"purl":"pkg:github/Vvkmnn/aslAI","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Vvkmnn%2FaslAI","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Vvkmnn%2FaslAI/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Vvkmnn%2FaslAI/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Vvkmnn%2FaslAI/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/Vvkmnn","download_url":"https://codeload.github.com/Vvkmnn/aslAI/tar.gz/refs/heads/master","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Vvkmnn%2FaslAI/sbom","scorecard":null,"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":286080680,"owners_count":35770024,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2026-07-20T02:08:10.276Z","status":"online","status_checked_at":"2026-07-22T02:00:06.236Z","response_time":124,"last_error":null,"robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":true,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["artificial-intelligence","bayesian-network","hidden-markov-machine"],"created_at":"2025-10-10T14:19:07.748Z","updated_at":"2026-07-22T17:06:23.060Z","avatar_url":"https://github.com/Vvkmnn.png","language":"Jupyter Notebook","funding_links":[],"categories":[],"sub_categories":[],"readme":"# recognizerAI\n\n\n[![](http://www.bu.edu/asllrp/SignStream/screenshots/ss2-screen.gif)](http://www-i6.informatik.rwth-aachen.de/~dreuw/download/021.avi)\n\nAnother [AIND](https://www.udacity.com/course/artificial-intelligence-nanodegree--nd889) project, that uses American Sign Language data from Boston University to a **Hidden Markov Machine (HMM)**, leveraging our understanding of **Probabilistic Models**, **Bayesian Networks**, and **Statistics**:  \n\n\n## Data \n\nThe data in the `data/` directory was derived from \nthe [RWTH-BOSTON-104 Database](http://www-i6.informatik.rwth-aachen.de/~dreuw/database-rwth-boston-104.php). \nThe handpositions (`hand_condensed.csv`) are pulled directly from \nthe database [boston104.handpositions.rybach-forster-dreuw-2009-09-25.full.xml](boston104.handpositions.rybach-forster-dreuw-2009-09-25.full.xml)\n\nThe three markers are:\n\n*   0  speaker's left hand\n*   1  speaker's right hand\n*   2  speaker's nose\n*   X and Y values of the video frame increase left to right and top to bottom.\n\nTake a look at the sample [ASL recognizer video](http://www-i6.informatik.rwth-aachen.de/~dreuw/download/021.avi)\nto see how the hand locations are tracked.\n\nThe videos are sentences with translations provided in the database.  \nFor purposes of this project, the sentences have been pre-segmented into words \nbased on slow motion examination of the files. These segments are provided in the `train_words.csv` and `test_words.csv` files in the form of start and end frames (inclusive)\n\nThe videos in the corpus include recordings from three different ASL speakers.\nThe mappings for the three speakers to video are included in the `speaker.csv` \nfile.\n\n\n## Setup\n\nThis project requires **Python 3** and the following Python libraries installed:\n\n- [NumPy](http://www.numpy.org/)\n- [SciPy](https://www.scipy.org/)\n- [scikit-learn](http://scikit-learn.org/0.17/install.html)\n- [pandas](http://pandas.pydata.org/)\n- [matplotlib](http://matplotlib.org/)\n- [jupyter](http://ipython.org/notebook.html)\n- [hmmlearn](http://hmmlearn.readthedocs.io/en/latest/)\n\nIt is highly recommended that you install the [Anaconda](http://continuum.io/downloads) distribution of Python, which includes most of these packages. There have been issues with using the default `hmmlearn` package, so do install the development version from Github if you have any probelms. \n\n```sh\npip install git+https://github.com/hmmlearn/hmmlearn.git\n```\n\n## Model\n\nThey entire approach is explored in the notebook `asl_recognizer.ipynb`, with additional support from other modules in the directory (especially `my_model_selectors.py`).\n\nFrom a terminal or command window, please run the following command from the top level directory to get started:\n    `jupyter notebook asl_recognizer.ipynb`\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fvvkmnn%2Faslai","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fvvkmnn%2Faslai","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fvvkmnn%2Faslai/lists"}