{"id":21165209,"url":"https://github.com/jomit/sign-langauge-recognition","last_synced_at":"2025-07-27T19:10:53.790Z","repository":{"id":39736094,"uuid":"137826469","full_name":"jomit/sign-langauge-recognition","owner":"jomit","description":"Sign Language Gesture Recognition on the Intelligent Edge using Azure Cognitive Services","archived":false,"fork":false,"pushed_at":"2023-03-24T23:14:46.000Z","size":84834,"stargazers_count":13,"open_issues_count":2,"forks_count":5,"subscribers_count":1,"default_branch":"master","last_synced_at":"2025-07-09T16:48:41.926Z","etag":null,"topics":["android-app","azure","cognitive-services"],"latest_commit_sha":null,"homepage":null,"language":"Java","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/jomit.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null}},"created_at":"2018-06-19T01:47:09.000Z","updated_at":"2024-11-16T11:41:10.000Z","dependencies_parsed_at":"2022-08-29T00:41:41.658Z","dependency_job_id":"2f2e55ab-17cd-4618-9680-fd6f94eb78a0","html_url":"https://github.com/jomit/sign-langauge-recognition","commit_stats":null,"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"purl":"pkg:github/jomit/sign-langauge-recognition","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/jomit%2Fsign-langauge-recognition","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/jomit%2Fsign-langauge-recognition/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/jomit%2Fsign-langauge-recognition/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/jomit%2Fsign-langauge-recognition/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/jomit","download_url":"https://codeload.github.com/jomit/sign-langauge-recognition/tar.gz/refs/heads/master","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/jomit%2Fsign-langauge-recognition/sbom","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":267408917,"owners_count":24082528,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","status":"online","status_checked_at":"2025-07-27T02:00:11.917Z","response_time":82,"last_error":null,"robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":true,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["android-app","azure","cognitive-services"],"created_at":"2024-11-20T14:22:44.602Z","updated_at":"2025-07-27T19:10:53.768Z","avatar_url":"https://github.com/jomit.png","language":"Java","funding_links":[],"categories":[],"sub_categories":[],"readme":"# Sign Language Gesture Recognition on the Intelligent Edge using Azure Cognitive Services\n\nFor this walkthrough we will use an Android Phone/Tablet as the Intelligent Edge device. The goal is to show how we can quickly create image recognition models using [Custom Vision Service](https://www.customvision.ai/) and export it to consume it offline at the Edge.\n\nIf you just want to test the app you can download the APK file from [here](https://github.com/jomit/sign-langauge-recognition/blob/master/sign-recognizer.apk?raw=true).\n\n![Sign Language](https://raw.githubusercontent.com/jomit/sign-langauge-recognition/master/images/signs.png)\n\n#### Setup\n\n- [Install Android Studio](https://developer.android.com/studio/index.html)\n\n- Download [dataset.zip](https://github.com/jomit/sign-langauge-recognition/blob/master/dataset.zip?raw=true) file and extract it\n    - Original dataset can be found [here](https://www.kaggle.com/datamunge/sign-language-mnist/version/1)\n\n#### Create Sign Language Recognition ML Model\n\n- Sigin to [Custom Vision Service](https://www.customvision.ai/) using your Azure Account\n\n- Create New Project with Domains as **General (compact)**\n\n- Upload all images from **dataset\\A** folder with Tag **A**\n\n- ***Repeat** above step for all alphabets in the dataset...*\n\n- Click the **Train** button at top to start training the model\n\n- Once the training is complete use the **Quick Test** button to upload a new image and test it.\n\n    ![Custom Vision Service](https://raw.githubusercontent.com/jomit/sign-langauge-recognition/master/images/customvisionservice.jpg)\n\n\n#### Export the ML Model\n\n- Under **Performance** tab click **Export**\n\n- Select **Android (Tensorflow)** and download the zip file\n\n- Extract the zip file and verify that it contains **model.pb** and **labels.txt** file\n\n\n#### Create the Android App\n\n- Clone [cognitive-services-android-customvision-sample](https://github.com/Azure-Samples/cognitive-services-android-customvision-sample) repo as a template or you can use the [android-mobileapp](https://github.com/jomit/sign-langauge-recognition/tree/master/android-mobileapp) code from this repo.\n\n- Replace both **model.pb** and **labels.txt** files in `app\\src\\main\\assets\\`\n\n- Open the project in Android Studio\n\n- *Make any updates to UI / Labels as necessary*\n\n#### Deploy the Android App on the device\n\n- First enable Developer Mode + USB Debugging on the Android device\n    - See instructions for Samsung Galaxy S7 [here](https://www.androidcentral.com/how-enable-developer-mode-galaxy-s7)\n\n- Connect your device to laptop via USB\n\n- Click **Run** and select the **app**\n\n- Select the **Connected Device**\n\n    - For first time you need to allow the camera and other permissions and run it again.\n\n\n#### Testing\n\n![Test 1 - Y](https://raw.githubusercontent.com/jomit/sign-langauge-recognition/master/images/test1.jpg)\n\n![Test 2 - P](https://raw.githubusercontent.com/jomit/sign-langauge-recognition/master/images/test2.jpg)\n\n![Test 3 - W](https://raw.githubusercontent.com/jomit/sign-langauge-recognition/master/images/test3.jpg)\n\n![Test 4 - V](https://raw.githubusercontent.com/jomit/sign-langauge-recognition/master/images/test4.jpg)\n\n\n\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fjomit%2Fsign-langauge-recognition","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fjomit%2Fsign-langauge-recognition","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fjomit%2Fsign-langauge-recognition/lists"}