{"id":20492741,"url":"https://github.com/kartikmehta8/textify","last_synced_at":"2026-05-11T09:32:33.796Z","repository":{"id":109787390,"uuid":"466626501","full_name":"kartikmehta8/textify","owner":"kartikmehta8","description":"Textify is a Speech-To-Text Website that can be operated by gestures of your hands for Starting, Stopping \u0026 Aborting the Speech Operations.","archived":false,"fork":false,"pushed_at":"2022-03-06T07:51:57.000Z","size":52,"stargazers_count":0,"open_issues_count":0,"forks_count":0,"subscribers_count":1,"default_branch":"main","last_synced_at":"2025-01-16T05:55:19.204Z","etag":null,"topics":["javascript","speech-to-text","tensorflow"],"latest_commit_sha":null,"homepage":"","language":"HTML","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/kartikmehta8.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2022-03-06T03:31:28.000Z","updated_at":"2022-03-30T12:32:05.000Z","dependencies_parsed_at":"2023-04-06T16:47:18.375Z","dependency_job_id":null,"html_url":"https://github.com/kartikmehta8/textify","commit_stats":null,"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/kartikmehta8%2Ftextify","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/kartikmehta8%2Ftextify/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/kartikmehta8%2Ftextify/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/kartikmehta8%2Ftextify/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/kartikmehta8","download_url":"https://codeload.github.com/kartikmehta8/textify/tar.gz/refs/heads/main","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":242073900,"owners_count":20067935,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["javascript","speech-to-text","tensorflow"],"created_at":"2024-11-15T17:30:35.291Z","updated_at":"2026-05-11T09:32:28.753Z","avatar_url":"https://github.com/kartikmehta8.png","language":"HTML","funding_links":[],"categories":[],"sub_categories":[],"readme":"# Textify - Gesture Controlled Speech-to-Text Website\nTextify is a Speech-To-Text Website that can be operated by gestures of your hands for Starting, Stopping \u0026 Aborting the Speech Operations. \n\n## What it is capable of doing?\nYou can convert **Speech-to-Text or vice versa**. The website can perform all the functions by only governing it with various gestures. Users can Start, Stop or command the website to convert the provided text into speech. The only requirement is that you have to provide access to the camera \u0026 microphone. The rest is magic!\n\n## How do I build it?\n### The website is built using:\n- HTML\n- CSS\n- Tailwind CSS\n- Javascript\n- Tensorflow.js\n- Google's Teachable Machine\n- Google Cloud\n- Google Chrome\n\nA user can click **Start with Gestures** to enable the voice recording. There are three gestures for starting, stopping, and converting text-to-speech data. Users can also manually start/stop/play the commands using the buttons provided.\n\n## The challenges I ran into:\n- The major challenge was the integration of Google's Teachable Machine with our camera for Gesture Recognition. Thanks to the document that was on the official website.\n- Working with webkitSpeechRecognition() was quite uncomfortable initially.\n- Setting up coordination between the gestures and speech commands was time-consuming.\n\n## My Learnings \u0026 Accomplishments:\n1. Convert Speech to Text or vice versa with ease.\n2. I integrated an Object Detection Machine Learning Model on a website.\n3. Control a website with gestures.\n4. I learned how to host the ML Model on Google Cloud using Google's Teachable Machine.\n5. Worked with webkitSpeechRecognition().\n\n## What's next for Textify - Gesture Controlled Speech-to-Text Website?\n- I will improve the website by deploying it on Google Virtual Machines and making my ML Model self-train as the number of users increases. It will improve the accuracy of the gesture's identification.\n- I will also try to create my voice assistant rather than using webkitSpeechRecognition() as it depends from browser to browser.\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fkartikmehta8%2Ftextify","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fkartikmehta8%2Ftextify","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fkartikmehta8%2Ftextify/lists"}