{"id":22481700,"url":"https://github.com/hussaino03/tohacks","last_synced_at":"2026-04-12T21:52:10.671Z","repository":{"id":41333909,"uuid":"497200008","full_name":"hussaino03/ToHacks","owner":"hussaino03","description":"Trained Model To Convert Image Text To Speech","archived":false,"fork":false,"pushed_at":"2022-05-31T07:50:10.000Z","size":36576,"stargazers_count":1,"open_issues_count":0,"forks_count":0,"subscribers_count":1,"default_branch":"main","last_synced_at":"2025-02-01T21:46:35.093Z","etag":null,"topics":["django","ml","python","tensorflow"],"latest_commit_sha":null,"homepage":"","language":"Jupyter Notebook","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/hussaino03.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null}},"created_at":"2022-05-28T03:16:45.000Z","updated_at":"2022-06-30T17:54:58.000Z","dependencies_parsed_at":"2022-09-19T00:02:27.786Z","dependency_job_id":null,"html_url":"https://github.com/hussaino03/ToHacks","commit_stats":null,"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/hussaino03%2FToHacks","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/hussaino03%2FToHacks/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/hussaino03%2FToHacks/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/hussaino03%2FToHacks/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/hussaino03","download_url":"https://codeload.github.com/hussaino03/ToHacks/tar.gz/refs/heads/main","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":245905874,"owners_count":20691863,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["django","ml","python","tensorflow"],"created_at":"2024-12-06T16:15:00.585Z","updated_at":"2026-04-12T21:52:05.604Z","avatar_url":"https://github.com/hussaino03.png","language":"Jupyter Notebook","funding_links":[],"categories":[],"sub_categories":[],"readme":"\n\u003cdiv id=\"top\"\u003e\u003c/div\u003e\n\n[![Contributors][contributors-shield]][contributors-url]\n[![Issues][issues-shield]][issues-url]\n[![MIT License][license-shield]][license-url]\n\n\u003c!-- PROJECT LOGO --\u003e\n\u003cbr\u003e\n\n\u003cdiv align=\"center\"\u003e\n\n\u003cimg src=\"https://encrypted-tbn0.gstatic.com/images?q=tbn:ANd9GcS9qsjzWAkeyCPRHTynRMqbf7JBKj96YmmkkQ\u0026usqp=CAU\"\u003e\u003c/img\u003e\n\n  \u003ch1 align=\"center\"\u003eToHacks\u003c/h1\u003e\n\n  \u003cp align=\"center\"\u003e\n   TBA\n    \u003cbr\u003e\n    \u003cbr\u003e\n    \u003ca href=\"https://github.com/hussaino03/ToHacks\"\u003e\u003cstrong\u003eExplore the docs »\u003c/strong\u003e\u003c/a\u003e\n  \u003c/p\u003e\n\u003c/div\u003e\n\n\u003c!-- TABLE OF CONTENTS --\u003e\n\u003cdetails\u003e\n  \u003csummary\u003eTable of Contents\u003c/summary\u003e\n  \u003cbr\u003e\n  \u003cbr\u003e\n  \u003col\u003e\n    \u003cli\u003e\n      \u003ca href=\"#about-the-project\"\u003eAbout The Project\u003c/a\u003e\n      \u003cul\u003e\n        \u003cli\u003e\u003ca href=\"#built-with\"\u003eBuilt With\u003c/a\u003e\u003c/li\u003e\n      \u003c/ul\u003e\n    \u003c/li\u003e\n    \u003cli\u003e\n      \u003ca href=\"#getting-started\"\u003eGetting Started\u003c/a\u003e\n      \u003cul\u003e\n        \u003cli\u003e\u003ca href=\"#prerequisites\"\u003ePrerequisites\u003c/a\u003e\u003c/li\u003e\n        \u003cli\u003e\u003ca href=\"#installation\"\u003eInstallation\u003c/a\u003e\u003c/li\u003e\n      \u003c/ul\u003e\n    \u003c/li\u003e\n    \u003cli\u003e\u003ca href=\"#usage\"\u003eUsage\u003c/a\u003e\u003c/li\u003e\n    \u003cli\u003e\u003ca href=\"#roadmap\"\u003eRoadmap\u003c/a\u003e\u003c/li\u003e\n    \u003cli\u003e\u003ca href=\"#contributing\"\u003eContributing\u003c/a\u003e\u003c/li\u003e\n    \u003cli\u003e\u003ca href=\"#license\"\u003eLicense\u003c/a\u003e\u003c/li\u003e\n    \u003cli\u003e\u003ca href=\"#contact\"\u003eContact\u003c/a\u003e\u003c/li\u003e\n    \u003cli\u003e\u003ca href=\"#acknowledgments\"\u003eAcknowledgments\u003c/a\u003e\u003c/li\u003e\n  \u003c/ol\u003e\n\u003c/details\u003e\n\n\n\n\u003c!-- ABOUT THE PROJECT --\u003e\n\n## Snapshots of Approach\n\u003cdiv align=\"center\"\u003e\n\u003cimg src=\"https://media.discordapp.net/attachments/979814222831706195/980464116504350740/conversion.png?width=1191\u0026height=670\" width=800\u003e\u003c/img\u003e\n\u003cbr\u003e\n\u003cimg src=\"https://media.discordapp.net/attachments/979814222831706195/980464115942318100/output.png?width=1191\u0026height=670\" width=800\u003e\u003c/img\u003e\n\u003c/div\u003e\n\n## Inspiration\n\nIn today's fast paced world there is hardly any time for people on the road to observe the surroundings and help the needy. However, the technology has successfully advanced well that the blind need not depend on any other person to perform their day to day activities. Guide Mobile is similar to that of a guide dog but it will help you to experience the scenery before you as if someone speaks with you.\n\n## What it does\n\nGuide Mobile which is a web app takes an image as input, and it provides a speech as an output where the sentence is generated with an image captioning algorithm.\n\n## How We built it\nThe image captioning model was built with tensorflow library. The model was trained on the flick8k image captioning dataset. The overall accuracy of the model was around 80%. There was extensive data preprocessing for the images as well as the corresponding text data and there was use of both Convolutional and Sequential networks. We are deploying the model on web app with Django MVT.\n\n## Challenges we ran into\nThe dataset provided with very limited images hence the output is not accurate for all the real world scenarios. Backend development was something new which under the limited time was challenging to build.\n\n## Accomplishments that we're proud of\nWe were able to deploy the web app and test it successfully on images. The outputs for most of the cases yielded fruitful results.\n\n## What we learned\nLearned to maintain ML models and deploy them. Also learned to version the progress and develop robust backend for the website.\n\n## What's next for Guide Mobile\nAdding more features for the blind such as adding regional languages, networking etc. Also work on real time scenery description so they don't need to click a picture to understand.\n### Features:\n* Easy to interact UI\n* Easy to understand voice\n* Upcoming range for multiple languages\n\n### Built With\n\n* Python\n* Django\n* Tensorflow\n\n\u003c!-- GETTING STARTED --\u003e\n# Getting Started\n\n\u003c!-- PREREQUISITES --\u003e\n## Prerequisites\n* Install the dependencies which are related to ML and Django\n* Host the Django web application\n* Input an image\n\n\n## **Local Setup**\n\n* If you wish to run your own build, first ensure you have python3 globally installed in your computer. If not, you can get python [here](https://www.python.org/downloads/).\n\n* Download [pip](https://pip.pypa.io/en/stable/installing/) and add it to the path\n\n* Clone the repository\n\n  * Using HTTPS\n\n    ```sh\n    git clone https://github.com/hussaino03/ToHacks.git\n    ```\n  \n  * Using SSH\n\n    ```sh\n    git clone git@github.com:hussaino03/ToHacks.git\n    ```\n\n* Change your working directory to the cloned folder `backend`\n\n    ```bash\n    cd path/to/backend\n    ```\n\n* Create a new virtual environment inside `backend` directory and activate that\n\n    ```bash\n    python -m venv env\n    ```\n\n    \u003e ***NOTE***  \n    \u003e By default, this will **not** include any of your existing site packages.\n\n* Download all the dependencies\n\n    ```bash\n    pip install -r requirements.txt\n    ```\n\n    Use `pip3` if `pip` not working\n\n### For running Django Server\n\n* Migrate to the database\n\n    ```bash\n    python manage.py makemigrations\n    python manage.py migrate\n    ```\n\n    Use `python3` if `python` not working\n\n* Run server\n\n    ```sh\n    python manage.py runserver\n    ```\n\n---\n\n\u003c!-- ROADMAP --\u003e\n## Roadmap\n\n* [✅] Train an Image captioning model\n* [✅] Test the model on few input images\n* [✅] Design a Django app to deploy the model\n\n\u003c!-- LICENSE --\u003e\n## License\n\nDistributed under the MIT License. See `LICENSE.txt` for more information.\n\n## Contributors\n\nThanks to all the **people who contribute**\n\n![Contributors](https://contributors-img.web.app/image?repo=hussaino03/ToHacks)\n\n\u003c!-- ACKNOWLEDGMENTS --\u003e\n## Acknowledgments\n\n* [GitHub README.md template](https://github.com/othneildrew/Best-README-Template)\n\n\u003c!-- MARKDOWN LINKS \u0026 IMAGES --\u003e\n\u003c!-- https://www.markdownguide.org/basic-syntax/#reference-style-links --\u003e\n[contributors-shield]: https://img.shields.io/github/contributors/hussaino03/ToHacks?color=%23\u0026style=for-the-badge\n[contributors-url]: https://github.com/hussaino03/ToHacks/graphs/contributors\n[issues-shield]: https://img.shields.io/github/issues/hussaino03/ToHacks?style=for-the-badge\n[issues-url]: https://github.com/hussaino03/ToHacks/issues\n[license-shield]: https://img.shields.io/github/license/othneildrew/Best-README-Template.svg?style=for-the-badge\n[license-url]: https://github.com/hussaino03/ToHacks/blob/main/LICENSE.txt\n[product-screenshot]: loginpage.png\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fhussaino03%2Ftohacks","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fhussaino03%2Ftohacks","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fhussaino03%2Ftohacks/lists"}