{"id":22100327,"url":"https://github.com/aryanjain28/image-caption-generator","last_synced_at":"2026-05-08T14:12:08.952Z","repository":{"id":129774966,"uuid":"276566541","full_name":"aryanjain28/Image-Caption-Generator","owner":"aryanjain28","description":"Fused RNN and CNN to predict image activity by amalgamating Xception model output and text input for enhanced accuracy.","archived":false,"fork":false,"pushed_at":"2020-07-02T12:33:56.000Z","size":2381,"stargazers_count":0,"open_issues_count":0,"forks_count":0,"subscribers_count":1,"default_branch":"master","last_synced_at":"2025-05-31T14:17:49.938Z","etag":null,"topics":["cnn","computer-vision","data-science","machine-learning","neural-network","python","rnn","tensorflow"],"latest_commit_sha":null,"homepage":"","language":"Jupyter Notebook","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/aryanjain28.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null,"zenodo":null}},"created_at":"2020-07-02T06:28:35.000Z","updated_at":"2023-08-15T14:13:07.000Z","dependencies_parsed_at":"2023-05-21T05:45:14.546Z","dependency_job_id":null,"html_url":"https://github.com/aryanjain28/Image-Caption-Generator","commit_stats":null,"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"purl":"pkg:github/aryanjain28/Image-Caption-Generator","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/aryanjain28%2FImage-Caption-Generator","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/aryanjain28%2FImage-Caption-Generator/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/aryanjain28%2FImage-Caption-Generator/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/aryanjain28%2FImage-Caption-Generator/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/aryanjain28","download_url":"https://codeload.github.com/aryanjain28/Image-Caption-Generator/tar.gz/refs/heads/master","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/aryanjain28%2FImage-Caption-Generator/sbom","scorecard":null,"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":278537808,"owners_count":26003256,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","status":"online","status_checked_at":"2025-10-05T02:00:06.059Z","response_time":54,"last_error":null,"robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":true,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["cnn","computer-vision","data-science","machine-learning","neural-network","python","rnn","tensorflow"],"created_at":"2024-12-01T05:13:37.027Z","updated_at":"2025-10-06T00:09:23.532Z","avatar_url":"https://github.com/aryanjain28.png","language":"Jupyter Notebook","funding_links":[],"categories":[],"sub_categories":[],"readme":"# Image Caption Generator\n\nTrained a model by merging RNN and CNN to generate the activity occuring on the image. The model takes pre-trained output from another model, Xception, as image's input and takes another input from text and merges them and generates predictions.\n\n# BLEU scores\n\n    Below is a chart that I prepared for the BLEU score of my VGG16 and Xception model. \n    The higher the BLEU score, the higher the accuracy of Model.\n    You can see the Xception Model-4 has the highest score, and that is the model used in this project.\n  \n  \u003cp align=\"center\"\u003e\u003cimg width=\"460\" src=\"https://raw.githubusercontent.com/aryanjain28/Image-Caption-Generator/master/Image%20Caption%20Generator/bleu-scores.png\"\u003e\u003c/p\u003e\n  \n  \n# Screenshots\n\n    Below are some screenshots, half of them are from training set while others are randomly picked from internet.\n    As observed below some results are exceptionally good, while some are too bad.\n    \n\u003ctable align=\"center\" border=\"1\"\u003e\n \u003ctr\u003e\n  \u003ctd\u003e\u003cimg align=\"center\" src=\"https://raw.githubusercontent.com/aryanjain28/Image-Caption-Generator/master/Image%20Caption%20Generator/Screenshots/Screenshot1.jpg\" height=\"250\" /\u003e\u003c/td\u003e\n  \u003ctd\u003e\u003cimg align=\"center\" src=\"https://raw.githubusercontent.com/aryanjain28/Image-Caption-Generator/master/Image%20Caption%20Generator/Screenshots/Screenshot2.jpg\" height=\"250\" /\u003e\u003c/td\u003e\n \u003c/tr\u003e\n\n \u003ctr\u003e\n  \u003ctd\u003e\u003cimg align=\"center\" src=\"https://raw.githubusercontent.com/aryanjain28/Image-Caption-Generator/master/Image%20Caption%20Generator/Screenshots/Screenshot3.jpg\" height=\"250\" /\u003e\u003c/td\u003e\n  \u003ctd\u003e\u003cimg align=\"center\" src=\"https://raw.githubusercontent.com/aryanjain28/Image-Caption-Generator/master/Image%20Caption%20Generator/Screenshots/Screenshot4.jpg\" height=\"250\" /\u003e\u003c/td\u003e\n \u003c/tr\u003e\n\n \u003ctr\u003e\n  \u003ctd\u003e\u003cimg align=\"center\" src=\"https://raw.githubusercontent.com/aryanjain28/Image-Caption-Generator/master/Image%20Caption%20Generator/Screenshots/Screenshot5.jpg\" height=\"250\" /\u003e\u003c/td\u003e\n  \u003ctd\u003e\u003cimg align=\"center\" src=\"https://raw.githubusercontent.com/aryanjain28/Image-Caption-Generator/master/Image%20Caption%20Generator/Screenshots/Screenshot6.jpg\" height=\"250\" /\u003e\u003c/td\u003e\n \u003c/tr\u003e\n \n  \u003ctr\u003e\n  \u003ctd\u003e\u003cimg align=\"center\" src=\"https://raw.githubusercontent.com/aryanjain28/Image-Caption-Generator/master/Image%20Caption%20Generator/Screenshots/Screenshot7.jpg\" height=\"250\" /\u003e\u003c/td\u003e\n  \u003ctd\u003e\u003cimg align=\"center\" src=\"https://raw.githubusercontent.com/aryanjain28/Image-Caption-Generator/master/Image%20Caption%20Generator/Screenshots/Screenshot8.jpg\" height=\"250\" /\u003e\u003c/td\u003e\n \u003c/tr\u003e\n\n \u003ctr\u003e\n  \u003ctd\u003e\u003cimg align=\"center\" src=\"https://raw.githubusercontent.com/aryanjain28/Image-Caption-Generator/master/Image%20Caption%20Generator/Screenshots/Screenshot9.jpg\" height=\"250\" /\u003e\u003c/td\u003e\n  \u003ctd\u003e\u003cimg align=\"center\" src=\"https://raw.githubusercontent.com/aryanjain28/Image-Caption-Generator/master/Image%20Caption%20Generator/Screenshots/Screenshot10.jpg\" height=\"250\" /\u003e\u003c/td\u003e\n \u003c/tr\u003e\n \n  \u003ctr\u003e\n  \u003ctd\u003e\u003cimg align=\"center\" src=\"https://raw.githubusercontent.com/aryanjain28/Image-Caption-Generator/master/Image%20Caption%20Generator/Screenshots/Screenshot11.jpg\" height=\"250\" /\u003e\u003c/td\u003e\n  \u003ctd\u003e\u003cimg align=\"center\" src=\"https://raw.githubusercontent.com/aryanjain28/Image-Caption-Generator/master/Image%20Caption%20Generator/Screenshots/Screenshot12.jpg\" height=\"250\" /\u003e\u003c/td\u003e\n \u003c/tr\u003e\n \n  \u003ctr\u003e\n  \u003ctd\u003e\u003cimg align=\"center\" src=\"https://raw.githubusercontent.com/aryanjain28/Image-Caption-Generator/master/Image%20Caption%20Generator/Screenshots/Screenshot14.jpg\" height=\"250\" /\u003e\u003c/td\u003e\n  \u003ctd\u003e\u003cimg align=\"center\" src=\"https://raw.githubusercontent.com/aryanjain28/Image-Caption-Generator/master/Image%20Caption%20Generator/Screenshots/Screenshot15.jpg\" height=\"250\" /\u003e\u003c/td\u003e\n \u003c/tr\u003e\n\n \u003ctr\u003e\n  \u003ctd\u003e\u003cimg align=\"center\" src=\"https://raw.githubusercontent.com/aryanjain28/Image-Caption-Generator/master/Image%20Caption%20Generator/Screenshots/Screenshot16.jpg\" height=\"250\" /\u003e\u003c/td\u003e\n  \u003ctd\u003e\u003cimg align=\"center\" src=\"https://raw.githubusercontent.com/aryanjain28/Image-Caption-Generator/master/Image%20Caption%20Generator/Screenshots/Screenshot17.jpg\" height=\"250\" /\u003e\u003c/td\u003e\n \u003c/tr\u003e\n \n  \u003ctr\u003e\n  \u003ctd\u003e\u003cimg align=\"center\" src=\"https://raw.githubusercontent.com/aryanjain28/Image-Caption-Generator/master/Image%20Caption%20Generator/Screenshots/Screenshot18.jpg\" height=\"250\" /\u003e\u003c/td\u003e\n  \u003ctd\u003e\u003cimg align=\"center\" src=\"https://raw.githubusercontent.com/aryanjain28/Image-Caption-Generator/master/Image%20Caption%20Generator/Screenshots/Screenshot19.jpg\" height=\"250\" /\u003e\u003c/td\u003e\n \u003c/tr\u003e\n\n \u003ctr\u003e\n  \u003ctd\u003e\u003cimg align=\"center\" src=\"https://raw.githubusercontent.com/aryanjain28/Image-Caption-Generator/master/Image%20Caption%20Generator/Screenshots/Screenshot13.jpg\" height=\"250\" /\u003e\u003c/td\u003e\n  \u003ctd\u003e\u003cimg align=\"center\" src=\"https://raw.githubusercontent.com/aryanjain28/Image-Caption-Generator/master/Image%20Caption%20Generator/Screenshots/Screenshot20.jpg\" height=\"250\" /\u003e\u003c/td\u003e\n \u003c/tr\u003e\n\n \u003ctr\u003e\n  \u003ctd\u003e\u003cimg align=\"center\" src=\"https://raw.githubusercontent.com/aryanjain28/Image-Caption-Generator/master/Image%20Caption%20Generator/Screenshots/Screenshot21.jpg\" height=\"250\" /\u003e\u003c/td\u003e\n  \u003ctd\u003e\u003cimg align=\"center\" src=\"https://raw.githubusercontent.com/aryanjain28/Image-Caption-Generator/master/Image%20Caption%20Generator/Screenshots/Screenshot22.jpg\" height=\"250\" /\u003e\u003c/td\u003e\n \u003c/tr\u003e\n \n  \u003ctr\u003e\n  \u003ctd\u003e\u003cimg align=\"center\" src=\"https://raw.githubusercontent.com/aryanjain28/Image-Caption-Generator/master/Image%20Caption%20Generator/Screenshots/Screenshot23.jpg\" height=\"250\" /\u003e\u003c/td\u003e\n  \u003ctd\u003e\u003cimg align=\"center\" src=\"https://raw.githubusercontent.com/aryanjain28/Image-Caption-Generator/master/Image%20Caption%20Generator/Screenshots/Screenshot24.jpg\" height=\"250\" /\u003e\u003c/td\u003e\n \u003c/tr\u003e\n \n  \u003ctr\u003e\n  \u003ctd\u003e\u003cimg align=\"center\" src=\"https://raw.githubusercontent.com/aryanjain28/Image-Caption-Generator/master/Image%20Caption%20Generator/Screenshots/Screenshot25.jpg\" height=\"250\" /\u003e\u003c/td\u003e\n  \u003ctd\u003e\u003cimg align=\"center\" src=\"https://raw.githubusercontent.com/aryanjain28/Image-Caption-Generator/master/Image%20Caption%20Generator/Screenshots/Screenshot26.jpg\" height=\"250\" /\u003e\u003c/td\u003e\n \u003c/tr\u003e\n \n  \u003ctr\u003e\n  \u003ctd\u003e\u003cimg align=\"center\" src=\"https://raw.githubusercontent.com/aryanjain28/Image-Caption-Generator/master/Image%20Caption%20Generator/Screenshots/Screenshot27.jpg\" height=\"250\" /\u003e\u003c/td\u003e\n  \u003ctd\u003e\u003cimg align=\"center\" src=\"https://raw.githubusercontent.com/aryanjain28/Image-Caption-Generator/master/Image%20Caption%20Generator/Screenshots/Screenshot28.jpg\" height=\"250\" /\u003e\u003c/td\u003e\n \u003c/tr\u003e\n \n  \u003ctr\u003e\n  \u003ctd\u003e\u003cimg align=\"center\" src=\"https://raw.githubusercontent.com/aryanjain28/Image-Caption-Generator/master/Image%20Caption%20Generator/Screenshots/Screenshot29.jpg\" height=\"250\" /\u003e\u003c/td\u003e\n  \u003ctd\u003e\u003cimg align=\"center\" src=\"https://raw.githubusercontent.com/aryanjain28/Image-Caption-Generator/master/Image%20Caption%20Generator/Screenshots/Screenshot30.jpg\" height=\"250\" /\u003e\u003c/td\u003e\n \u003c/tr\u003e\n\n\u003c/table\u003e\n\n\n# References\n\n\u003ca href=\"https://machinelearningmastery.com/develop-a-deep-learning-caption-generation-model-in-python/\" \u003ehttps://machinelearningmastery.com/\u003c/a\u003e\u003cbr\u003e\n\u003ca href=\"https://data-flair.training/blogs/deep-learning-project-ideas/\" \u003ehttps://data-flair.training/\u003c/a\u003e\u003cbr\u003e\n\u003ca href=\"https://www.youtube.com/watch?v=DejHQYAGb7Q\" \u003ehttps://www.youtube.com/\u003c/a\u003e\n\n\n\n\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Faryanjain28%2Fimage-caption-generator","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Faryanjain28%2Fimage-caption-generator","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Faryanjain28%2Fimage-caption-generator/lists"}