{"id":13341913,"url":"https://github.com/GodModed/ai-captions","last_synced_at":"2025-03-11T23:30:29.434Z","repository":{"id":62973931,"uuid":"562361329","full_name":"GodModed/ai-captions","owner":"GodModed","description":"This small project uses OpenAI's whisper AI to generate captions for videos.","archived":false,"fork":false,"pushed_at":"2022-11-10T03:55:50.000Z","size":37,"stargazers_count":17,"open_issues_count":1,"forks_count":0,"subscribers_count":3,"default_branch":"master","last_synced_at":"2024-10-24T10:08:05.610Z","etag":null,"topics":["ai","captions","collaborate","communityexchange","github","gitlens","learn","python","student-vscode","whisper"],"latest_commit_sha":null,"homepage":"","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"gpl-3.0","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/GodModed.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":"CONTRIBUTING.md","funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null}},"created_at":"2022-11-06T05:04:51.000Z","updated_at":"2024-10-22T21:10:48.000Z","dependencies_parsed_at":"2022-11-10T05:17:20.392Z","dependency_job_id":null,"html_url":"https://github.com/GodModed/ai-captions","commit_stats":null,"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/GodModed%2Fai-captions","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/GodModed%2Fai-captions/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/GodModed%2Fai-captions/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/GodModed%2Fai-captions/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/GodModed","download_url":"https://codeload.github.com/GodModed/ai-captions/tar.gz/refs/heads/master","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":243129517,"owners_count":20241027,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["ai","captions","collaborate","communityexchange","github","gitlens","learn","python","student-vscode","whisper"],"created_at":"2024-07-29T19:26:40.929Z","updated_at":"2025-03-11T23:30:29.067Z","avatar_url":"https://github.com/GodModed.png","language":"Python","readme":"[![GitHub issues](https://img.shields.io/github/issues/godmoded/ai-captions?style=for-the-badge)](https://github.com/godmoded/ai-captions/issues)\n[![GitHub forks](https://img.shields.io/github/forks/godmoded/ai-captions?style=for-the-badge)](https://github.com/godmoded/ai-captions/network)\n[![GitHub stars](https://img.shields.io/github/stars/godmoded/ai-captions?style=for-the-badge)](https://github.com/godmoded/ai-captions/stargazers)\n[![GitHub license](https://img.shields.io/github/license/godmoded/ai-captions?style=for-the-badge)](https://github.com/GodModed/ai-captions/blob/master/LICENSE)\n\n# Ai Captions\n\nCreate captions for videos using AI.\n\n## Description\n\nThis small project uses OpenAI's whisper AI to generate captions for videos.\n\n## Getting Started\n\n### Dependencies\n\n* FFmpeg\n* Python\n\n### Installing\n\n* Clone the repo\n* Install python from [here](https://www.python.org/downloads/) if you have not already installed it.\n* You can install FFmpeg from [here](https://www.ffmpeg.org/download.html) or use your package manager to install it.\n* Install the requirements by running `py setup.py` inside of the project directory.\n\n### Executing program\n\n* If you have not already, run the `setup.py` file to install the required packages.\n```bash\npython setup.py\n```\n* Then run the `main.py` with your own arguments.\n```bash\npython main.py -v \u003cvideo path\u003e -m \u003cwhisper model name\u003e -p (-p is optional)\n```\n\n* Example\n```bash\npython main.py -v video.mp4 -m tiny.en -p\n```\n\n* Arguments\n    * `-v` or `--video` - The path to the video file.\n    * `-m` or `--model` - The name of the model to use. (The list of models can be found below)\n    * `-p` or `--preview` - If you want to preview the generated video.\n\n* Models\n\n|  Size  | Parameters | English-only model | Multilingual model | Required VRAM | Relative speed |\n|:------:|:----------:|:------------------:|:------------------:|:-------------:|:--------------:|\n|  tiny  |    39 M    |     `tiny.en`      |       `tiny`       |     ~1 GB     |      ~32x      |\n|  base  |    74 M    |     `base.en`      |       `base`       |     ~1 GB     |      ~16x      |\n| small  |   244 M    |     `small.en`     |      `small`       |     ~2 GB     |      ~6x       |\n| medium |   769 M    |    `medium.en`     |      `medium`      |     ~5 GB     |      ~2x       |\n| large  |   1550 M   |        N/A         |      `large`       |    ~10 GB     |       1x       |\n\nFor English-only applications, the .en models tend to perform better, especially for the tiny.en and base.en models.\nThese models are provided by OpenAI. [More Info](https://github.com/openai/whisper/blob/main/README.md)\n\nIt may take some time to run for the first time since the AI model needs to be downloaded.\n\nThe output of the program will be in the `output` folder. There will be a video called `output.mp4` inside of the folder. There will also be a transcript file called `captions.vtt` and an audio file called `audio.mp3`.\n## Help\n\nMake an [Issue](https://github.com/GodModed/ai-captions/issues) to report a bug or request a feature.\n\n## Authors\n\n[@GodModed](https://github.com/GodModed)\n\n## Version History\n\n* 0.3\n    * Using ffmpeg instead of moviepy\n    * Increased speed by so much\n* 0.2\n    * Added the ability to preview the generated video.\n    * Added better argument parsing.\n* 0.1.1\n   * Fixed video getting cut off\n* 0.1.0\n    * Initial Release\n\n## License\n\nThis project is licensed under the [GNU General Public License v3.0](https://github.com/GodModed/ai-captions/blob/main/LICENSE) License.\n\n## Acknowledgments\n\n* [Nicholas Renotte](https://www.youtube.com/watch?v=_xVTgdpokH4)\n* [OpenAI Whisper](https://github.com/openai/whisper)\n","funding_links":[],"categories":[],"sub_categories":[],"project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2FGodModed%2Fai-captions","html_url":"https://awesome.ecosyste.ms/projects/github.com%2FGodModed%2Fai-captions","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2FGodModed%2Fai-captions/lists"}