{"id":13341902,"url":"https://github.com/fly-apps/cog-whisper","last_synced_at":"2025-04-22T20:49:08.326Z","repository":{"id":247378039,"uuid":"765265009","full_name":"fly-apps/cog-whisper","owner":"fly-apps","description":"Run OpenAI Whisper as a Cog model on Fly GPUs","archived":false,"fork":false,"pushed_at":"2024-07-17T08:23:16.000Z","size":5449,"stargazers_count":3,"open_issues_count":0,"forks_count":3,"subscribers_count":7,"default_branch":"main","last_synced_at":"2025-03-29T18:41:45.018Z","etag":null,"topics":["ai","cog","gpu","whisper"],"latest_commit_sha":null,"homepage":"","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"apache-2.0","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/fly-apps.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE.txt","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2024-02-29T15:37:37.000Z","updated_at":"2024-10-18T10:40:58.000Z","dependencies_parsed_at":"2024-07-17T10:18:56.415Z","dependency_job_id":"01f33c0d-a272-4f65-a078-eae707af5a78","html_url":"https://github.com/fly-apps/cog-whisper","commit_stats":null,"previous_names":["fly-apps/cog-whisper"],"tags_count":4,"template":true,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/fly-apps%2Fcog-whisper","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/fly-apps%2Fcog-whisper/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/fly-apps%2Fcog-whisper/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/fly-apps%2Fcog-whisper/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/fly-apps","download_url":"https://codeload.github.com/fly-apps/cog-whisper/tar.gz/refs/heads/main","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":250323531,"owners_count":21411939,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["ai","cog","gpu","whisper"],"created_at":"2024-07-29T19:26:40.841Z","updated_at":"2025-04-22T20:49:08.276Z","avatar_url":"https://github.com/fly-apps.png","language":"Python","funding_links":[],"categories":[],"sub_categories":[],"readme":"\u003cdiv align=\"center\"\u003e\n    \u003ch1\u003eWhisper on Fly GPUs\u003c/h1\u003e\n    \u003cp\u003eRun \u003cstrong\u003e\u003ca href=\"https://github.com/openai/whisper\"\u003eOpenAI Whisper\u003c/a\u003e\u003c/strong\u003e as a \u003cstrong\u003e\u003ca href=\"https://github.com/replicate/cog\"\u003eReplicate Cog\u003c/a\u003e\u003c/strong\u003e on Fly.io!\u003c/p\u003e\n\u003c/div\u003e\n\n![cog](https://github.com/fly-apps/cog-whisper/assets/3727384/4d757f88-29c1-4966-ace9-01d0b1a630ac)\n\nThis app exposes the Whisper model via a simple HTTP server, thanks to Replicate Cog. Cog is an open-source tool that lets you package machine learning models in a standard, production-ready container. When you're up and running, you can trascribe audio using the /predictions endpoint.\n\n## Launch\n\nCreate a deploy the app in one single command:\n\n```console\nfly launch --from https://github.com/fly-apps/cog-whisper --no-public-ips\n```\n\nAssign a [Flycast](https://fly.io/docs/networking/private-networking/#assign-a-flycast-address) IP to the app:\n\n```console\nfly ips allocate-v6 --private\n```\n\nThat's it! You can now access the app at `http://\u003cAPP_NAME\u003e.flycast/predictions`\n\n\u003e [!IMPORTANT]  \n\u003e By default, the app runs on Fly GPUs — Nvidia L40s to be exact. This can be customized in the fly.toml `vm` settings. It will run on a standard Fly Machine — but performance will be reduced.\n\n## Usage\n\n```console\ncurl -X PUT \\\n     -H \"Content-Type: application/json\" \\\n     -d '{\n           \"input\": {\n             \"audio\": \"https://fly.storage.tigris.dev/cogs/bun_on_fly.mp3\"\n           }\n         }' \\\n     http://cog-whisper.flycast/predictions/test | jq\n\n```\n\n## Local Setup\n\n1. Clone the `cog-whisper` repository from GitHub:\n\n    ```console\n    git clone git@github.com:fly-apps/cog-whisper.git\n    ```\n\n2. Navigate into the cloned directory:\n\n    ```console\n    cd cog-whisper\n    ```\n    \n3. Run locally. First, run `get_weights.sh` from the project root to download pre-trained weights, then build a container and run predictions:\n\n    ```console\n    ./scripts/get_weights.sh:\n    ```\n\n    ```console\n    cog predict -i audio=\"\u003cpath/to/your/audio/file\u003e\"\n    ```\n\n4. Build the Docker image using `cog`:\n\n    ```console\n    cog build -t whisper\n    ```\n\n## Having trouble?\n\nCreate an issue or ask a question here: https://community.fly.io/\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Ffly-apps%2Fcog-whisper","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Ffly-apps%2Fcog-whisper","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Ffly-apps%2Fcog-whisper/lists"}