{"id":21343654,"url":"https://github.com/catalystcode/customvision-find-video-tags","last_synced_at":"2025-03-16T03:14:21.109Z","repository":{"id":73516970,"uuid":"103394960","full_name":"CatalystCode/customvision-find-video-tags","owner":"CatalystCode","description":"Find highest probability video tags with Microsoft custom vision ai in a video","archived":false,"fork":false,"pushed_at":"2017-09-14T19:18:08.000Z","size":8,"stargazers_count":1,"open_issues_count":0,"forks_count":1,"subscribers_count":7,"default_branch":"master","last_synced_at":"2025-02-23T15:11:15.569Z","etag":null,"topics":[],"latest_commit_sha":null,"homepage":null,"language":"JavaScript","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/CatalystCode.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2017-09-13T12:08:15.000Z","updated_at":"2017-09-13T19:49:12.000Z","dependencies_parsed_at":null,"dependency_job_id":"4c3690ec-7f14-4f2b-9025-e7b048fd8e24","html_url":"https://github.com/CatalystCode/customvision-find-video-tags","commit_stats":null,"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/CatalystCode%2Fcustomvision-find-video-tags","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/CatalystCode%2Fcustomvision-find-video-tags/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/CatalystCode%2Fcustomvision-find-video-tags/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/CatalystCode%2Fcustomvision-find-video-tags/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/CatalystCode","download_url":"https://codeload.github.com/CatalystCode/customvision-find-video-tags/tar.gz/refs/heads/master","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":243818199,"owners_count":20352629,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":[],"created_at":"2024-11-22T01:14:27.823Z","updated_at":"2025-03-16T03:14:21.104Z","avatar_url":"https://github.com/CatalystCode.png","language":"JavaScript","readme":"# customvision-find-video-tags\n\nUse [Microsoft Custom Vision API](customvision.ai) to pin point frames in a video with the biggest probability for each tag.\n\nThis module will;\n\n1. download the video\n2. sample an image every second (configurable)\n3. check for each image what's the probability for each tag (using customvision.ai)\n4. for each tag, take the image with the highest probability\n5. delete local temporary files\n\n# Usage\n\n```js\nlet { pinTagsInVideo } = require('customvision-find-video-tags');\n\npinTagsInVideo(\n  'https://southcentralus.api.cognitive.microsoft.com/customvision/v1.0/Prediction/52856430-0796-4d1b-a05b-b6a42dc14743/image',\n  'f49c5905ca3148cfb5a146a0bsa3adc9',\n  'http://location.com/urlpath/video.mp4',\n  [ 'front', 'back', 'side' ],\n  { every_n_seconds: 0.5 },\n  (err, anchors) =\u003e {\n    console.log('done');\n  }\n);\n```\n\n# Using ffmpeg\n\nIf you want to use ffmpeg without installing it locally, you can use [ffmpeg-ensure](https://github.com/CatalystCode/ffmpeg-ensure):\n\n```js\nlet { ensureFFMPEG } = require('ffmpeg-ensure');\nlet { pinTagsInVideo } = require('customvision-find-video-tags');\n\nensureFFMPEG().then(() =\u003e {\n  pinTagsInVideo(\n    'https://southcentralus.api.cognitive.microsoft.com/customvision/v1.0/Prediction/52856430-0796-4d1b-a05b-b6a42dc14743/image',\n    'f49c5905ca3148cfb5a146a0bsa3adc9',\n    'http://location.com/urlpath/video.mp4',\n    [ 'front', 'back', 'side' ],\n    { every_n_seconds: 0.5 },\n    (err, anchors) =\u003e {\n      console.log('done');\n    }\n  );\n});\n```","funding_links":[],"categories":[],"sub_categories":[],"project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fcatalystcode%2Fcustomvision-find-video-tags","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fcatalystcode%2Fcustomvision-find-video-tags","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fcatalystcode%2Fcustomvision-find-video-tags/lists"}