{"id":19513763,"url":"https://github.com/excamera/pipelines","last_synced_at":"2025-09-09T14:41:25.042Z","repository":{"id":78126653,"uuid":"58281274","full_name":"excamera/Pipelines","owner":"excamera","description":null,"archived":false,"fork":false,"pushed_at":"2016-05-07T20:04:27.000Z","size":5,"stargazers_count":1,"open_issues_count":0,"forks_count":1,"subscribers_count":4,"default_branch":"master","last_synced_at":"2025-01-08T12:13:17.371Z","etag":null,"topics":[],"latest_commit_sha":null,"homepage":null,"language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/excamera.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2016-05-07T19:29:27.000Z","updated_at":"2016-08-08T03:06:14.000Z","dependencies_parsed_at":"2023-03-12T03:36:54.883Z","dependency_job_id":null,"html_url":"https://github.com/excamera/Pipelines","commit_stats":null,"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/excamera%2FPipelines","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/excamera%2FPipelines/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/excamera%2FPipelines/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/excamera%2FPipelines/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/excamera","download_url":"https://codeload.github.com/excamera/Pipelines/tar.gz/refs/heads/master","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":240762512,"owners_count":19853495,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":[],"created_at":"2024-11-10T23:32:35.714Z","updated_at":"2025-02-25T23:24:49.556Z","avatar_url":"https://github.com/excamera.png","language":"Python","funding_links":[],"categories":[],"sub_categories":[],"readme":"# Pipelines\n\nThe masterLambda is a general purpose lambda, which takes a video, chunks it, calls the WORKER LAMBDA on each chunk, gathers the result of all the WORKER LAMBDAS and calls the reducerLambda to join them. It then notifies completion on SNS.  \n\nThe reducerLambda, takes a list of S3 keys, downloads the keys, and joins them -if they are txt files then simply appends them to a long file. If they are video chunks it uses ffmpeg concat to rejoin them.  \n\nThe taggerLambda, imageclassifyLambda and the grayscaleLambdas are WORKER LAMBDAS, which take in an S3 key as input, operate on it, produce an output chunk or text, write it back to S3 and give its key as output.  \n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fexcamera%2Fpipelines","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fexcamera%2Fpipelines","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fexcamera%2Fpipelines/lists"}