{"id":13490251,"url":"https://github.com/cvondrick/videogan","last_synced_at":"2026-01-27T07:37:25.487Z","repository":{"id":50582638,"uuid":"67075276","full_name":"cvondrick/videogan","owner":"cvondrick","description":"Generating Videos with Scene Dynamics. NIPS 2016.","archived":false,"fork":false,"pushed_at":"2018-05-03T01:24:08.000Z","size":20,"stargazers_count":714,"open_issues_count":9,"forks_count":143,"subscribers_count":40,"default_branch":"master","last_synced_at":"2024-10-31T03:35:32.480Z","etag":null,"topics":["computer-vision","deep-learning","generative-adversarial-network","video"],"latest_commit_sha":null,"homepage":"http://web.mit.edu/vondrick/tinyvideo/","language":"Lua","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/cvondrick.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null}},"created_at":"2016-08-31T21:37:50.000Z","updated_at":"2024-10-03T08:48:25.000Z","dependencies_parsed_at":"2022-09-08T14:00:17.932Z","dependency_job_id":null,"html_url":"https://github.com/cvondrick/videogan","commit_stats":null,"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/cvondrick%2Fvideogan","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/cvondrick%2Fvideogan/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/cvondrick%2Fvideogan/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/cvondrick%2Fvideogan/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/cvondrick","download_url":"https://codeload.github.com/cvondrick/videogan/tar.gz/refs/heads/master","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":245978201,"owners_count":20703675,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["computer-vision","deep-learning","generative-adversarial-network","video"],"created_at":"2024-07-31T19:00:43.570Z","updated_at":"2026-01-27T07:37:25.436Z","avatar_url":"https://github.com/cvondrick.png","language":"Lua","funding_links":[],"categories":["Lua"],"sub_categories":[],"readme":"Generating Videos with Scene Dynamics\n=====================================\n\nThis repository contains an implementation of [Generating Videos with Scene Dynamics](http://carlvondrick.com/tinyvideo/) by Carl Vondrick, Hamed Pirsiavash, Antonio Torralba, to appear at NIPS 2016. The model learns to generate tiny videos using adversarial networks.\n\nExample Generations\n-------------------\nBelow are some selected videos that are generated by our model. These videos are not real; they are hallucinated by a generative video model. While they are not photo-realistic, the motions are fairly reasonable for the scene category they are trained on.\n\n\u003ctable\u003e\u003ctr\u003e\u003ctd\u003e\n\u003cstrong\u003eBeach\u003c/strong\u003e\u003cbr\u003e\n\u003cimg src='http://carlvondrick.com/tinyvideo/supp/supp/beach/1.gif'\u003e\n\u003cimg src='http://carlvondrick.com/tinyvideo/supp/supp/beach/2.gif'\u003e\n\u003cimg src='http://carlvondrick.com/tinyvideo/supp/supp/beach/3.gif'\u003e\n\u003cimg src='http://carlvondrick.com/tinyvideo/supp/supp/beach/4.gif'\u003e\n\u003cimg src='http://carlvondrick.com/tinyvideo/supp/supp/beach/5.gif'\u003e\u003cbr\u003e\n\u003cimg src='http://carlvondrick.com/tinyvideo/supp/supp/beach/6.gif'\u003e\n\u003cimg src='http://carlvondrick.com/tinyvideo/supp/supp/beach/7.gif'\u003e\n\u003cimg src='http://carlvondrick.com/tinyvideo/supp/supp/beach/8.gif'\u003e\n\u003cimg src='http://carlvondrick.com/tinyvideo/supp/supp/beach/9.gif'\u003e\n\u003cimg src='http://carlvondrick.com/tinyvideo/supp/supp/beach/10.gif'\u003e\u003cbr\u003e\n\u003cimg src='http://carlvondrick.com/tinyvideo/supp/supp/beach/11.gif'\u003e\n\u003cimg src='http://carlvondrick.com/tinyvideo/supp/supp/beach/12.gif'\u003e\n\u003cimg src='http://carlvondrick.com/tinyvideo/supp/supp/beach/13.gif'\u003e\n\u003cimg src='http://carlvondrick.com/tinyvideo/supp/supp/beach/14.gif'\u003e\n\u003cimg src='http://carlvondrick.com/tinyvideo/supp/supp/beach/15.gif'\u003e\n\u003c/td\u003e\u003ctd\u003e\n\u003cstrong\u003eGolf\u003c/strong\u003e\u003cbr\u003e\n\u003cimg src='http://carlvondrick.com/tinyvideo/supp/supp/golf/1.gif'\u003e\n\u003cimg src='http://carlvondrick.com/tinyvideo/supp/supp/golf/2.gif'\u003e\n\u003cimg src='http://carlvondrick.com/tinyvideo/supp/supp/golf/3.gif'\u003e\n\u003cimg src='http://carlvondrick.com/tinyvideo/supp/supp/golf/4.gif'\u003e\n\u003cimg src='http://carlvondrick.com/tinyvideo/supp/supp/golf/5.gif'\u003e\u003cbr\u003e\n\u003cimg src='http://carlvondrick.com/tinyvideo/supp/supp/golf/6.gif'\u003e\n\u003cimg src='http://carlvondrick.com/tinyvideo/supp/supp/golf/7.gif'\u003e\n\u003cimg src='http://carlvondrick.com/tinyvideo/supp/supp/golf/8.gif'\u003e\n\u003cimg src='http://carlvondrick.com/tinyvideo/supp/supp/golf/9.gif'\u003e\n\u003cimg src='http://carlvondrick.com/tinyvideo/supp/supp/golf/10.gif'\u003e\u003cbr\u003e\n\u003cimg src='http://carlvondrick.com/tinyvideo/supp/supp/golf/11.gif'\u003e\n\u003cimg src='http://carlvondrick.com/tinyvideo/supp/supp/golf/12.gif'\u003e\n\u003cimg src='http://carlvondrick.com/tinyvideo/supp/supp/golf/13.gif'\u003e\n\u003cimg src='http://carlvondrick.com/tinyvideo/supp/supp/golf/14.gif'\u003e\n\u003cimg src='http://carlvondrick.com/tinyvideo/supp/supp/golf/15.gif'\u003e\n\u003c/td\u003e\u003c/tr\u003e\u003ctr\u003e\u003ctd\u003e\n\u003cstrong\u003eTrain Station\u003c/strong\u003e\u003cbr\u003e\n\u003cimg src='http://carlvondrick.com/tinyvideo/supp/supp/train_station/1.gif'\u003e\n\u003cimg src='http://carlvondrick.com/tinyvideo/supp/supp/train_station/2.gif'\u003e\n\u003cimg src='http://carlvondrick.com/tinyvideo/supp/supp/train_station/3.gif'\u003e\n\u003cimg src='http://carlvondrick.com/tinyvideo/supp/supp/train_station/4.gif'\u003e\n\u003cimg src='http://carlvondrick.com/tinyvideo/supp/supp/train_station/5.gif'\u003e\u003cbr\u003e\n\u003cimg src='http://carlvondrick.com/tinyvideo/supp/supp/train_station/6.gif'\u003e\n\u003cimg src='http://carlvondrick.com/tinyvideo/supp/supp/train_station/7.gif'\u003e\n\u003cimg src='http://carlvondrick.com/tinyvideo/supp/supp/train_station/8.gif'\u003e\n\u003cimg src='http://carlvondrick.com/tinyvideo/supp/supp/train_station/9.gif'\u003e\n\u003cimg src='http://carlvondrick.com/tinyvideo/supp/supp/train_station/10.gif'\u003e\u003cbr\u003e\n\u003cimg src='http://carlvondrick.com/tinyvideo/supp/supp/train_station/11.gif'\u003e\n\u003cimg src='http://carlvondrick.com/tinyvideo/supp/supp/train_station/12.gif'\u003e\n\u003cimg src='http://carlvondrick.com/tinyvideo/supp/supp/train_station/13.gif'\u003e\n\u003cimg src='http://carlvondrick.com/tinyvideo/supp/supp/train_station/14.gif'\u003e\n\u003cimg src='http://carlvondrick.com/tinyvideo/supp/supp/train_station/15.gif'\u003e\n\u003c/td\u003e\u003ctd\u003e\n\u003cstrong\u003eBaby\u003c/strong\u003e\u003cbr\u003e\n\u003cimg src='http://carlvondrick.com/tinyvideo/supp/supp/hospital/1.gif'\u003e\n\u003cimg src='http://carlvondrick.com/tinyvideo/supp/supp/hospital/2.gif'\u003e\n\u003cimg src='http://carlvondrick.com/tinyvideo/supp/supp/hospital/3.gif'\u003e\n\u003cimg src='http://carlvondrick.com/tinyvideo/supp/supp/hospital/4.gif'\u003e\n\u003cimg src='http://carlvondrick.com/tinyvideo/supp/supp/hospital/5.gif'\u003e\u003cbr\u003e\n\u003cimg src='http://carlvondrick.com/tinyvideo/supp/supp/hospital/6.gif'\u003e\n\u003cimg src='http://carlvondrick.com/tinyvideo/supp/supp/hospital/7.gif'\u003e\n\u003cimg src='http://carlvondrick.com/tinyvideo/supp/supp/hospital/8.gif'\u003e\n\u003cimg src='http://carlvondrick.com/tinyvideo/supp/supp/hospital/9.gif'\u003e\n\u003cimg src='http://carlvondrick.com/tinyvideo/supp/supp/hospital/10.gif'\u003e\u003cbr\u003e\n\u003cimg src='http://carlvondrick.com/tinyvideo/supp/supp/hospital/11.gif'\u003e\n\u003cimg src='http://carlvondrick.com/tinyvideo/supp/supp/hospital/12.gif'\u003e\n\u003cimg src='http://carlvondrick.com/tinyvideo/supp/supp/hospital/13.gif'\u003e\n\u003cimg src='http://carlvondrick.com/tinyvideo/supp/supp/hospital/14.gif'\u003e\n\u003cimg src='http://carlvondrick.com/tinyvideo/supp/supp/hospital/15.gif'\u003e\n\u003c/td\u003e\u003c/tr\u003e\u003c/table\u003e\n\n\n\nTraining\n--------\n\nThe code requires a Torch7 installation. \n\nTo train a generator for video, see main.lua. This file will construct the networks, start many threads to load data, and train the networks.\n\nFor the conditional version, see main_conditional.lua. This is similar to main.lua, except the input to the model is a static image.\n\nTo generate videos, see generate.lua. This file will also output intermediate layers,\nsuch as the mask and background image, which you can inspect manually.\n\nData\n----\nThe data loading is designed assuming videos have been stabilized and flattened\ninto JPEG images. We do this for efficiency. Stabilization is computationally slow and\nmust be done offline, and reading one file per video is more efficient on NFS.\n\nFor our stabilization code, see the 'extra' directory.\nEssentially, this will convert each video into an image of vertically\nconcatenated frames. After doing this, you create a text file listing\nall the frames, which you pass into the data loader.\n\nModels\n------\nYou can download our pre-trained models [here](https://drive.google.com/file/d/0B-xMJ5CYz_F9QS1BTE5yWl9aUWs/view?usp=sharing) (1 GB ZIP file).\n\nNotes\n-----\nThe code is based on [DCGAN](https://github.com/soumith/dcgan.torch) and our [starter code](https://github.com/cvondrick/torch-starter) in [Torch7](https://github.com/torch/torch7).\n\nIf you find this useful for your research, please consider citing our NIPS\npaper.\n\nLicense\n-------\nMIT\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fcvondrick%2Fvideogan","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fcvondrick%2Fvideogan","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fcvondrick%2Fvideogan/lists"}