{"id":13340642,"url":"https://github.com/o-tawab/Video-Pixel-Networks","last_synced_at":"2025-03-11T18:31:32.103Z","repository":{"id":92699498,"uuid":"100975857","full_name":"o-tawab/Video-Pixel-Networks","owner":"o-tawab","description":"Video Pixel Networks in Tensorflow","archived":false,"fork":false,"pushed_at":"2018-04-21T08:08:37.000Z","size":84,"stargazers_count":55,"open_issues_count":2,"forks_count":12,"subscribers_count":6,"default_branch":"master","last_synced_at":"2024-10-24T06:28:35.935Z","etag":null,"topics":["computer-vision","video-pixel-network","vpn"],"latest_commit_sha":null,"homepage":"","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/o-tawab.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2017-08-21T17:20:39.000Z","updated_at":"2024-05-19T13:39:46.000Z","dependencies_parsed_at":"2023-04-11T19:17:02.178Z","dependency_job_id":null,"html_url":"https://github.com/o-tawab/Video-Pixel-Networks","commit_stats":null,"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/o-tawab%2FVideo-Pixel-Networks","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/o-tawab%2FVideo-Pixel-Networks/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/o-tawab%2FVideo-Pixel-Networks/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/o-tawab%2FVideo-Pixel-Networks/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/o-tawab","download_url":"https://codeload.github.com/o-tawab/Video-Pixel-Networks/tar.gz/refs/heads/master","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":243090386,"owners_count":20234793,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["computer-vision","video-pixel-network","vpn"],"created_at":"2024-07-29T19:23:54.425Z","updated_at":"2025-03-11T18:31:32.090Z","avatar_url":"https://github.com/o-tawab.png","language":"Python","funding_links":[],"categories":[],"sub_categories":[],"readme":"# VPN: Video Pixel Networks in Tensorflow \nThe VPN is a probabilistic video model that estimates the discrete joint distribution of the raw pixel values in a video. It approaches the best possible performance on the Moving MNIST benchmark. \n\nThis repository contains a tensorflow implementation of the VPN architecture proposed in the [paper](https://arxiv.org/abs/1610.00527). However, this code hasn’t been trained and tested on the full Moving MNIST dataset due to lack of the computation power. It has been overfitted on one sequence to insure the correctness of the implementation. \n\nThis repository also contains some additional experiments with the VPN architecture that are not mentioned in the original paper. These experiments are:\n* Mini VPN architecture.\n* Micro VPN architecture.\n\n## Examples of the network output\n##### Here's different steps from predicting the first frame pixel-by-pixel:\n![alt text](https://github.com/3ammor/Video-Pixel-Networks/blob/master/images/0.PNG \"frame 1\")\n![alt text](https://github.com/3ammor/Video-Pixel-Networks/blob/master/images/1.PNG \"frame 2\")\n![alt text](https://github.com/3ammor/Video-Pixel-Networks/blob/master/images/2.PNG \"frame 3\")\n![alt text](https://github.com/3ammor/Video-Pixel-Networks/blob/master/images/3.PNG \"frame 4\")\n\n## The loss curves for the different architectures\n##### full:pink\n##### mini:red\n##### micro:orange\n![alt text](https://github.com/3ammor/Video-Pixel-Networks/blob/master/images/graph.PNG \"loss\")\n\n\n### The Moving MNIST Dataset\nYou can download the full moving MNIST dataset from toronto [website](http://www.cs.toronto.edu/~nitish/unsupervised_video/). \n\n### Overfitting On One Sequence\n```\npython vpn.py --vpn_arch='mini' --train=True --overfitting=Ture --data_dir='/numpy/file/directory/' --exp_dir='/tmp/vpn/'\n```\n\n### Training On The Full Dataset\n```\npython vpn.py --vpn_arch='mini' --train=True --overfitting=False --data_dir='/numpy/file/directory/' --exp_dir='/tmp/vpn/'\n```\n\n### TODO\n* Train on data generated on the air.\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fo-tawab%2FVideo-Pixel-Networks","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fo-tawab%2FVideo-Pixel-Networks","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fo-tawab%2FVideo-Pixel-Networks/lists"}