{"id":13994539,"url":"https://github.com/carpedm20/pixel-rnn-tensorflow","last_synced_at":"2025-04-05T17:09:33.148Z","repository":{"id":66039969,"uuid":"63187775","full_name":"carpedm20/pixel-rnn-tensorflow","owner":"carpedm20","description":"in progress","archived":false,"fork":false,"pushed_at":"2019-06-02T02:55:12.000Z","size":1686,"stargazers_count":495,"open_issues_count":13,"forks_count":129,"subscribers_count":26,"default_branch":"master","last_synced_at":"2025-03-29T16:11:10.223Z","etag":null,"topics":["generative-model","pixel-rnn","pixelcnn","tensorflow"],"latest_commit_sha":null,"homepage":"","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/carpedm20.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null}},"created_at":"2016-07-12T19:46:49.000Z","updated_at":"2025-03-07T15:08:51.000Z","dependencies_parsed_at":"2024-01-18T05:18:26.158Z","dependency_job_id":"0ba6dd85-1408-48c9-915f-f6abbb67aa26","html_url":"https://github.com/carpedm20/pixel-rnn-tensorflow","commit_stats":null,"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/carpedm20%2Fpixel-rnn-tensorflow","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/carpedm20%2Fpixel-rnn-tensorflow/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/carpedm20%2Fpixel-rnn-tensorflow/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/carpedm20%2Fpixel-rnn-tensorflow/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/carpedm20","download_url":"https://codeload.github.com/carpedm20/pixel-rnn-tensorflow/tar.gz/refs/heads/master","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":247369953,"owners_count":20927928,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["generative-model","pixel-rnn","pixelcnn","tensorflow"],"created_at":"2024-08-09T14:02:55.996Z","updated_at":"2025-04-05T17:09:33.118Z","avatar_url":"https://github.com/carpedm20.png","language":"Python","funding_links":[],"categories":["Python"],"sub_categories":[],"readme":"# PixelCNN \u0026 PixelRNN in TensorFlow\n\nTensorFlow implementation of [Pixel Recurrent Neural Networks](https://arxiv.org/abs/1601.06759). This implementation contains:\n\n![model](./assets/model.png)\n\n1. PixelCNN\n  - Masked Convolution (A, B)\n2. PixelRNN\n  - Row LSTM (in progress)\n  - Diagonal BiLSTM (skew, unskew)\n  - Residual Connections\n  - Multi-Scale PixelRNN (in progress)\n3. Datasets\n  - MNIST\n  - cifar10 (in progress)\n  - ImageNet (in progress)\n\n\n## Requirements\n\n- Python 2.7\n- [Scipy](https://www.scipy.org/)\n- [TensorFlow](https://www.tensorflow.org/) 0.9+\n\n\n## Usage\n\nFirst, install prerequisites with:\n\n    $ pip install tqdm gym[all]\n\nTo train a `pixel_rnn` model with `mnist` data (slow iteration, fast convergence):\n\n    $ python main.py --data=mnist --model=pixel_rnn\n\nTo train a `pixel_cnn` model with `mnist` data (fast iteration, slow convergence):\n\n    $ python main.py --data=mnist --model=pixel_cnn --hidden_dims=64 --recurrent_length=2 --out_hidden_dims=64\n\nTo generate images with trained model: \n\n    $ python main.py --data=mnist --model=pixel_rnn --is_train=False\n\n\n## Samples\n\nSamples generated with `pixel_cnn` after 50 epochs.\n\n![generation_2016_08_01_16_40_28.jpg](./assets/generation_2016_08_01_16_40_28.jpg)\n\n\n## Training details\n\nBelow results uses two different parameters\n\n[1] `--hidden_dims=16 --recurrent_length=7 --out_hidden_dims=32`  \n[2] `--hidden_dims=64 --recurrent_length=2 --out_hidden_dims=64`\n\nTraining results of `pixel_rnn` with \\[1\\] (yellow) and \\[2\\] (green) with `epoch` as x-axis:\n\n![pixel_rnn](./assets/pixel_rnn.png)\n\nTraining results of `pixel_cnn` with \\[1\\] (orange) and \\[2\\] (purple) with `epoch` as x-axis:\n\n![pixel_cnn](./assets/pixel_cnn.png)\n\nTraining results of `pixel_rnn` (yellow, green) and `pixel_cnn` (orange, purple) with `hour` as x-axis:\n\n![pixel_rnn_cnn_relative](./assets/pixel_rnn_cnn_relative.png)\n\n\n\n## References\n\n- [Pixel Recurrent Neural Networks](https://arxiv.org/abs/1601.06759)\n- [Conditional Image Generation with PixelCNN Decoders](https://arxiv.org/abs/1606.05328)\n- [Review by Kyle Kastner](https://github.com/tensorflow/magenta/blob/master/magenta/reviews/pixelrnn.md)\n- [igul222/pixel_rnn](https://github.com/igul222/pixel_rnn)\n- [kundan2510/pixelCNN](https://github.com/kundan2510/pixelCNN)\n\n\n## Author\n\nTaehoon Kim / [@carpedm20](http://carpedm20.github.io/)\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fcarpedm20%2Fpixel-rnn-tensorflow","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fcarpedm20%2Fpixel-rnn-tensorflow","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fcarpedm20%2Fpixel-rnn-tensorflow/lists"}