{"id":13444435,"url":"https://github.com/sekwiatkowski/awesome-capsule-networks","last_synced_at":"2025-03-20T18:32:38.871Z","repository":{"id":132078444,"uuid":"120216451","full_name":"sekwiatkowski/awesome-capsule-networks","owner":"sekwiatkowski","description":"A curated list of awesome resources related to capsule networks","archived":false,"fork":false,"pushed_at":"2020-02-24T17:12:38.000Z","size":104,"stargazers_count":973,"open_issues_count":6,"forks_count":198,"subscribers_count":72,"default_branch":"master","last_synced_at":"2024-05-21T12:22:43.579Z","etag":null,"topics":["awesome-list","capsule-network","capsule-networks","computer-vision","deep-learning","neural-networks"],"latest_commit_sha":null,"homepage":null,"language":null,"has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/sekwiatkowski.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null}},"created_at":"2018-02-04T19:36:58.000Z","updated_at":"2024-02-21T08:02:21.000Z","dependencies_parsed_at":null,"dependency_job_id":"73230fa4-b22f-4fdf-9a13-d61f989ca388","html_url":"https://github.com/sekwiatkowski/awesome-capsule-networks","commit_stats":null,"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/sekwiatkowski%2Fawesome-capsule-networks","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/sekwiatkowski%2Fawesome-capsule-networks/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/sekwiatkowski%2Fawesome-capsule-networks/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/sekwiatkowski%2Fawesome-capsule-networks/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/sekwiatkowski","download_url":"https://codeload.github.com/sekwiatkowski/awesome-capsule-networks/tar.gz/refs/heads/master","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":221470047,"owners_count":16827724,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["awesome-list","capsule-network","capsule-networks","computer-vision","deep-learning","neural-networks"],"created_at":"2024-07-31T04:00:22.894Z","updated_at":"2024-10-28T06:30:58.610Z","avatar_url":"https://github.com/sekwiatkowski.png","language":null,"funding_links":[],"categories":["Implementations","Uncategorized","Others","Other Lists"],"sub_categories":["PyTorch","Uncategorized","TeX Lists"],"readme":"# Awesome Capsule Networks [![Awesome](https://cdn.rawgit.com/sindresorhus/awesome/d7305f38d29fed78fa85652e3a63e154dd8e8829/media/badge.svg)](https://github.com/sindresorhus/awesome)\n\n\u003cimg src=\"diagram.png\" /\u003e\n\nA curated list of awesome resources related to capsule networks maintained by [AI Summary](http://aisummary.com).\n\n## Contributing\nPlease [pull a request](https://github.com/aisummary/awesome-capsule-networks/pulls) if you are aware of additional resources.\n\nYour feedback and contributions are always welcome!\n\n## Sharing\n- [Share on Twitter](http://twitter.com/home?status=http://github.com/sekwiatkowski/awesome-capsule-networks)\n- [Share on Facebook](http://www.facebook.com/sharer/sharer.php?u=http://github.com/sekwiatkowski/awesome-capsule-networks)\n- [Share on Google Plus](http://plus.google.com/share?url=http://github.com/sekwiatkowski/awesome-capsule-networks)\n- [Share on LinkedIn](http://www.linkedin.com/shareArticle?mini=true\u0026url=http://github.com/sekwiatkowski/awesome-capsule-networks)\n\n## Table of Contents\n- [Papers](#papers)\n  - [Papers by Geoffrey Hinton and colleagues](#papers-by-hinton-et-al)\n  - [Under review](#under-review)\n  - [Preprints](#preprints)  \n- [Videos](#videos)\n- [Blogs](#blogs)\n- [Dynamic routing implementations](#dynamic-routing-implementations)\n  - [Official implementation](#official-implementation)  \n  - [Chainer](#chainer)  \n  - [CNTK](#cntk)\n  - [Keras](#keras)\n  - [Matlab](#matlab)\n  - [MXNet](#mxnet)\n  - [PyTorch](#pytorch)\n  - [R](#r)\n  - [TensorFlow](#tensorflow)  \n  - [Torch](#torch)\n- [EM routing implementations](#em-routing-implementations)\n  - [PyTorch](#em-routing-pytorch)\n  - [TensorFlow](#em-routing-tensorflow)  \n- [Other resources](#other-resources)  \n- [License](#license)\n\n## Papers\n\n### Papers by Hinton et al.\n- [Matrix capsules with EM routing](https://openreview.net/forum?id=HJWLfGWRb) - Hinton, G. E., Sabour, S. and Frosst, N. (2018)\n- [Dynamic Routing Between Capsules](https://arxiv.org/abs/1710.09829) - Sabour, S., Frosst, N. and Hinton, G.E. (2017)\n- [Transforming Auto-encoders](http://www.cs.toronto.edu/~fritz/absps/transauto6.pdf) - Hinton, G. E., Krizhevsky, A. and Wang, S. D. (2011)\n- [A parallel computation that assigns canonical object-based frames of reference.](http://www.cs.toronto.edu/~fritz/absps/object-based81.pdf) - Hinton, G.E. (1981)\n- [Shape representation in parallel systems](http://www.cs.toronto.edu/~fritz/absps/shape81.pdf) - Hinton, G.E. (1981)\n- [Optimizing Neural Networks that Generate Images](http://www.cs.toronto.edu/~tijmen/tijmen_thesis.pdf) - Tijmen Tieleman's disseration\n\n### Other papers\n- [Multi-level Dense Capsule Networks](https://github.com/ssrp/Multi-level-DCNet) - S. S. R. Phaye, A. Sikka, A. Dhall and D. R. Bathula (2018)\n\n### Under review\n- [An Optimization View on Dynamic Routing Between Capsules](https://openreview.net/forum?id=HJjtFYJDf) - Wang, D., Liu, E. (2018)\n- [Spectral Capsule Networks](https://openreview.net/forum?id=ByVJlqR8G) - Bahadori, M. T. (2018)\n\n### Preprints\n- [Capsule Network Performance on Complex Data](https://arxiv.org/pdf/1712.03480.pdf) - Xi, E., Bing, S. and Jin, Y. (2017)\n- [Accurate reconstruction of image stimuli from human fMRI based on the decoding model with capsule network architecture](https://arxiv.org/ftp/arxiv/papers/1801/1801.00602.pdf) - Qiao, K., Zhang, C., Wang, L., Yan, B., Chen, J., Zeng, L. and Tong, L. (2018)\n- [CapsuleGAN: Generative Adversarial Capsule Network](https://arxiv.org/pdf/1802.06167.pdf) - Jaiswal, A., AbdAlmageed, W. and Natarajan, P. (2018)\n- [Brain Tumor Type Classification via Capsule Networks](https://arxiv.org/pdf/1802.10200.pdf) - Afshar, Parnian., Mohammadi, A., and Plataniotis, K. N. (2018)\n- [Sentiment Analysis by Capsules](https://www.researchgate.net/profile/Aixin_Sun/publication/323257127_Sentiment_Analysis_by_Capsules/links/5a8a3be5aca272017e621e81/Sentiment-Analysis-by-Capsules.pdf) - Wang, Y., Sun, A., Han, J., Liu, Y. and Zhu, X. (2018)\n- [Capsules for Object Segmentation](https://arxiv.org/pdf/1804.04241.pdf) - LaLonde, R. and Bagci, U. (2018)\n- [Sparse Unsupervised Capsules Generalize Better](https://arxiv.org/abs/1804.06094) - Rawlinson, D., Ahmed, A. and Kowadlo, G. (2018)\n- [VideoCapsuleNet: A Simplified Network for Action Detection](https://arxiv.org/abs/1805.08162) - Duarte, K., Rawat, Y.S. and Shah, M. (2018)\n- [Fast CapsNet for Lung Cancer Screening](https://arxiv.org/abs/1806.07416) - Mobiny, A. and Nguyen, H.V. (2018)\n- [Automated Classification of Apoptosis in Phase Contrast Microscopy Using Capsule Network](https://ieeexplore.ieee.org/abstract/document/8720196) - Mobiny, A., Lu H., Nguyen, H.V., Roysam, B. and Varadarajan, N. (2019) [(code)](https://github.com/amobiny/Deep_Capsule_Network)\n\n## Videos\n- [Geoffrey Hinton's talk: What is wrong with convolutional neural nets?](https://www.youtube.com/watch?v=rTawFwUvnLE) - Talk given at MIT. Brain \u0026 Cognitive Sciences - Fall Colloquium Series.\n- [Capsule Networks (CapsNets) – Tutorial](https://www.youtube.com/watch?v=pPN8d0E3900) - \"This is an amazingly good video. I wish I could explain capsules that well.\" (Geoffrey Hinton)\n- [Capsule networks: overview](https://www.youtube.com/watch?v=YqazfBLLV4U) - Overview of Hinton's capsule networks, including vector and matrix capsules.\n- [Overview of awesome videos](http://www.aisummary.com/blog/watch-three-videos-understand-capsule-networks/)\n\n## Blogs\n- Understanding Hinton’s Capsule Networks - Max Pechyonkin's series\n  - [Part 1: Intuition](https://medium.com/ai%C2%B3-theory-practice-business/understanding-hintons-capsule-networks-part-i-intuition-b4b559d1159b)\n  - [Part 2: How Capsules Work](https://medium.com/ai%C2%B3-theory-practice-business/understanding-hintons-capsule-networks-part-ii-how-capsules-work-153b6ade9f66)\n  - [Part 3: Dynamic Routing Between Capsules](https://medium.com/ai%C2%B3-theory-practice-business/understanding-hintons-capsule-networks-part-iii-dynamic-routing-between-capsules-349f6d30418)\n  - [Part 4: CapsNet Architecture](https://medium.com/@pechyonkin/part-iv-capsnet-architecture-6a64422f7dce)\n- [Uncovering the Intuition behind Capsule Networks and Inverse Graphic](https://hackernoon.com/uncovering-the-intuition-behind-capsule-networks-and-inverse-graphics-part-i-7412d121798d) - Tanay Kothari's long-form tutorial\n- [A Visual Representation of Capsule Connections in Dynamic Routing Between Capsules](https://medium.com/@mike_ross/a-visual-representation-of-capsule-network-computations-83767d79e737) - Mike Ross's diagram\n- [What is a CapsNet or Capsule Network?](https://hackernoon.com/what-is-a-capsnet-or-capsule-network-2bfbe48769cc) - Debarko De's tutorial with commented code\n- [Capsule Networks Are Shaking up AI — Here’s How to Use Them](https://hackernoon.com/capsule-networks-are-shaking-up-ai-heres-how-to-use-them-c233a0971952) - Nick Bourdakos's introduction\n- [Understanding Capsule Networks — AI’s Alluring New Architecture](https://medium.freecodecamp.org/understanding-capsule-networks-ais-alluring-new-architecture-bdb228173ddc) - Nick Bourdakos's deeper explanation about capsules with the visualization tool\n- [Capsule Networks Explained](https://kndrck.co/posts/capsule_networks_explained/) - Kendrick Tan's explanation\n- [Understanding Dynamic Routing between Capsules (Capsule Networks)](https://jhui.github.io/2017/11/03/Dynamic-Routing-Between-Capsules/): Jonathan Hui's tutorial with commented code\n- [Matrix capsules with EM routing](https://blog.acolyer.org/2017/11/14/matrix-capsules-with-em-routing/) - Adrian Colyer's post on EM routing\n- [Cuda, TensorFlow and Capsule Networks](http://jostosh.github.io/posts/capscuda.html) - Jos van de Wolfshaar's post on custom TensorFlow Ops with CUDA support for the prediction operation\n- [Capsule Networks: A Glossary](http://www.aisummary.com/blog/capsule-networks-glossary/) - Sebastian Kwiatkowski's glossary\n- [Overview of awesome articles](http://www.aisummary.com/blog/three-complementary-capsule-network-tutorials/)\n\n## Dynamic routing implementations\n\n### Official implementation\n- [Sarasra/models](https://github.com/Sarasra/models) - The official models used in [Dynamic Routing Between Capsules](https://arxiv.org/abs/1710.09829)\n\n### Chainer\n- [soskek/dynamic_routing_between_capsules](https://github.com/soskek/dynamic_routing_between_capsules)\n\n### CNTK\n- [Southworkscom/CapsNet-CNTK](https://github.com/southworkscom/CapsNet-CNTK)\n\n### Keras\n- [XifengGuo/CapsNet-Keras](https://github.com/XifengGuo/CapsNet-Keras)\n- [gusgad/capsule-GAN](https://github.com/gusgad/capsule-GAN)\n\n### Matlab\n- [yechengxi/LightCapsNet](https://github.com/yechengxi/LightCapsNet)\n\n### MXNet\n- [Soonhwan-Kwon/capsnet.mxnet](https://github.com/Soonhwan-Kwon/capsnet.mxnet)\n\n### PyTorch\n- [gram-ai/capsule-networks](https://github.com/gram-ai/capsule-networks)\n- [higgsfield/Capsule-Network-Tutorial](https://github.com/higgsfield/Capsule-Network-Tutorial)\n- [danielhavir/capsule-network](https://github.com/danielhavir/capsule-network)\n\n### R\n- [dfalbel/capsnet](https://github.com/dfalbel/capsnet)\n\n### TensorFlow\n- [naturomics/CapsNet-Tensorflow](https://github.com/naturomics/CapsNet-Tensorflow)\n- [bourdakos1/capsule-networks](https://github.com/bourdakos1/capsule-networks)\n- [JunYeopLee/capsule-networks](https://github.com/JunYeopLee/capsule-networks)\n- [jaesik817/adv_attack_capsnet](https://github.com/jaesik817/adv_attack_capsnet)\n- [thibo73800/capsnet-traffic-sign-classifier](https://github.com/thibo73800/capsnet-traffic-sign-classifier)\n\n### Torch\n- [mrkulk/Unsupervised-Capsule-Network](https://github.com/mrkulk/Unsupervised-Capsule-Network)\n\n## EM routing implementations\n\u003ch3 id=\"em-routing-pytorch\"\u003ePyTorch\u003c/h3\u003e\n\u003cul\u003e\n  \u003cli\u003e\u003ca href=\"https://github.com/shzygmyx/Matrix-Capsules-pytorch\"\u003eshzygmyx/Matrix-Capsules-pytorch\u003c/a\u003e\u003c/li\u003e\n\u003c/ul\u003e\n\n\u003ch3 id=\"em-routing-tensorflow\"\u003eTensorFlow\u003c/h3\u003e\n\u003cul\u003e\n  \u003cli\u003e\u003ca href=\"https://github.com/gyang274/capsulesEM\"\u003egyang274/capsulesEM\u003c/a\u003e\u003c/li\u003e\n  \u003cli\u003e\u003ca href=\"https://github.com/www0wwwjs1/Matrix-Capsules-EM-Tensorflow\"\u003ewww0wwwjs1/Matrix-Capsules-EM-Tensorflow\u003c/a\u003e\u003c/li\u003e\n\u003c/ul\u003e\n\n## Other resources\n- [Capsule Networks discussion](https://www.facebook.com/groups/1830303997268623) - A Facebook discussion group\n- [loretoparisi/CapsNet](https://github.com/loretoparisi/CapsNet) - Loreto Parisi's list of capsule network resources\n- [Will capsule networks replace neural networks?](https://www.quora.com/Will-capsule-networks-replace-neural-networks) - A question discussed on Quora\n- [Capsule Networks HW](https://github.com/vkantor/Data_Mining_in_Action_2018_Spring/blob/master/trends/data_2/CapsuleNetwork_HW.ipynb) - Homework assignwork in a Python Notebook format\n- [CapsNet-Tensorflow](https://gitter.im/CapsNet-Tensorflow/Lobby) - CapsNet-Tensorflow's gitter.im group\n\n## License\n[![Creative Commons License](http://i.creativecommons.org/l/by/4.0/88x31.png)](http://creativecommons.org/licenses/by/4.0/)\n\nThis work is licensed under a [Creative Commons Attribution 4.0 International License](https://creativecommons.org/licenses/by/4.0/).\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fsekwiatkowski%2Fawesome-capsule-networks","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fsekwiatkowski%2Fawesome-capsule-networks","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fsekwiatkowski%2Fawesome-capsule-networks/lists"}