https://github.com/lucidrains/equiformer-diffusion
Implementation of Denoising Diffusion for protein design, but using the new Equiformer (successor to SE3 Transformers) with some additional improvements
https://github.com/lucidrains/equiformer-diffusion
artificial-intelligence attention-mechanisms deep-learning denoising-diffusion equivariant-networks protein-design
Last synced: 4 months ago
JSON representation
Implementation of Denoising Diffusion for protein design, but using the new Equiformer (successor to SE3 Transformers) with some additional improvements
- Host: GitHub
- URL: https://github.com/lucidrains/equiformer-diffusion
- Owner: lucidrains
- License: mit
- Created: 2022-12-27T19:08:57.000Z (over 3 years ago)
- Default Branch: main
- Last Pushed: 2022-12-27T22:58:52.000Z (over 3 years ago)
- Last Synced: 2025-06-08T20:44:32.795Z (12 months ago)
- Topics: artificial-intelligence, attention-mechanisms, deep-learning, denoising-diffusion, equivariant-networks, protein-design
- Homepage:
- Size: 2.93 KB
- Stars: 57
- Watchers: 12
- Forks: 4
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
## Equiformer Diffusion (wip)
Implementation of denoising diffusion for protein design in the same vein as RFDiffusion, with the pretraining and newly discovered self-conditioning technique, but using the new Equiformer with some improvements (negative of euclidean distance for attention in higher types).
## Citations
```bibtex
@article{Liao2022EquiformerEG,
title = {Equiformer: Equivariant Graph Attention Transformer for 3D Atomistic Graphs},
author = {Yi Liao and Tess E. Smidt},
journal = {ArXiv},
year = {2022},
volume = {abs/2206.11990}
}
```
```bibtex
@article{Watson2022,
author = {Watson, Joseph L. and Juergens, David and Bennett, Nathaniel R. and Trippe, Brian L. and Yim, Jason and Eisenach, Helen E. and Ahern, Woody and Borst, Andrew J. and Ragotte, Robert J. and Milles, Lukas F. and Wicky, Basile I. M. and Hanikel, Nikita and Pellock, Samuel J. and Courbet, Alexis and Sheffler, William and Wang, Jue and Venkatesh, Preetham and Sappington, Isaac and Torres, Susana Vazquez and Lauko, Anna and De Bortoli, Valentin and Mathieu, Emile and Barzilay, Regina and Jaakkola, Tommi S. and DiMaio, Frank and Baek, Minkyung and Baker, David},
title = {Broadly applicable and accurate protein design by integrating structure prediction networks and diffusion generative models},
year = {2022},
doi = {10.1101/2022.12.09.519842},
publisher = {Cold Spring Harbor Laboratory},
url = {https://www.biorxiv.org/content/early/2022/12/10/2022.12.09.519842},
eprint = {https://www.biorxiv.org/content/early/2022/12/10/2022.12.09.519842.full.pdf},
journal = {bioRxiv}
}
```