Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/lucidrains/coordinate-descent-attention
Implementation of an Attention layer where each head can attend to more than just one token, using coordinate descent to pick topk
https://github.com/lucidrains/coordinate-descent-attention
artificial-intelligence attention-mechanisms deep-learning
Last synced: 2 months ago
JSON representation
Implementation of an Attention layer where each head can attend to more than just one token, using coordinate descent to pick topk
- Host: GitHub
- URL: https://github.com/lucidrains/coordinate-descent-attention
- Owner: lucidrains
- License: mit
- Created: 2023-03-31T14:50:46.000Z (over 1 year ago)
- Default Branch: main
- Last Pushed: 2023-07-16T18:54:08.000Z (over 1 year ago)
- Last Synced: 2024-10-15T00:16:32.989Z (2 months ago)
- Topics: artificial-intelligence, attention-mechanisms, deep-learning
- Language: Python
- Homepage:
- Size: 34.1 MB
- Stars: 46
- Watchers: 3
- Forks: 1
- Open Issues: 1