Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/tech-srl/layer_norm_expressivity_role
Code for the paper "On the Expressivity Role of LayerNorm in Transformers' Attention" (Findings of ACL'2023)
https://github.com/tech-srl/layer_norm_expressivity_role
attention layer-normalization layernorm transformers
Last synced: 12 days ago
JSON representation
Code for the paper "On the Expressivity Role of LayerNorm in Transformers' Attention" (Findings of ACL'2023)
- Host: GitHub
- URL: https://github.com/tech-srl/layer_norm_expressivity_role
- Owner: tech-srl
- Created: 2023-05-03T11:37:03.000Z (over 1 year ago)
- Default Branch: main
- Last Pushed: 2023-07-13T14:16:25.000Z (over 1 year ago)
- Last Synced: 2024-03-26T13:56:59.109Z (8 months ago)
- Topics: attention, layer-normalization, layernorm, transformers
- Language: Python
- Homepage:
- Size: 743 KB
- Stars: 35
- Watchers: 6
- Forks: 3
- Open Issues: 0