https://github.com/kyegomez/differentialtransformer

An open source community implementation of the model from "DIFFERENTIAL TRANSFORMER" paper by Microsoft.
https://github.com/kyegomez/differentialtransformer

ai attention ml rnns ssm transformers transformers-library transformers-models

Last synced: about 2 months ago
JSON representation

An open source community implementation of the model from "DIFFERENTIAL TRANSFORMER" paper by Microsoft.

• Host: GitHub
• URL: https://github.com/kyegomez/differentialtransformer
• Owner: kyegomez
• License: mit
• Created: 2024-10-12T20:16:59.000Z (3 months ago)
• Default Branch: main
• Last Pushed: 2024-10-12T21:07:38.000Z (3 months ago)
• Last Synced: 2024-10-12T23:04:56.609Z (3 months ago)
• Topics: ai, attention, ml, rnns, ssm, transformers, transformers-library, transformers-models
• Language: Python
• Homepage: https://discord.com/servers/agora-999382051935506503
• Size: 2.17 MB
• Stars: 2
• Watchers: 2
• Forks: 0
• Open Issues: 4

Awesome Lists containing this project