https://github.com/dino65-dev/transformers-from-scratch

This is transformers from scratch coded with py and torch, kv cache and GQA(Grouped Query Attention) is implemented.
https://github.com/dino65-dev/transformers-from-scratch

Last synced: about 1 year ago
JSON representation

This is transformers from scratch coded with py and torch, kv cache and GQA(Grouped Query Attention) is implemented.

• Host: GitHub
• URL: https://github.com/dino65-dev/transformers-from-scratch
• Owner: dino65-dev
• License: mit
• Created: 2025-06-30T05:08:44.000Z (about 1 year ago)
• Default Branch: main
• Last Pushed: 2025-06-30T05:10:20.000Z (about 1 year ago)
• Last Synced: 2025-06-30T06:23:47.056Z (about 1 year ago)
• Language: Python
• Size: 9.77 KB
• Stars: 0
• Watchers: 0
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

README

          
# Transformers-from-scratch

This is transformers from scratch coded with py and torch, kv cache and GQA(Grouped Query Attention) is implemented.