https://github.com/peri044/concepts

Understanding attention in LLMs
https://github.com/peri044/concepts

Last synced: 5 days ago
JSON representation

Understanding attention in LLMs

• Host: GitHub
• URL: https://github.com/peri044/concepts
• Owner: peri044
• Created: 2024-02-17T23:47:17.000Z (over 2 years ago)
• Default Branch: main
• Last Pushed: 2025-01-02T03:14:07.000Z (over 1 year ago)
• Last Synced: 2025-10-10T21:41:45.620Z (10 months ago)
• Language: Python
• Size: 96.7 KB
• Stars: 1
• Watchers: 1
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

README

          
# Concepts

This repo is for self-learning deep learning concepts from latest research.

You can navigate to 

* `attention/` - To understand attention concepts in detail

* `layers/` - Standard DL layer implementations