https://github.com/hesamsheikh/llm-mechanics

Coding an LLM and its building blocks from scratch.
https://github.com/hesamsheikh/llm-mechanics

gpt large-language-model llm natural-language-processing python pytorch

Last synced: 16 days ago
JSON representation

Coding an LLM and its building blocks from scratch.

• Host: GitHub
• URL: https://github.com/hesamsheikh/llm-mechanics
• Owner: hesamsheikh
• Created: 2024-12-19T11:20:08.000Z (18 days ago)
• Default Branch: main
• Last Pushed: 2024-12-19T11:20:37.000Z (18 days ago)
• Last Synced: 2024-12-19T12:27:43.481Z (18 days ago)
• Topics: gpt, large-language-model, llm, natural-language-processing, python, pytorch
• Homepage: https://x.com/Hesamation
• Size: 986 KB
• Stars: 0
• Watchers: 1
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

README

        
# LLM Mechanics (implementing from scratch)

![header](assets/header.png)

This repository is my personal playground to implement large language models (LLM) and their building blocks from scratch using PyTorch. If you like to know the theory behind how LLMs operate, check out my [Advanced ML Learning Journal](https://github.com/hesamsheikh/ml-retreat).