https://github.com/johnmachado11/build-a-large-language-model-from-scratch
Building a GPT-like LLM from scratch with PyTorch.
https://github.com/johnmachado11/build-a-large-language-model-from-scratch
Last synced: 6 months ago
JSON representation
Building a GPT-like LLM from scratch with PyTorch.
- Host: GitHub
- URL: https://github.com/johnmachado11/build-a-large-language-model-from-scratch
- Owner: JohnMachado11
- Created: 2024-10-01T19:12:57.000Z (about 1 year ago)
- Default Branch: main
- Last Pushed: 2024-12-20T04:31:15.000Z (10 months ago)
- Last Synced: 2024-12-20T04:33:38.069Z (10 months ago)
- Language: Python
- Homepage: https://www.manning.com/books/build-a-large-language-model-from-scratch
- Size: 30.7 MB
- Stars: 11
- Watchers: 2
- Forks: 5
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
# Build-a-Large-Language-Model-from-Scratch
https://www.manning.com/books/build-a-large-language-model-from-scratch
"In Build a Large Language Model (from Scratch), you’ll discover how LLMs work from the inside out. In this book, I’ll guide you step by step through creating your own LLM, explaining each stage with clear text, diagrams, and examples.
The method described in this book for training and developing your own small-but-functional model for educational purposes mirrors the approach used in creating large-scale foundational models such as those behind ChatGPT. The book uses Python and PyTorch for all its coding examples."
By Sebastian Raschka
Book Repo:
https://github.com/rasbt/LLMs-from-scratch/