https://github.com/mk2112/nn-zero-to-hero-notes

Jupyter Notebook notes on Andrej Karpathy's videos and the tutorial series, "Neural Networks: Zero to Hero."
https://github.com/mk2112/nn-zero-to-hero-notes

deep-learning gpt neural-networks nlp nn-zero-to-hero pytorch

Last synced: about 1 month ago
JSON representation

Jupyter Notebook notes on Andrej Karpathy's videos and the tutorial series, "Neural Networks: Zero to Hero."

• Host: GitHub
• URL: https://github.com/mk2112/nn-zero-to-hero-notes
• Owner: MK2112
• License: mit
• Created: 2023-06-02T16:36:25.000Z (almost 2 years ago)
• Default Branch: main
• Last Pushed: 2025-03-25T14:23:57.000Z (about 2 months ago)
• Last Synced: 2025-03-29T06:05:39.474Z (about 2 months ago)
• Topics: deep-learning, gpt, neural-networks, nlp, nn-zero-to-hero, pytorch
• Language: Jupyter Notebook
• Homepage:
• Size: 30.6 MB
• Stars: 156
• Watchers: 4
• Forks: 22
• Open Issues: 0
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

README

        
# Notes - Neural Networks: Zero to Hero

[Andrej's GitHub Repository](https://github.com/karpathy/nn-zero-to-hero)


[Andrej's YouTube](https://www.youtube.com/@AndrejKarpathy)


[Eureka Labs Discord](https://discord.com/invite/3zy8kqD9Cp)

Jupyter Notebooks and Markdown files with detailed notes on Andrej Karpathy's tutorial series "Neural Networks: Zero to Hero", his talks and general audience videos. The notes aim to provide an additional overview and documentation of the concepts and techniques covered in the videos.

## Zero to Hero Tutorial Series

  

    Video

    Notes

  

  

    

    N001 - Building Micrograd

  

  

    

    N002 - Makemore 1

  

  

    

    N003 - Makemore 2 - MLP

  

  

    

    N004 - Makemore 3 - Activations, BatchNorm

  

  

    

    N005 - Makemore 4 - Becoming a Backprop Ninja

  

  

    

    N006 - Makemore 5 - WaveNet

  

  

    

    N007 - GPT From Scratch

  

  

    

    N008 - GPT Tokenizer

  

  

    

    N009 - Reproducing GPT-2

  

## General

  

    Video

    Notes

  

  

    

    G001 - Deep Dive into LLMs like ChatGPT

  

  

    

    G002 - How I Use LLMs

  

## Talks

  

    Video

    Notes

  

  

    

    T001 - State of GPT

  

  

    

    T002 - Intro to LLMs - Director's Cut

  

## Getting Started

1. Clone this repository to your local machine using the following command:

```bash

git clone https://github.com/MK2112/nn-zero-to-hero-notes.git

```

2. Navigate to the repository, make sure to run `pip install -r requirements.txt`.

3. Launch Jupyter Notebook by running the command:

```bash

jupyter notebook

```

4. Within Jupyter, navigate to the repository and open the desired notebook.

## Contributions

Contributions are welcome and encouraged. If you find any errors, have suggestions for improvements, or want to add to the materials, please submit a pull request.

## Acknowledgments

Thank you Andrej Karpathy for creating and sharing the "Neural Networks: Zero to Hero" tutorial series. Find more of Andrej's work on his [GitHub](https://github.com/karpathy) and [𝕏/Twitter](https://x.com/karpathy).

## License

This repository is licensed under the MIT License. Please attribute the original content to Andrej Karpathy and provide links to the tutorial series, the videos and this repo.