Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/vaibhavs10/gpu-poor-llm-notebooks
https://github.com/vaibhavs10/gpu-poor-llm-notebooks
Last synced: 17 days ago
JSON representation
- Host: GitHub
- URL: https://github.com/vaibhavs10/gpu-poor-llm-notebooks
- Owner: Vaibhavs10
- Created: 2024-07-19T17:05:17.000Z (6 months ago)
- Default Branch: main
- Last Pushed: 2024-07-31T15:23:22.000Z (5 months ago)
- Last Synced: 2024-08-01T19:39:06.807Z (5 months ago)
- Language: Jupyter Notebook
- Size: 74.2 KB
- Stars: 11
- Watchers: 3
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
# GPU Poor LLM Notebooks ⚡
A good old T4 is more potent than you think!
This repository is a collection of notebooks to run <15B param LLMs using Transformers and Accelerate in `bfloat16`/ `float16` on the mighty T4.
I'll update this with each new LLM release. Feel free to open an issue with feature requests.
LLMs covered so far:
1. Mathstral 7B
2. Gemma 2 9B
3. CodeGemma
4. RecurrentGemma
5. Mistral Nemo 12B