https://github.com/adamcohenhillel/llms-cheatsheet

Instructions on how to run LLMs on Raspberry PI
https://github.com/adamcohenhillel/llms-cheatsheet

Last synced: 6 days ago
JSON representation

Instructions on how to run LLMs on Raspberry PI

• Host: GitHub
• URL: https://github.com/adamcohenhillel/llms-cheatsheet
• Owner: adamcohenhillel
• Created: 2024-03-02T22:11:02.000Z (10 months ago)
• Default Branch: main
• Last Pushed: 2024-07-29T04:29:19.000Z (5 months ago)
• Last Synced: 2024-12-24T01:34:49.266Z (10 days ago)
• Language: Jupyter Notebook
• Size: 1.33 MB
• Stars: 196
• Watchers: 3
• Forks: 15
• Open Issues: 1
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

README

        
# LLMs-Cheatsheet

This repo aims to be a comprehensive resource for those interested in Large Language Models (LLMs), with a specific focus on running and fine-tuning small models on personal hardware. Our goal is to empower users to work with powerful, locally-run LLMs that are tailored to their needs, ensuring data privacy and maintaining digital sovereignty. By avoiding reliance on third-party providers, you retain full control over your models and information, free from the risk of sudden access restrictions or policy changes.

## Resources:

- [Running LLMs on a Raspberry Pi](./run-llm-on-raspberry-pi.md)

- [Fine-tune small LLama3 8B model with output from Big LLM Llama 3 405B](./fine-tune-llama3-8b-with-llama3-405b-data.ipynb)

## Contributing

We welcome contributions! If you have resources, guides, or insights to share, please do!

---

This repository is a work in progress. Stay tuned for updates and feel free to star or watch the project for notifications on new content!