https://github.com/uralstech/vid-tinyllama
Run TinyLLaMA on your PC.
https://github.com/uralstech/vid-tinyllama
Last synced: 12 months ago
JSON representation
Run TinyLLaMA on your PC.
- Host: GitHub
- URL: https://github.com/uralstech/vid-tinyllama
- Owner: Uralstech
- License: apache-2.0
- Created: 2023-09-18T18:22:47.000Z (almost 3 years ago)
- Default Branch: main
- Last Pushed: 2023-09-19T16:54:47.000Z (almost 3 years ago)
- Last Synced: 2025-03-17T08:21:26.699Z (over 1 year ago)
- Language: Python
- Homepage:
- Size: 6.84 KB
- Stars: 4
- Watchers: 1
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
# Vid TinyLLaMA
Run TinyLLaMA on your PC.
## TinyLLaMA
Go to ****** to download TinyLLaMA or check out ****** for more info.
## Notes
* You can reduce the max tokens and length of the answer (`src/main.py`, line **25** and **26**) to make the model run faster.
## Docker
If you do not want to use docker to run the model, you can just run:
#### Bash
```bash
pip3 install -r requirements.txt
python3 src/main.py
```
#### CMD (Windows)
```cmd
pip install -r requirements.txt
python src/main.py
```
## License
The license and notice for the code in the repository can be found here: (https://github.com/Uralstech/Vid-TinyLLaMA/blob/main/LICENSE) and here: (https://github.com/Uralstech/Vid-TinyLLaMA/blob/main/NOTICE) respectively.