Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/mpociot/llamero
A GUI application to easily try out Facebook's LLaMA models.
https://github.com/mpociot/llamero
ai llama llm
Last synced: 3 months ago
JSON representation
A GUI application to easily try out Facebook's LLaMA models.
- Host: GitHub
- URL: https://github.com/mpociot/llamero
- Owner: mpociot
- Created: 2023-03-16T21:55:17.000Z (almost 2 years ago)
- Default Branch: main
- Last Pushed: 2023-03-16T23:38:06.000Z (almost 2 years ago)
- Last Synced: 2024-10-18T21:18:16.354Z (3 months ago)
- Topics: ai, llama, llm
- Language: JavaScript
- Homepage:
- Size: 2.31 MB
- Stars: 179
- Watchers: 5
- Forks: 8
- Open Issues: 5
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
# Llamero
A GUI application to easily try out Facebook's LLaMA models.
![](./build/icon.png)
## [Download the latest release](https://github.com/mpociot/llamero/releases)
## Usage
This is a cross-platform GUI application that makes it super easy to download, install and run any of the [Facebook LLaMA](https://github.com/facebookresearch/llama) models.
It uses the models in combination with [llama.cpp](https://github.com/ggerganov/llama.cpp), which uses 4-bit quantization and allows you to run these models on your local computer.
In the UI you can choose which model(s) you want to download and install.
![](./docs/install.png)
After installing one or multiple models, you will be provided with a "Playground" that allows you to locally infer the models. You can also configure parameters such as the temperature and maximum token length.
![](./docs/demo.gif)
## Limitations
Facebook's LLaMA model is not finetuned for question answering, but instead tries to continue writing existing prompts. Take this into account when interacting with these models.
Additionally, even though the app is cross-platform I have personally only tested the macOS version of it.
## Credits
This project is inspired by [Dalai](https://github.com/cocktailpeanut/dalai) and uses a modified version of their query and installation script.
## Sponsors
### [What The Diff](https://whatthediff.ai/?ref=gh-llamero) - your AI powered code review assistant
[![What The Diff](https://whatthediff.ai/images/card.png)](https://whatthediff.ai/?ref=gh-llamero)