Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

https://github.com/mpociot/llamero

A GUI application to easily try out Facebook's LLaMA models.
https://github.com/mpociot/llamero

ai llama llm

Last synced: about 1 month ago
JSON representation

A GUI application to easily try out Facebook's LLaMA models.

Host: GitHub
URL: https://github.com/mpociot/llamero
Owner: mpociot
Created: 2023-03-16T21:55:17.000Z (over 1 year ago)
Default Branch: main
Last Pushed: 2023-03-16T23:38:06.000Z (over 1 year ago)
Last Synced: 2024-02-23T09:37:25.084Z (5 months ago)
Topics: ai, llama, llm
Language: JavaScript
Homepage:
Size: 2.31 MB
Stars: 176
Watchers: 5
Forks: 8
Open Issues: 5
Metadata Files:
- Readme: README.md

Lists

awesome-list - mpociot/llamero - A GUI application to easily try out Facebook's LLaMA models. (JavaScript)

README

        # Llamero

A GUI application to easily try out Facebook's LLaMA models.

![](./build/icon.png)

## [Download the latest release](https://github.com/mpociot/llamero/releases)

## Usage

This is a cross-platform GUI application that makes it super easy to download, install and run any of the [Facebook LLaMA](https://github.com/facebookresearch/llama) models.

It uses the models in combination with [llama.cpp](https://github.com/ggerganov/llama.cpp), which uses 4-bit quantization and allows you to run these models on your local computer.

In the UI you can choose which model(s) you want to download and install.

![](./docs/install.png)

After installing one or multiple models, you will be provided with a "Playground" that allows you to locally infer the models. You can also configure parameters such as the temperature and maximum token length.

![](./docs/demo.gif)

## Limitations

Facebook's LLaMA model is not finetuned for question answering, but instead tries to continue writing existing prompts. Take this into account when interacting with these models.

Additionally, even though the app is cross-platform I have personally only tested the macOS version of it.

## Credits

This project is inspired by [Dalai](https://github.com/cocktailpeanut/dalai) and uses a modified version of their query and installation script.

## Sponsors

### [What The Diff](https://whatthediff.ai/?ref=gh-llamero) - your AI powered code review assistant

[![What The Diff](https://whatthediff.ai/images/card.png)](https://whatthediff.ai/?ref=gh-llamero)