An open API service indexing awesome lists of open source software.

https://github.com/lrusso/llamaloader

Llama Loader in GGUF format for Web browsers
https://github.com/lrusso/llamaloader

ai browsers gguf javascript llama models web webassembly

Last synced: 7 months ago
JSON representation

Llama Loader in GGUF format for Web browsers

Awesome Lists containing this project

README

          

# Llama Loader

Designed in JavaScript and WebAssembly. With this project you can load and run your model (in GGUF format) on your Web browser. Just select the GGUF file from your computer.

## Web:

https://lrusso.github.io/LlamaLoader/Llama.htm

## Suggested model - Llama 3.2:

* Lightweight model file (732 MB).
* The model has 1.23 billion parameters.
* Supports English, German, French, Italian, Portuguese, Hindi, Spanish, and Thai.
* It can be downloaded from [here](https://huggingface.co/bartowski/Llama-3.2-1B-Instruct-GGUF/resolve/main/Llama-3.2-1B-Instruct-Q3_K_L.gguf?download=true) and others models are available [here](https://huggingface.co/bartowski/Llama-3.2-1B-Instruct-GGUF).

## Based on the work of:

https://github.com/ngxson/wllama