https://github.com/maragudk/llamafile

Scripts to create llamafiles.
https://github.com/maragudk/llamafile

Last synced: 21 days ago
JSON representation

Scripts to create llamafiles.

• Host: GitHub
• URL: https://github.com/maragudk/llamafile
• Owner: maragudk
• License: other
• Created: 2024-09-26T09:51:46.000Z (4 months ago)
• Default Branch: main
• Last Pushed: 2024-11-06T10:16:05.000Z (3 months ago)
• Last Synced: 2025-01-03T02:17:20.626Z (22 days ago)
• Language: Roff
• Homepage: https://www.maragu.dev/blog/til-building-llamafiles-from-llama-3-2-ggufs
• Size: 21.5 KB
• Stars: 4
• Watchers: 1
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md
  • License: LICENSE-Llama-3.1

Awesome Lists containing this project

README

        
# llamafile

Scripts for creating [llamafiles](https://github.com/Mozilla-Ocho/llamafile) for [Llama LLMs](https://www.llama.com) and other models in GGUF format.

## Usage

Check the `Makefile` for what version of Llamafile and what model will be used, and adjust to your liking.

To create a llamafile:

```shell

make build/$MODEL_NAME

```

To run the Llamafile:

```shell

make start

```

Made with ✨sparkles✨ by [maragu](https://www.maragu.dev/).