Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

Awesome Lists | Featured Topics | Projects

https://github.com/cybershadow/company-llama


https://github.com/cybershadow/company-llama

Last synced: 1 day ago
JSON representation

Awesome Lists containing this project

README

        

company-llama
========

Glue between [company-mode](https://github.com/company-mode/company-mode) and [llama.cpp](https://github.com/ggerganov/llama.cpp).

Quick setup
-----------

1. Download a LLM `.llamafile`
- For example, [this one](https://huggingface.co/jartine/wizardcoder-13b-python/resolve/main/wizardcoder-python-13b.llamafile?download=true)
- More [here](https://github.com/jart/emacs-copilot?tab=readme-ov-file#llm-download-links)

2. Run the `.llamafile` on your computer

3. Load this package

4. ```elisp
(add-to-list 'company-backends 'company-llama-backend)
```

Recommended configuration
-------------------------

```elisp
;; Keep offering completions after selecting one
(add-to-list 'company-begin-commands 'company-complete)
(add-to-list 'company-begin-commands 'company-complete-selection))

;; To show probabilities:
(setq company-tooltip-align-annotations t)
(setq company-tooltip-annotation-padding 3)
(setq company-llama-show-probabilities t)
```