Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

Awesome Lists | Featured Topics | Projects

https://github.com/ivanfioravanti/autogram

Grammar checker with a keyboard shortcut for Ollama and Apple MLX with Automator on macOS.
https://github.com/ivanfioravanti/autogram

Last synced: about 2 months ago
JSON representation

Grammar checker with a keyboard shortcut for Ollama and Apple MLX with Automator on macOS.

Awesome Lists containing this project

README

        

# Autogram

Grammar checker for Apple Silicon devices powered by Automator with Ollama or Apple MLX as backend.
Open, free, easy and fast!
Play, copy, fork, experiment, have fun!

## Ollama Backend

### Installation

Install [ollama](https://ollama.ai/)

Run in the background to download a Mistral Instruct 0.2 based model:

```bash
ollama run ifioravanti/mistral-grammar-checker
```
Note: If you have base model installed in Ollama, only a very small additional layer will be downloaded.
You can easily create new custom models using ModelFiles [following instructions on Ollama](https://github.com/ollama/ollama/blob/main/docs/modelfile.md)

Install the workflow. This essentially copies the workflow to `~/Library/Services/autogram-ollama.workflow`.

Go to System Preferences -> Keyboard -> Shortcuts -> Services -> General -> autogram, and set the shortcut, in my case I set it to `⌃⌥⌘G`.

### Usage

In any OSX application, select some text, and press the shortcut you set. The selected text will be replaced with the generated text from the model.

## Apple MLX Backend

Install `autogram-mlx.workflow` the same way as above, no need to edit and add token, however you may edit `MODEL="mistral"`, in case you want to use a different model

This worfklow is based on mlx-community/Mistral-7B-Instruct-v0.2-4bit-mlx model with prompt defined directly in the workflow.
You can edit it directly from Automator.

### Credits
Original idea [LLM-Automator](https://github.com/radames/LLM-automator) [Radamés Ajna](https://github.com/radames)