An open API service indexing awesome lists of open source software.

https://github.com/aldarisbm/classifier


https://github.com/aldarisbm/classifier

Last synced: 3 months ago
JSON representation

Awesome Lists containing this project

README

        

# Classifier

- Using a local LLM to classify queries.
- Using grammar files to constrain LLM output.

Using `Meta-Llama-3-8B-Instruct-Q5_K_M.gguf` but any decent smallish param should
suffice. Prompt is setup for Llama2 chat structure.