Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

Awesome Lists | Featured Topics | Projects

Projects in Awesome Lists tagged with exllama

A curated list of projects in awesome lists tagged with exllama .

https://github.com/gotzmann/booster

Booster - open platform for serving LLM models

chatgpt exllama ggml gpt llama llama-cpp llamacpp llm ollama oobabooga openai vllm

Last synced: 27 Sep 2024

https://github.com/c0sogi/llama-api

An OpenAI-like LLaMA inference API

api exllama fastapi llama llamacpp

Last synced: 27 Sep 2024

https://github.com/Zuellni/ComfyUI-ExLlama-Nodes

ExLlama nodes for ComfyUI.

comfyui exllama stable-diffusion

Last synced: 01 Aug 2024

https://github.com/shinomakoi/magi_llm_gui

A Qt GUI for large language models

exllama gui llama llamacpp llm python qt

Last synced: 27 Sep 2024

https://github.com/shinomakoi/AI-Messenger

A QT GUI for large language models

exllama llama llamacpp qt6

Last synced: 04 Aug 2024

https://github.com/nickpotafiy/illama

A fast, lightweight, parallel inference server for Llama LLMs.

exllama exllamav2 flash-attention-2 inference llama llama2 llama3 llm-inference paged-attention server

Last synced: 27 Sep 2024