An open API service indexing awesome lists of open source software.

Projects in Awesome Lists tagged with koboldcpp

A curated list of projects in awesome lists tagged with koboldcpp .

https://github.com/LostRuins/koboldcpp

Run GGUF models easily with a KoboldAI UI. One File. Zero Install.

gemma ggml gguf koboldai koboldcpp language-model llama llamacpp llm mistral

Last synced: 23 Mar 2025

https://github.com/lostruins/koboldcpp

A simple one-file way to run various GGML and GGUF models with KoboldAI's UI

koboldcpp llamacpp llm

Last synced: 20 Jan 2025

https://github.com/if-ai/comfyui-if_ai_tools

ComfyUI-IF_AI_tools is a set of custom nodes for ComfyUI that allows you to generate prompts using a local Large Language Model (LLM) via Ollama. This tool enables you to enhance your image generation workflow by leveraging the power of language models.

anthropic comfyui flux gemini graphrag groq koboldcpp llamacpp lmstudio mistral ocr ollama omost rag stable-diffusion supervision textgeneration transformers xai

Last synced: 15 May 2025

https://github.com/if-ai/ComfyUI-IF_AI_tools

ComfyUI-IF_AI_tools is a set of custom nodes for ComfyUI that allows you to generate prompts using a local Large Language Model (LLM) via Ollama. This tool enables you to enhance your image generation workflow by leveraging the power of language models.

anthropic comfyui flux gemini graphrag groq koboldcpp llamacpp lmstudio mistral ocr ollama omost rag stable-diffusion supervision textgeneration transformers xai

Last synced: 19 Dec 2024

https://github.com/lee-b/kobold_assistant

Like ChatGPT's voice conversations with an AI, but entirely offline/private/trade-secret-friendly, using local AI models such as LLama 2 and Whisper

ai-assistant ai-assistants android desktop koboldai koboldcpp linux llama llm local-ai mobile oobabooga speech-to-text text-generation-webui text-to-speech voice-assistant voice-recognition

Last synced: 17 Feb 2025

https://github.com/nexesenex/croco.cpp

Croco.Cpp is a 3rd party testground for KoboldCPP, a simple one-file way to run various GGML/GGUF models with KoboldAI's UI. (for Crocorico.Cpp, in Cuda mode mainly!)

crocoricocpp koboldcpp llamacpp

Last synced: 20 Jan 2025

https://github.com/lofcz/LlmTornado

One .NET library to consume OpenAI, Anthropic, Cohere, Google, Azure, Groq, and self-hosed APIs.

aiapi anthropic-ai chatbot cohere command-r-plus gemini gpt4o groq inference-api koboldcpp llama3 llm-inference o1 o3 ollama openai sdk sonnet sonnet3-5

Last synced: 24 Jan 2025

https://github.com/latestissue/altaeraai

A set of bash scripts to automate deployment of GGML/GGUF models [default: RWKV] with the use of KoboldCpp on Android - Termux

ai android ggml gguf koboldai koboldcpp llamacpp mamba mistral phi rwkv rwkv4 rwkvcpp termux tinydolphin tinyllama tinyvicuna vicuna

Last synced: 03 Dec 2024

https://github.com/latestissue/AltaeraAI

A set of bash scripts to automate deployment of GGML/GGUF models [default: RWKV] with the use of KoboldCpp on Android - Termux

ai android ggml gguf koboldai koboldcpp llamacpp mamba mistral phi rwkv rwkv4 rwkvcpp termux tinydolphin tinyllama tinyvicuna vicuna

Last synced: 11 Apr 2025

https://github.com/acrion/ditana-assistant

Ditana Assistant: AI-powered CLI/GUI tool for intelligent assistance, leveraging LLMs with OS interaction capabilities and context augmentation, optionally via Wolfram|Alpha

ai-assistant cli-tool context-augmentation ditana gui-application-python huggingface-datasets koboldcpp linux llms macos openai-api os-interaction windows wolfram-alpha-api

Last synced: 12 Apr 2025

https://github.com/pboardman/koboldsharp

koboldcpp REST API wrapper for C#

ai koboldcpp llama llm text-generation

Last synced: 13 May 2025

https://github.com/spongeengine/llmsharp

Unified .NET client for interacting with popular local LLM providers like KoboldCpp, Ollama, LM Studio, and Oobabooga.

ai ai-client csharp dotnet koboldcpp language-models llm llm-client lm-studio local-llm offline-ai ollama openai-compatible-api self-hosted-ai text-generation-webui

Last synced: 24 Jan 2025

https://github.com/bbc-esq/vectordb-plugin-for-koboldai

Basic vector database plugin that works wth KoboldAI. Adds documents, images, and audio files.

ctranslate2 database koboldai koboldcpp sentence-transformers tiledb transformers vector-database vision-transformer whispers2t

Last synced: 11 Jan 2025

https://github.com/ketis21/ketisbot

KetisBot is a powerful Discord AI chatbot using KoboldCpp for text generation, web browsing, and image creation. It features slash commands for easy interaction and allows admin customization.

bot chatbot discord discord-bot gguf koboldai koboldcpp llama llm

Last synced: 12 Apr 2025

https://github.com/spongeengine/lmsharp

A unified .NET client library for running LLMs (Large Language Models) locally. LocalAI.NET provides a single, consistent API for interacting with popular local LLM providers like KoboldCpp, Ollama, LM Studio, and Text Generation WebUI.

ai ai-client csharp dotnet koboldcpp language-models llm llm-client lm-studio local-llm offline-ai ollama openai-compatible-api self-hosted-ai text-generation-webui

Last synced: 02 Jan 2025

https://github.com/SpongeEngine/LMSharp

A unified .NET client library for running LLMs (Large Language Models) locally. LocalAI.NET provides a single, consistent API for interacting with popular local LLM providers like KoboldCpp, Ollama, LM Studio, and Text Generation WebUI.

ai ai-client csharp dotnet koboldcpp language-models llm llm-client lm-studio local-llm offline-ai ollama openai-compatible-api self-hosted-ai text-generation-webui

Last synced: 12 Jan 2025