https://github.com/LostRuins/koboldcpp

A simple one-file way to run various GGML and GGUF models with KoboldAI's UI
https://github.com/LostRuins/koboldcpp

koboldcpp llamacpp llm

Last synced: about 2 months ago
JSON representation

A simple one-file way to run various GGML and GGUF models with KoboldAI's UI

• Host: GitHub
• URL: https://github.com/LostRuins/koboldcpp
• Owner: LostRuins
• License: agpl-3.0
• Fork: true (ggerganov/llama.cpp)
• Created: 2023-03-16T02:07:02.000Z (over 1 year ago)
• Default Branch: concedo
• Last Pushed: 2024-04-14T03:14:15.000Z (5 months ago)
• Last Synced: 2024-04-14T06:52:36.937Z (5 months ago)
• Topics: koboldcpp, llamacpp, llm
• Language: C++
• Homepage: https://github.com/lostruins/koboldcpp
• Size: 79 MB
• Stars: 3,657
• Watchers: 56
• Forks: 266
• Open Issues: 169
• Metadata Files:
  • Readme: README.md
  • License: LICENSE.md

Awesome Lists containing this project

• awesome-local-llms - koboldcpp - file way to run various GGML and GGUF models with KoboldAI's UI | 4,187 | 304 | 216 | 470 | 79 | GNU Affero General Public License v3.0 | 0 days, 11 hrs, 21 mins | (Open-Source Local LLM Projects)
• awesome-local-ai - koboldcpp - A simple one-file way to run various GGML models with KoboldAI's UI | GGML | Both | ✅ | C/C++ | Text-Gen | (Inference Engine)
• Self-Hosting-Guide - KoboldCpp - to-use AI text-generation software for GGML models. It's a single self contained distributable from Concedo, that builds off llama.cpp, and adds a versatile Kobold API endpoint, additional format support, backward compatibility, as well as a fancy UI with persistent stories, editing tools, save formats, memory, world info, author's note, characters, and scenarios. (Tools for Self-Hosting / LLMs)
• project-awesome - LostRuins/koboldcpp - Run GGUF models easily with a KoboldAI UI. One File. Zero Install. (C++)
• awesome-LLM-resourses - koboldcpp - file way to run various GGML and GGUF models with KoboldAI's UI. (推理 Inference)