Projects in Awesome Lists tagged with ggml
A curated list of projects in awesome lists tagged with ggml .
https://github.com/leejet/stable-diffusion.cpp
Diffusion model(SD,Flux,Wan,Qwen Image,Z-Image,...) inference in pure C/C++
ai cplusplus diffusion flux flux-dev ggml image-generation image2image img2img latent-diffusion ltx-video qwen-image stable-diffusion text2image txt2img videogeneration wan z-image z-image-turbo
Last synced: 09 Nov 2026
https://github.com/0xshug0/audio.cpp
An all-in-one, pure C++ inference engine for audio models, powered by ggml. Supports TTS, STT, VAD, voice conversion, music generation, and more, with highly optimized performance. No Python dependency.
ai amd-gpu apple-silicon asr audio cpp edge-ai ggml minimax-music3 music-generation speech-analysis speech-to-speech speech-to-text text-to-speech tts voice-ai voice-cloning voice-conversion vulkan yue2
Last synced: 09 Nov 2026
https://github.com/handy-computer/transcribe.cpp
ggml speech-to-text inference for 16+ model families
Last synced: 19 Oct 2026
https://github.com/rwkv/rwkv.cpp
INT4/INT5/INT8 and FP16 inference on CPU for RWKV language model
deep-learning ggml language-model llm machine-learning quantization rwkv
Last synced: 19 Oct 2026
https://github.com/RWKV/rwkv.cpp
INT4/INT5/INT8 and FP16 inference on CPU for RWKV language model
deep-learning ggml language-model llm machine-learning quantization rwkv
Last synced: 15 Apr 2025
https://github.com/rahulschand/gpu_poor
Calculate token/s & GPU memory requirement for any LLM. Supports llama.cpp/ggml/bnb/QLoRA quantization
ggml gpu huggingface language-model llama llama2 llamacpp llm pytorch quantization
Last synced: 19 Oct 2026
https://github.com/timoncool/yue2-studio
Local AI song generator with an editable score — YuE2 on your GPU: full songs with vocals, sheet music, covers, exact replay. Native Windows app, no Python, installer with auto-update.
abc-notation ai-music covers cuda ggml local-ai music-generation offline rust sheet-music tauri text-to-music vocals windows yue2
Last synced: 29 Oct 2026
https://github.com/RahulSChand/gpu_poor
Calculate token/s & GPU memory requirement for any LLM. Supports llama.cpp/ggml/bnb/QLoRA quantization
ggml gpu huggingface language-model llama llama2 llamacpp llm pytorch quantization
Last synced: 17 Apr 2025
https://github.com/CrispStrobe/CrispASR
C++ ggml runtime hub for multilingual ASR and TTS models: Cohere Transcribe, Parakeet TDT, Voxtral, Canary 1B v2, etc, plus universal forced alignment, and more
cohere-transcribe cohere-transcribe-03-2026 ggml parakeet speech-recognition speech-to-text stt transcription voxtral whisper-cpp
Last synced: 08 Oct 2026
https://github.com/azkadev/whisper
Whisper Dart is a cross platform library for dart and flutter that allows converting audio to text / speech to text / inference from Open AI models
ai android dart flutter ggml indonesia ios linux macos openai speech speech-recognition speech-synthesis speech-to-text transcribe transformer whisper whisper-dart whisper-flutter windows
Last synced: 15 May 2025
https://github.com/abacaj/mpt-30b-inference
Run inference on MPT-30B using CPU
Last synced: 05 Apr 2025
https://github.com/Maknee/minigpt4.cpp
Port of MiniGPT4 in C++ (4bit, 5bit, 6bit, 8bit, 16bit CPU inference with GGML)
c cpp deep-learning ggml machine-learning minigpt4 multimodal quantization
Last synced: 15 Apr 2025
https://github.com/the-crypt-keeper/can-ai-code
Self-evaluating interview for AI coders
ai ggml humaneval langchain llama-cpp llm transformers
Last synced: 05 Apr 2025
https://github.com/shm007g/LLaMA-Cult-and-More
Large Language Models for All, 🦙 Cult and More, Stay in touch !
alpaca chatgpt deepspeed ggml gpt gpt4 gptq llama llm loralib pytorch tensorflow transformers vicuna
Last synced: 17 Mar 2025
https://github.com/azkadev/bark
WIP Library Text To Speech From Suno AI's Bark in C/C++ for fast inference
ai bark clone dart deep-learning fake ggml machine-learning neural-network text-to-speech tts voice
Last synced: 05 Apr 2025
https://github.com/crispstrobe/crispasr
C++ ggml runtime hub for multilingual ASR and TTS models: Cohere Transcribe, Parakeet TDT, Voxtral, Canary 1B v2, etc, plus universal forced alignment, and more
cohere-transcribe cohere-transcribe-03-2026 ggml parakeet speech-recognition speech-to-text stt transcription voxtral whisper-cpp
Last synced: 04 Jul 2026
https://github.com/azkadev/general_ai
GENERAL Ai Library For DART & Flutter
ai artificial-intelligence azkadev dart deep-learning flutter ggml library machine-learning ml piper stable-diffusion whisper
Last synced: 06 Apr 2025
https://github.com/staghado/vit.cpp
Inference Vision Transformer (ViT) in plain C/C++ with ggml
ai c computer-vision cpp cpu edge-computing ggml image-classification llamacpp vision-transformer whisper-cpp
Last synced: 03 Oct 2025
https://github.com/shubham0204/smolchat-android
Running any GGUF SLMs/LLMs locally, on-device in Android
android cpp ggml kotlin llamacpp small-language-models
Last synced: 13 Apr 2025
https://github.com/mayooear/private-chatbot-mpt30b-langchain
Chat with your data privately using MPT-30b
Last synced: 12 May 2025
https://github.com/balisujohn/tortoise.cpp
A ggml (C++) re-implementation of tortoise-tts
ggml local speech text text-to-speech to tortoise-tts tts
Last synced: 07 Apr 2025
https://github.com/abacaj/replit-3b-inference
Run inference on replit-3B code instruct model using CPU
ctransformers ggml replit replit-code
Last synced: 07 Aug 2026
https://github.com/chenhunghan/ialacol
🪶 Lightweight OpenAI drop-in replacement for Kubernetes
ai cloudnative cuda ggml gptq gpu helm kubernetes langchain llamacpp llm llm-inference llm-serving openai python
Last synced: 30 Sep 2025
https://github.com/zatevakhin/obsidian-local-llm
Obsidian Local LLM is a plugin for Obsidian that provides access to a powerful neural network, allowing users to generate text in a wide range of styles and formats using a local LLM.
ggml llama llamacpp obsidian-md obsidian-plugin
Last synced: 17 Mar 2026
https://github.com/sevagh/demucs.cpp
C++17 port of Demucs v3 (hybrid) and v4 (hybrid transformer) models with ggml and Eigen3
blas demixing demucs eigen3 ggml guitar music-source-separation piano pytorch
Last synced: 05 Apr 2025
https://github.com/nrl-ai/customchar
Your customized AI assistant - Personal assistants on any hardware! With llama.cpp, whisper.cpp, ggml, LLaMA-v2.
cpp ggml llama llama-cpp llama-v2 llm stt tts whisper-cpp
Last synced: 25 Aug 2025
https://github.com/guoriyue/langcommand
LangCommand is a local inference command-line tool that transforms natural language descriptions into shell commands.
command command-line command-line-tool ggml llama llm shell terminal
Last synced: 04 Apr 2025
https://github.com/guoriyue/llmc
LangCommand is a local inference command-line tool that transforms natural language descriptions into shell commands.
command command-line command-line-tool ggml llama llm shell terminal
Last synced: 18 Feb 2026
https://github.com/kigner/audio.cpp-webui
audio.cpp with a full-task WebUI - pure C++ audio-model inference engine powered by ggml. TTS, ASR/STT, VAD, voice conversion, speaker diarization, music generation. No Python dependency.
asr audio cpp ggml inference-engine music-generation speaker-diarization speech-recognition speech-synthesis speech-to-text text-to-speech tts vad voice-conversion webui
Last synced: 25 Aug 2026
https://github.com/mobile-artificial-intelligence/llama_sdk
lcpp is a dart implementation of llama.cpp used by the mobile artificial intelligence distribution (maid)
facebook flutter-ai gemma ggml gguf llama llama2 llamacpp llm llm-inference local-ai meta mistral mixtral mobile-ai
Last synced: 11 Oct 2025
https://github.com/ferranpons/llamatik
True on-device AI for Kotlin Multiplatform (Android, iOS, Desktop, JVM, WASM). LLM, Speech-to-Text and Image Generation — powered by llama.cpp, whisper.cpp and stable-diffusion.cpp.
ai android desktop edge-ai ggml inference ios kmp kmp-library kotlin ktor llama llama-cpp llm mobile-ai multiplatform offline-ai on-device-ai privacy rag
Last synced: 17 Apr 2026
https://github.com/mgonzs13/whisper_ros
Speech-to-Text based on SileroVAD + whisper.cpp (GGML Whisper) for ROS 2
asr automatic-speech-recognition ggml ros2 speech-recognition speech-to-text vad voice-activity-detection whisper whisper-cpp
Last synced: 30 Aug 2025
https://github.com/Mobile-Artificial-Intelligence/llama_sdk
lcpp is a dart implementation of llama.cpp used by the mobile artificial intelligence distribution (maid)
facebook flutter-ai gemma ggml gguf llama llama2 llamacpp llm llm-inference local-ai meta mistral mixtral mobile-ai
Last synced: 23 Apr 2025
https://github.com/CrispStrobe/CrispEmbed
Lightweight text and scans processing: embedding, document processing, OCR, OMR, etc, with inference via ggml in pure C++
bert embeddings ggml mpnet ocr xlm-roberta
Last synced: 08 Oct 2026
https://github.com/ahoylabs/gguf.js
A Javascript library (with Typescript types) to parse metadata of GGML based GGUF files.
ggml gguf large-language-models llamacpp llm machine-learning
Last synced: 06 Oct 2025
https://github.com/william-murray1204/stable-diffusion-cpp-python
stable-diffusion.cpp bindings for python
ai bindings diffusion flux ggml image-generation img2img machine-learning stable-diffusion txt2img
Last synced: 07 Apr 2025
https://github.com/cztomsik/ggml-js
JavaScript bindings for the ggml-js library
Last synced: 15 Oct 2025
https://github.com/latestissue/AltaeraAI
A set of bash scripts to automate deployment of GGML/GGUF models [default: RWKV] with the use of KoboldCpp on Android - Termux
ai android ggml gguf koboldai koboldcpp llamacpp mamba mistral phi rwkv rwkv4 rwkvcpp termux tinydolphin tinyllama tinyvicuna vicuna
Last synced: 11 Apr 2025
https://github.com/latestissue/altaeraai
A set of bash scripts to automate deployment of GGML/GGUF models [default: RWKV] with the use of KoboldCpp on Android - Termux
ai android ggml gguf koboldai koboldcpp llamacpp mamba mistral phi rwkv rwkv4 rwkvcpp termux tinydolphin tinyllama tinyvicuna vicuna
Last synced: 28 Jul 2025
https://github.com/uminosachi/open-llm-webui
This repository contains a web application designed to execute relatively compact, locally-operated Large Language Models (LLMs).
chatbot ggml gradio huggingface language-model llama llama2 llama3 llava llava-llama3 llm nlp transformers
Last synced: 25 Oct 2025
https://github.com/teleprint-me/py.gpt.prompt
PyGPTPrompt: A CLI tool that manages context windows for AI models, facilitating user interaction and data ingestion for optimized long-term memory and task automation.
chatgpt chromadb cli-app developer-tools ggml gguf huggingface llamacpp openai prompt-toolkit python
Last synced: 30 Sep 2025
https://github.com/eugenehp/llama-cpp-rs
A wrapper around the llama-cpp library for rust, including new Sampler API from llama-cpp.
Last synced: 04 Jun 2026
https://github.com/albertstarfield/project-zephyrine
Introducing Project Zephyrine: Elevating Your Interaction Plug and Play, and Employing GPU Acceleration within a Modernized Automata Local Graphical User Interface.
adacore agentic-ai chatgpt chatgpt-app cuda-api deepseek-r1 flux ggml gguf metal-api openai-api qwen2-5 realtime vulkan-api
Last synced: 23 Jul 2025
https://github.com/general-developer/whisper_library
Whisper Is Library for transcribe sound wav AKA Speech To Text Or Extract Text From Audio
ai artificial-intelligence dart flutter ggml machine-learning ml openai speech-to-text transcribe translate whisper
Last synced: 05 Apr 2025
https://github.com/m1el/nemotron-asr.cpp
Nemotron ASR rewrite to GGML
asr asr-model ggml inference nemotron-ai nvidia-nemo speech-recognition speech-to-text
Last synced: 29 Jul 2026
https://github.com/seasonjs/rwkv
pure go for rwkv
deep-learning ggml go golang language-model llm rwkv
Last synced: 10 Apr 2025
https://github.com/betweentwomidnights/sa3.cpp
sa3 implemented in ggml for cross-platform and embedded applications
Last synced: 17 Jul 2026
https://github.com/ProjectArgus-cc/libargus.cc
A unified, unmanaged multimodal runtime. Zero-allocation native AI inference for Java 22+.
foreign-function-and-memory-api ggml java-22 java-25 jvm llama-cpp multimodal-ai project-panama whisper-cpp zero-gc
Last synced: 10 Aug 2026
https://github.com/seasonjs/stable-diffusion
pure go for stable-diffusion and support cross-platform.
deep-learning ggml go golang hacktoberfest image2image stable-diffusion text2image
Last synced: 07 Oct 2025
https://github.com/sunayhegde2006/air.rs
Air.rs 70B+ inference on consumer GPU, LLM inference in Rust
apple-silicon ggml inference instruction-set kernel llama-cpp local-ai lora megakernel nvidia-cuda open-models open-source qlora
Last synced: 28 May 2026
https://github.com/grazder/template.cpp
A template for getting started writing code using GGML
cpp deep-learning ggml inference-optimization
Last synced: 28 Sep 2026
https://github.com/coderonion/ggml-zig
[ ggml: Tensor library for machine learning ] written in zig.
aigc auto-differentiation chatglm chatgpt deep-learning ggml gpt gpt4 large-language-models llama llm machine-learning tensor wizardcoder zig ziglang
Last synced: 15 Jun 2025
https://github.com/rifkybujana/sam3.c
Efficient SAM3 (Segment Anything Model 3) inference from scratch in pure C — Metal GPU + multithreaded CPU, no Python dependencies
apple-silicon c computer-vision from-scratch ggml image-segmentation inference machine-learning metal pure-c sam3 segment-anything
Last synced: 04 Jun 2026
https://github.com/godmode2k/whisper.cpp.android
whisper.cpp.android with CLBlast(OpenCL), Translation (Google ML-Kit) and TTS
ai-translation android clblast ggml kotlin ml-kit openai-whisper opencl opencl-headers translation tts whisper whisper-ai whisper-android whisper-cpp
Last synced: 13 Apr 2025
https://github.com/matthoffner/backseat-pilot
Bring your own copilot server and customize commands to refactor instead of autofill or tabbed completion.
copilot ggml llm starcoder vscode-extension wizardcoder
Last synced: 01 Feb 2026
https://github.com/general-developer/stable_diffusion_library
Stable Diffusion Library Stable Diffusion Is Library for generated text to Image
ai dart flutter ggml ml stable-diffusion
Last synced: 04 Sep 2025
https://github.com/KerfuffleV2/gguf-tools
Some random tools for working with the GGUF file format
Last synced: 11 Sep 2025
https://github.com/ace-step/acestep.vst3
VST3 plugin for ACE-Step 1.5 music generation. Based on acestep.cpp (C++17/GGML). Runs on CPU, CUDA, Metal, Vulkan.
ace-step audio-plugin daw ggml music-generation vst3
Last synced: 13 Apr 2026
https://github.com/johnclaw/chatllm.v
V-lang api wrapper for llm-inference chatllm.cpp
api-wrapper bindings chatbot chatllm cpu-inference gemma ggml inference llama llm llm-inference llms mistral phi3 quantization qwen v-lang vlang
Last synced: 20 Jun 2025
https://github.com/iakashpaul/ghudsavar
Ghudsavar (Horse rider) - Is a quick llama.cpp server for CPU only runtimes
gemma gemma-2b ggml gguf google huggingface llama llamacpp server
Last synced: 19 Jul 2025
https://github.com/smartloop-ai/smartloop
An open-source local AI orchestration for documents
ai auto-tuning fine-tune-llms fine-tuning framework ggml gguf llm llm-inference orchestration slm textual tui tui-app
Last synced: 25 Apr 2026
https://github.com/tbogdala/sentient_core
A terminal style user interface to chat with AI characters using llama LLMs for locally processed AI.
ai chat-application ggml llama llamacpp llm llm-inference rust terminal-ui
Last synced: 23 Apr 2025
https://github.com/johnclaw/chatllm.vb
VB.NET api wrapper for llm-inference chatllm.cpp
api-wrapper bindings chatllm cpu-inference gemma ggml int8 int8-inference int8-quantization llama llm-inference mistral qwen vb-net vbnet
Last synced: 05 Jul 2025
https://github.com/loong64/llama.cpp
LLM inference in C/C++
ggml llama loong64 loongarch64
Last synced: 05 Jul 2026
https://github.com/johnclaw/chatllm.nim
Nim api-wrapper for llm-inference chatllm.cpp
api-wrapper bindings chatbot chatllm cpu-inference gemma ggml inference llama llm llm-inference llms mistral nim nim-lang nim-language nimlang phi quantization qwen
Last synced: 09 Feb 2026
https://github.com/johnclaw/chatllm.cs
C# api wrapper for llm-inference chatllm.cpp
api-wrapper bindings chatllm cpu-inference csharp gemma ggml inference int8 int8-inference int8-quantization llama llm llm-inference llms mistral qwen
Last synced: 11 Feb 2026
https://github.com/developer239/llama.cpp-ts
llama.cpp 🦙 LLM inference in TypeScript
ggml gguf llama llama3 llm llms meta-ai node-addon-api nodejs typescript
Last synced: 25 Feb 2026
https://github.com/thefrieber/koboldcs
Adaption of KoboldCPP with the goal to add missing core features
ai chatbot ggml gguf koboldai language-model llama llamacpp llm-interface llms
Last synced: 15 Apr 2025
https://github.com/ranjithrajv/awesome-cpu-first-ai
Curated, evidence-backed list of runtimes, formats & tools for running AI inference on CPU — start with CPU, justify the GPU.
ai arm awesome awesome-list cpu cpu-inference edge-ai efficient-inference ggml gguf inference llama-cpp llm local-llm machine-learning on-device onnx onnxruntime openvino quantization
Last synced: 30 Jul 2026
https://github.com/ngxson/ggml-easy
Thin wrapper around GGML to make life easier
Last synced: 23 Mar 2025
https://github.com/gaolingx/llama.cpp-launcher
run llama.cpp quickly and conveniently.
Last synced: 19 May 2026
https://github.com/amajji/llm-quantization-techniques-absmax-zeropoint-gptq-gguf
LLM quantization techniques: absmax, zero-point, GPTQ and GGUF
absmax absolute ggml gguf gptq llamacpp llm ptq quantization quantization-aware-training zeropoint
Last synced: 05 Jan 2026
https://github.com/incubated-geek-cc/native_gpt4j
A portable and native standalone GPT bot assistant *with chat interface) built using Java bindings from GPT4All. JDK 8 compatible.
chat-application chatgpt chatgpt-app ggml gpt java java-8
Last synced: 06 Jun 2026
https://github.com/johnclaw/chatllm.rs
rust api wrapper for llm-inference chatllm.cpp
api-wrapper bindings chatbot chatllm cpu-inference gemma ggml inference llama llm llm-inference llms mistral quantization qwen rust
Last synced: 29 Apr 2026
https://github.com/johnclaw/chatllm.lua
lua api wrapper for llm-inference chatllm.cpp
api-wrapper bindings chatbot chatllm cpu-inference gemma ggml inference llama llm llm-inference llms lua luajit mistral quantization qwen
Last synced: 11 May 2026
https://github.com/kartiksood10/blog-generator
An LLM App that generates Blogs based on style, topic and number of words input by the user.
ggml huggingface langchain llm python streamlit
Last synced: 09 Apr 2026
https://github.com/toreleon/leann.cpp
Native C++20 low-storage vector index with selective GGUF embedding recomputation through llama.cpp/ggml for local RAG.
cpp ggml hnsw llama-cpp local-rag product-quantization vector-search
Last synced: 04 Aug 2026
https://github.com/johnclaw/chatllm.d
D-lang api wrapper for llm-inference chatllm.cpp
api-wrapper bindings chatbot chatllm cpu-inference d-lang d-language dlang gemma ggml inference llama llm llm-inference llms mistral quantization qwen
Last synced: 29 Apr 2026
https://github.com/frinknet/gelli
Containerized LLM for any use-case big or small
ggml gguf-model-support llama llamacpp llm llm-training llmops
Last synced: 15 May 2026
https://github.com/wiatrM/jevtpp
Jev-like decisions. Strong C++ types.
cpp cpp20 ggml inference jev laya machine-learning observability onnx-runtime strong-types typed-decisions
Last synced: 01 Oct 2026
https://github.com/johnclaw/chatllm.kt
kotlin api wrapper for llm-inference chatllm.cpp
api-wrapper bindings chatbot chatllm cpu-inference gemma ggml inference kotlin llama llm llm-inference llms mistral quantization qwen
Last synced: 12 Apr 2026
https://github.com/guilt/neuron-kernel-generator
A modular C++ tool for generating HLO and NEFF files from GGML/llama.cpp kernels for AWS Neuron (Inferentia/Trainium).
Last synced: 09 May 2026
