Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

https://github.com/Mobile-Artificial-Intelligence/maid_llm

maid_llm is a dart implementation of llama.cpp used by the mobile artificial intelligence distribution (maid)

facebook flutter-ai gemma ggml gguf llama llama2 llamacpp llm llm-inference local-ai meta mistral mixtral mobile-ai

Last synced: 01 Jul 2024

https://github.com/withcatai/node-llama-cpp

Run AI models locally on your machine with node.js bindings for llama.cpp. Force a JSON schema on the model output on the generation level

ai bindings catai cmake cmake-js cuda gguf grammar json-schema llama llama-cpp llm metal nodejs prebuilt-binaries self-hosted

Last synced: 11 Jun 2024

https://github.com/antirez/gguf-tools

GGUF implementation in C as a library and a tools CLI program

ai gguf llm ml

Last synced: 04 May 2024

https://github.com/latestissue/AltaeraAI

A set of bash scripts to automate deployment of GGML/GGUF models [default: RWKV] with the use of KoboldCpp on Android - Termux

ai android ggml gguf koboldai koboldcpp llama-2 llama2 llamacpp mistral mistral-7b phi phi-2 phi2 rwkv rwkv4 rwkvcpp termux vicuna

Last synced: 04 May 2024

https://github.com/janhq/cortex

Drop-in, local AI alternative to the OpenAI stack. Multi-engine (llama.cpp, TensorRT-LLM). Powers πŸ‘‹ Jan

accelerated ai cuda gguf inference-engine llama llama2 llamacpp llm llms openai-api stable-diffusion tensorrt-llm

Last synced: 30 Apr 2024

https://github.com/Mobile-Artificial-Intelligence/maid

Maid is a cross-platform Flutter app for interfacing with GGUF / llama.cpp models locally, and with Ollama and OpenAI models remotely.

android android-ai chatbot chatgpt facebook ffigen flutter gguf large-language-models llama llama-cpp llama2 llamacpp local-ai mistral mobile-ai mobile-artificial-intelligence ollama openai openorca

Last synced: 31 Mar 2024

https://github.com/albertstarfield/alpaca-electron-zephyrine

Introducing Project Zephyrine: Elevating Your Interaction Plug and Play, and Employing GPU Acceleration within a Modernized Automata Local Graphical User Interface.

chatgpt cuda electron falcon gemma ggml gguf gpt-3 gui llama llama-2 llm metal opencl

Last synced: 16 Mar 2024