Projects in Awesome Lists tagged with openai-compatible-api

https://github.com/remsky/kokoro-fastapi

Dockerized FastAPI wrapper for Kokoro-82M text-to-speech model w/CPU ONNX and NVIDIA GPU PyTorch support, handling, and auto-stitching

fastapi huggingface-spaces kokoro kokoro-tts onnx onnxruntime openai-compatible-api openwebui pytorch sillytavern tts tts-api uv

Last synced: 15 May 2026

https://github.com/micz/thunderai

ThunderAI is a Thunderbird Addon that uses the capabilities of ChatGPT, Gemini, Claude or Ollama to enhance email management.

anthropic anthropic-api chatgpt chatgpt-app gemini gemini-ai gemini-api javascript ollama ollama-api ollama-app ollama-client openai-api openai-compatible-api thunderbird thunderbird-addon thunderbird-addons thunderbird-extension

Last synced: 11 Mar 2026

https://github.com/agentem-ai/izwi

On-device Voice AI engine for transcription, TTS, and voice workflows.

asr audio-inference local-first openai-compatible-api self-hosted-ai speaker-diarization speech-to-text text-to-speech tts voice-cloning

Last synced: 10 Mar 2026

https://github.com/gpustack/llama-box

LM inference server implementation based on *.cpp.

cpp diffusion gguf openai-compatible-api transformer

Last synced: 05 Apr 2025

https://github.com/micz/ThunderAI

ThunderAI is a Thunderbird Addon that uses the capabilities of ChatGPT, Gemini, Anthropic or Ollama to enhance email management.

anthropic anthropic-api chatgpt chatgpt-app gemini gemini-ai gemini-api javascript ollama ollama-api ollama-app ollama-client openai-api openai-compatible-api thunderbird thunderbird-addon thunderbird-addons thunderbird-extension

Last synced: 18 Jun 2025

https://github.com/devidw/inferit

Visual inference exploration & experimentation playground

chrome-ai chromeai inference-client openai-compatible-api

Last synced: 07 Oct 2025

https://github.com/gpustack/vox-box

A text-to-speech and speech-to-text server compatible with the OpenAI API, supporting Whisper, FunASR, Bark, and CosyVoice backends.

asr audio-processing openai-compatible-api python speech-to-text stt text-to-speech tts

Last synced: 07 Apr 2025

https://github.com/ericc-ch/copilot-api

GitHub Copilot API wrapper to make it OpenAI compatible

github-copilot openai-api openai-compatible-api reverse-engineering

Last synced: 06 Apr 2025

https://github.com/aws-samples/easy-model-deployer

A user-friendly Command-line/SDK tool that makes it quickly and easier to deploy open-source LLMs on AWS

comfyui-workflow deepseek deepseek-r1 ec2 ecs gemma3 huggingface inferentia-2 internlm2 langchain large-language-model ollama openai-compatible-api qwen2-5 qwq qwq-32b sagemaker vllm

Last synced: 13 Apr 2025

https://github.com/hcd233/aris-ai-model-server

An OpenAI Compatible API which integrates LLM, Embedding and Reranker. 一个集成 LLM、Embedding 和 Reranker 的 OpenAI 兼容 API

ai awq embedding fastapi gptq llm mlx openai-compatible-api rag reranker sentence-transformers vllm

Last synced: 08 May 2025

https://github.com/fcn06/swarm

SDK to build Agents in rust. Build and manage complex, self-correcting agent teams. Launch multi-agent systems via configuration files or using an Agent Factory. It's the robust framework for orchestrating intelligent agents using open standards (MCP, A2A).

a2a-protocol agent-factory agentic-ai ai-agents-sdk domain-agents executor-agent identity-agent llm-as-a-judge model-context-protocol openai-compatible-api planner-agent twin-agent

Last synced: 09 Jun 2026

https://github.com/spongeengine/koboldsharp

C# client for KoboldCpp.

ai ai-client csharp dotnet kobold-cpp koboldai koboldcpp language-models llm llm-client local-llm local-llm-integration local-llms offline-ai openai-compatible-api self-hosted-ai text-generation-webui

Last synced: 24 Apr 2025

https://github.com/spongeengine/lmstudiosharp

C# client for LM Studio.

ai ai-client csharp dotnet language-models llm llm-client lm-studio lmstudio local-llm local-llm-integration local-llms offline-ai openai-compatible-api self-hosted-ai

Last synced: 24 Feb 2025

https://github.com/samestrin/llm-services-api

A FastAPI-powered REST API offering a comprehensive suite of natural language processing services using machine learning models with PyTorch and Transformers, packaged in a Docker container to run efficiently.

api docker fastapi hugging-face hugging-face-transformers huggingface-transformers keybert llm openai-compatible-api python python3 pytorch rest rest-api spacy torch transformers uvicorn

Last synced: 09 Feb 2026

https://github.com/skirja/vision-mcp

MCP server that adds visual understanding capabilities to text-only coding models. Supports OpenAI GPT-4o and compatible vision APIs.

image-analysis mcp openai openai-compatible-api ui-extraction vision visual-understanding

Last synced: 13 Apr 2026

https://github.com/toledo-labs/toledo1

Achieve search sovereignty with Toledo1, a compound LLM browser

ai-agents anthropic-claude chat client-side desktop-app huggingface-inference-endpoint llamacpp llm-browser multi-llm nvidia-inference-endpoint openai-chatgpt openai-compatible-api real-time

Last synced: 26 Oct 2025

https://github.com/pacphi/spring-ai-openrouter-example

Demonstrates that Spring AI can be configured to work with OpenRouter so that you can work with multiple LLMs through a single Open AI compatible interface. Potentially helpful when evaluating the performance and quality of model responses.

java openai-compatible-api openrouter spring-ai

Last synced: 24 Mar 2025

https://github.com/nuttingd/pocket-llm

A private LLM chat client for Android.

android llm openai-compatible-api

Last synced: 04 Apr 2026

https://github.com/vibheksoni/secrets-wtf

secrets.wtf: defensive AI infrastructure exposure index for Ollama and LM Studio hosts, local LLM APIs, model observations, remediation, and takedown requests.

ai-infrastructure ai-security api-security asset-discovery attack-surface attack-surface-management defensive-security easm exposure-monitoring host-inventory llm-infrastructure llm-security lm-studio local-llm ollama openai-compatible-api osint security-research security-tools vibheksoni

Last synced: 27 Jun 2026

https://github.com/spongeengine/lmsharp

A unified .NET client library for running LLMs (Large Language Models) locally. LocalAI.NET provides a single, consistent API for interacting with popular local LLM providers like KoboldCpp, Ollama, LM Studio, and Text Generation WebUI.

ai ai-client csharp dotnet koboldcpp language-models llm llm-client lm-studio local-llm offline-ai ollama openai-compatible-api self-hosted-ai text-generation-webui