{"id":20874980,"url":"https://github.com/servicestack/ai-server","last_synced_at":"2025-04-07T11:04:41.317Z","repository":{"id":258048336,"uuid":"868689734","full_name":"ServiceStack/ai-server","owner":"ServiceStack","description":"AI Server","archived":false,"fork":false,"pushed_at":"2025-03-30T07:02:32.000Z","size":14658,"stargazers_count":88,"open_issues_count":1,"forks_count":9,"subscribers_count":10,"default_branch":"main","last_synced_at":"2025-04-02T23:41:54.924Z","etag":null,"topics":[],"latest_commit_sha":null,"homepage":null,"language":"JavaScript","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"other","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/ServiceStack.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"license.txt","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2024-10-07T02:11:57.000Z","updated_at":"2025-03-30T07:02:35.000Z","dependencies_parsed_at":"2024-10-28T06:42:14.214Z","dependency_job_id":"0766987a-a9f0-4b02-8e66-9dfbcce5181f","html_url":"https://github.com/ServiceStack/ai-server","commit_stats":null,"previous_names":["servicestack/ai-server"],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/ServiceStack%2Fai-server","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/ServiceStack%2Fai-server/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/ServiceStack%2Fai-server/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/ServiceStack%2Fai-server/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/ServiceStack","download_url":"https://codeload.github.com/ServiceStack/ai-server/tar.gz/refs/heads/main","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":247640461,"owners_count":20971557,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":[],"created_at":"2024-11-18T06:40:37.238Z","updated_at":"2025-04-07T11:04:41.299Z","avatar_url":"https://github.com/ServiceStack.png","language":"JavaScript","readme":"# ai-server\n\nWebsite: [openai.servicestack.net](https://openai.servicestack.net).\n\nSelf-hosted private gateway to manage access to multiple LLM APIs, Ollama endpoints, Media APIs, Comfy UI and FFmpeg Agents.\n\n```mermaid\nflowchart TB\n    A[AI Server] \n    A --\u003e D{LLM APIs}\n    A --\u003e C{Ollama}\n    A --\u003e E{Media APIs}\n    A --\u003e F{Comfy UI \n    + \n    FFmpeg}\n    D --\u003e D1[OpenRouter / OpenAI / Mistral AI / Google Cloud / GroqCloud]\n    E --\u003e E1[Replicate / dall-e-3 / Text to speech]\n    F --\u003e F1[Diffusion / Whisper / TTS]\n```\n\n## Self Hosted AI Server API Gateway\n\nAI Server is a way to orchestrate your AI requests through a single self-hosted private gateway to control what AI Providers your Apps with only a single typed client integration. It can be used to process LLM, AI, Diffusion and image transformation requests which are dynamically delegated across multiple configured providers which can include any \nOllama endpoint, OpenRouter / OpenAI / Mistral AI / Google Cloud / GroqCloud LLM APIs, Replicate / Open AI/Dall-e-3 / \nText to speech Media APIs, Diffusion / Whisper / Text to Speech from Comfy UI and FFmpeg Agents.\n\n### Comfy UI FFmpeg Agents\n\nAs part of the overall AI Server solution we're also maintaining [Docker Client Agents](https://docs.servicestack.net/ai-server/comfy-extension) configured with Comfy UI, Whisper and FFmpeg which can be installed on GPU Servers to provide a full stack media processing pipeline for video and audio files which can be used as part of your AI workflows.\n\nSee [AI Server Docs](https://docs.servicestack.net/ai-server/) for documentation on \n[installation](https://docs.servicestack.net/ai-server/quickstart) and \n[configuration](https://docs.servicestack.net/ai-server/configuration).\n\n## Built In UIs\n\nIn addition to its backend APIs, it also includes several built in UI's for utlizing AI Server features:\n\n### Open AI Chat\n\n![](https://raw.githubusercontent.com/ServiceStack/ai-server/refs/heads/main/AiServer/wwwroot/img/uis/Chat.webp)\n\n### Text to Image\n\n![](https://raw.githubusercontent.com/ServiceStack/ai-server/refs/heads/main/AiServer/wwwroot/img/uis/TextToImage.webp)\n\n### Image to Text\n\n![](https://raw.githubusercontent.com/ServiceStack/ai-server/refs/heads/main/AiServer/wwwroot/img/uis/ImageToText.webp)\n\n### Image to Image\n\n![](https://raw.githubusercontent.com/ServiceStack/ai-server/refs/heads/main/AiServer/wwwroot/img/uis/ImageUpscale.webp)\n\n### Speech to Text\n\n![](https://raw.githubusercontent.com/ServiceStack/ai-server/refs/heads/main/AiServer/wwwroot/img/uis/SpeechToText.webp)\n\n### Text to Speech\n\n![](https://raw.githubusercontent.com/ServiceStack/ai-server/refs/heads/main/AiServer/wwwroot/img/uis/TextToSpeech.webp)\n\n## Admin UIs\n\nUse Admin UIs to manage AI and Media Providers and API Key Access\n\n![](https://raw.githubusercontent.com/ServiceStack/ai-server/refs/heads/main/AiServer/wwwroot/img/uis/admin/dashboard.webp)\n\nIncrease capacity by adding AI Providers that can process LLM Requests\n\n![](https://raw.githubusercontent.com/ServiceStack/ai-server/refs/heads/main/AiServer/wwwroot/img/uis/admin/ai-providers.webp)\n\nAdd local Ollama endpoints and control which of their Models can be used\n\n![](https://raw.githubusercontent.com/ServiceStack/ai-server/refs/heads/main/AiServer/wwwroot/img/uis/admin/ai-providers-new-ollama.webp)\n\nGlossary of LLM models available via Ollama or LLM APIs\n\n![](https://raw.githubusercontent.com/ServiceStack/ai-server/refs/heads/main/AiServer/wwwroot/img/uis/admin/ai-models.webp)\n\nList of different AI Provider Types that AI Server supports\n\n![](https://raw.githubusercontent.com/ServiceStack/ai-server/refs/heads/main/AiServer/wwwroot/img/uis/admin/ai-types.webp)\n\nIncrease capacity by adding AI Providers that can process Media \u0026 FFmpeg Requests\n\n![](https://raw.githubusercontent.com/ServiceStack/ai-server/refs/heads/main/AiServer/wwwroot/img/uis/admin/media-providers.webp)\n\nAdd a new Replicate API Media Provider and which diffusion models to enable\n\n![](https://raw.githubusercontent.com/ServiceStack/ai-server/refs/heads/main/AiServer/wwwroot/img/uis/admin/media-providers-replicate.webp)\n\nAdd a new Comfy UI Agent and control which of its models can be used\n\n![](https://raw.githubusercontent.com/ServiceStack/ai-server/refs/heads/main/AiServer/wwwroot/img/uis/admin/media-providers-comfyui.webp)\n\nGlossary of different Media Provider Types that AI Server supports\n\n![](https://raw.githubusercontent.com/ServiceStack/ai-server/refs/heads/main/AiServer/wwwroot/img/uis/admin/media-types.webp)\n\nView completed and failed Background Jobs from Jobs Dashboard\n\n![](https://raw.githubusercontent.com/ServiceStack/ai-server/refs/heads/main/AiServer/wwwroot/img/uis/admin/background-jobs.webp)\n\nMonitor Live progress of executing AI Requests\n\n![](https://raw.githubusercontent.com/ServiceStack/ai-server/refs/heads/main/AiServer/wwwroot/img/uis/admin/background-jobs-live.webp)\n\nView all currently pending and executing AI Requests\n\n![](https://raw.githubusercontent.com/ServiceStack/ai-server/refs/heads/main/AiServer/wwwroot/img/uis/admin/background-jobs-queue.webp)\n\nUse Admin UI to manage API Keys that can access AI Server APIs and Features\n\n![](https://raw.githubusercontent.com/ServiceStack/ai-server/refs/heads/main/AiServer/wwwroot/img/uis/admin/api-keys.webp)\n\nEdit API Keys for fine grain control over API Keys access and scope\n\n![](https://raw.githubusercontent.com/ServiceStack/ai-server/refs/heads/main/AiServer/wwwroot/img/uis/admin/api-keys-edit.webp)\n","funding_links":[],"categories":[],"sub_categories":[],"project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fservicestack%2Fai-server","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fservicestack%2Fai-server","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fservicestack%2Fai-server/lists"}