{"id":28463823,"url":"https://github.com/lemonade-sdk/lemonade","last_synced_at":"2026-04-02T12:05:35.849Z","repository":{"id":293569801,"uuid":"984341155","full_name":"lemonade-sdk/lemonade","owner":"lemonade-sdk","description":"Lemonade helps users discover and run local AI apps by serving optimized LLMs right from their own GPUs and NPUs. Join our discord: https://discord.gg/5xXzkMu8Zk","archived":false,"fork":false,"pushed_at":"2026-02-05T09:51:38.000Z","size":9925,"stargazers_count":2107,"open_issues_count":118,"forks_count":178,"subscribers_count":19,"default_branch":"main","last_synced_at":"2026-02-05T13:50:55.903Z","etag":null,"topics":["ai","amd","genai","gpu","llama","llm","llm-inference","local-server","mcp","mcp-server","mistral","npu","onnxruntime","openai-api","qwen","radeon","rocm","ryzen","vulkan"],"latest_commit_sha":null,"homepage":"https://lemonade-server.ai/","language":"C++","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"apache-2.0","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/lemonade-sdk.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null,"zenodo":null,"notice":"NOTICE.md","maintainers":null,"copyright":null,"agents":null,"dco":null,"cla":null}},"created_at":"2025-05-15T19:17:39.000Z","updated_at":"2026-02-05T13:08:26.000Z","dependencies_parsed_at":"2025-05-16T02:23:53.598Z","dependency_job_id":"3eb746a5-d58e-46f4-a94b-5a9fb3e0eafb","html_url":"https://github.com/lemonade-sdk/lemonade","commit_stats":null,"previous_names":["lemonade-sdk/lemonade"],"tags_count":95,"template":false,"template_full_name":null,"purl":"pkg:github/lemonade-sdk/lemonade","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/lemonade-sdk%2Flemonade","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/lemonade-sdk%2Flemonade/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/lemonade-sdk%2Flemonade/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/lemonade-sdk%2Flemonade/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/lemonade-sdk","download_url":"https://codeload.github.com/lemonade-sdk/lemonade/tar.gz/refs/heads/main","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/lemonade-sdk%2Flemonade/sbom","scorecard":null,"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":286080680,"owners_count":29187931,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2026-02-07T05:07:31.176Z","status":"ssl_error","status_checked_at":"2026-02-07T05:06:15.227Z","response_time":63,"last_error":"SSL_connect returned=1 errno=0 peeraddr=140.82.121.6:443 state=error: unexpected eof while reading","robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":false,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["ai","amd","genai","gpu","llama","llm","llm-inference","local-server","mcp","mcp-server","mistral","npu","onnxruntime","openai-api","qwen","radeon","rocm","ryzen","vulkan"],"created_at":"2025-06-07T05:01:08.926Z","updated_at":"2026-04-02T12:05:35.840Z","avatar_url":"https://github.com/lemonade-sdk.png","language":"C++","funding_links":[],"categories":["C++","A01_文本生成_文本对话","ai","📚 Projects (1974 total)","Inference platforms","8. Inference Engines","\u003cimg src=\"./assets/cpu.svg\" width=\"16\" height=\"16\" style=\"vertical-align: middle;\"\u003e Backends","MCP Frameworks and libraries"],"sub_categories":["大语言对话模型及数据","MCP Servers","Desktop / Local","Python"],"readme":"## 🍋 Lemonade: Refreshingly fast local LLMs, Image and Speech Generation\n\n\u003cp align=\"center\"\u003e\n  \u003ca href=\"https://discord.gg/5xXzkMu8Zk\"\u003e\n    \u003cimg src=\"https://img.shields.io/badge/Discord-7289DA?logo=discord\u0026logoColor=white\" alt=\"Discord\" /\u003e\u003c/a\u003e\n  \u003ca href=\"https://github.com/lemonade-sdk/lemonade/tree/main/test\" title=\"Check out our tests\"\u003e\n    \u003cimg src=\"https://github.com/lemonade-sdk/lemonade/actions/workflows/cpp_server_build_test_release.yml/badge.svg\" alt=\"Lemonade Server Build\" /\u003e\u003c/a\u003e\n  \u003ca href=\"docs/README.md#installation\" title=\"Check out our instructions\"\u003e\n    \u003cimg src=\"https://img.shields.io/badge/Windows-11-0078D6?logo=windows\u0026logoColor=white\" alt=\"Windows 11\" /\u003e\u003c/a\u003e\n  \u003ca href=\"https://lemonade-server.ai/install_options.html#ubuntu\" title=\"Ubuntu 24.04 \u0026 25.04 Supported\"\u003e\n    \u003cimg src=\"https://img.shields.io/badge/Ubuntu-24.04%20%7C%2025.04-E95420?logo=ubuntu\u0026logoColor=white\" alt=\"Ubuntu 24.04 | 25.04\" /\u003e\u003c/a\u003e\n  \u003ca href=\"https://lemonade-server.ai/install_options.html#macos\" title=\"macOS (beta)\"\u003e\n    \u003cimg src=\"https://img.shields.io/badge/macOS-beta-999999?logo=apple\u0026logoColor=white\" alt=\"macOS (beta)\" /\u003e\u003c/a\u003e\n  \u003ca href=\"https://snapcraft.io/lemonade-server\"\u003e\n    \u003cimg src=\"https://snapcraft.io/lemonade-server/badge.svg\" alt=\"Get it from the Snap Store\" /\u003e\u003c/a\u003e\n  \u003ca href=\"https://lemonade-server.ai/install_options.html#arch\" title=\"Arch Linux Supported\"\u003e\n    \u003cimg src=\"https://img.shields.io/aur/version/lemonade-server\" alt=\"Arch Linux\"\u003e\u003c/a\u003e\n  \u003ca href=\"docs/README.md#installation\" title=\"Check out our instructions\"\u003e\n    \u003cimg src=\"https://img.shields.io/badge/Python-3.10--3.13-blue?logo=python\u0026logoColor=white\" alt=\"Made with Python\" /\u003e\u003c/a\u003e\n  \u003ca href=\"https://github.com/lemonade-sdk/lemonade/blob/main/docs/contribute.md\" title=\"Contribution Guide\"\u003e\n    \u003cimg src=\"https://img.shields.io/badge/PRs-welcome-brightgreen.svg\" alt=\"PRs Welcome\" /\u003e\u003c/a\u003e\n  \u003ca href=\"https://github.com/lemonade-sdk/lemonade/releases/latest\" title=\"Download the latest release\"\u003e\n    \u003cimg src=\"https://img.shields.io/github/v/release/lemonade-sdk/lemonade?include_prereleases\" alt=\"Latest Release\" /\u003e\u003c/a\u003e\n  \u003ca href=\"https://tooomm.github.io/github-release-stats/?username=lemonade-sdk\u0026repository=lemonade\"\u003e\n    \u003cimg src=\"https://img.shields.io/github/downloads/lemonade-sdk/lemonade/total.svg\" alt=\"GitHub downloads\" /\u003e\u003c/a\u003e\n  \u003ca href=\"https://github.com/lemonade-sdk/lemonade/issues\"\u003e\n    \u003cimg src=\"https://img.shields.io/github/issues/lemonade-sdk/lemonade\" alt=\"GitHub issues\" /\u003e\u003c/a\u003e\n  \u003ca href=\"https://github.com/lemonade-sdk/lemonade/blob/main/LICENSE\"\u003e\n    \u003cimg src=\"https://img.shields.io/badge/License-Apache-yellow.svg\" alt=\"License: Apache\" /\u003e\u003c/a\u003e\n  \u003ca href=\"https://github.com/psf/black\"\u003e\n    \u003cimg src=\"https://img.shields.io/badge/code%20style-black-000000.svg\" alt=\"Code style: black\" /\u003e\u003c/a\u003e\n  \u003ca href=\"https://star-history.com/#lemonade-sdk/lemonade\"\u003e\n    \u003cimg src=\"https://img.shields.io/badge/Star%20History-View-brightgreen\" alt=\"Star History Chart\" /\u003e\u003c/a\u003e\n\u003c/p\u003e\n\u003cp align=\"center\"\u003e\n  \u003cimg src=\"https://github.com/lemonade-sdk/assets/blob/main/docs/banner_02.png?raw=true\" alt=\"Lemonade Banner\" /\u003e\n\u003c/p\u003e\n\u003ch3 align=\"center\"\u003e\n  \u003ca href=\"https://lemonade-server.ai/install_options.html\"\u003eDownload\u003c/a\u003e |\n  \u003ca href=\"https://lemonade-server.ai/docs/\"\u003eDocumentation\u003c/a\u003e |\n  \u003ca href=\"https://discord.gg/5xXzkMu8Zk\"\u003eDiscord\u003c/a\u003e\n\u003c/h3\u003e\n\nLemonade helps users discover and run local AI apps by serving optimized LLMs, images, and speech right from their own GPUs and NPUs.\n\nApps like [n8n](https://n8n.io/integrations/lemonade-model/), [VS Code Copilot](https://marketplace.visualstudio.com/items?itemName=lemonade-sdk.lemonade-sdk), [Morphik](https://www.morphik.ai/docs/local-inference#lemonade), and many more use Lemonade to seamlessly run generative AI on any PC.\n\n## Getting Started\n\n1. **Install**: [Windows](https://lemonade-server.ai/install_options.html#windows) · [Linux](https://lemonade-server.ai/install_options.html#linux) · [macOS (beta)](https://lemonade-server.ai/install_options.html#macos) · [Docker](https://lemonade-server.ai/install_options.html#docker) · [Source](./docs/dev-getting-started.md)\n2. **Get Models**: Browse and download with the [Model Manager](#model-library)\n3. **Generate**: Try models with the built-in interfaces for chat, image gen, speech gen, and more\n4. **Mobile**: Take your lemonade to go: [iOS](https://apps.apple.com/us/app/lemonade-mobile/id6757372210) · [Android](https://play.google.com/store/apps/details?id=com.lemonade.mobile.chat.ai\u0026pli=1) · [Source](https://github.com/lemonade-sdk/lemonade-mobile)\n5. **Connect**: Use Lemonade with your favorite apps:\n\n\u003c!-- MARKETPLACE_START --\u003e\n\u003cp align=\"center\"\u003e\n  \u003ca href=\"https://lemonade-server.ai/docs/server/apps/continue/\" title=\"Continue\"\u003e\u003cimg src=\"https://raw.githubusercontent.com/lemonade-sdk/marketplace/main/apps/continue/logo.png\" alt=\"Continue\" width=\"60\" /\u003e\u003c/a\u003e\u0026nbsp;\u0026nbsp;\u003ca href=\"https://deeptutor.knowhiz.us/\" title=\"Deep Tutor\"\u003e\u003cimg src=\"https://raw.githubusercontent.com/lemonade-sdk/marketplace/main/apps/deep-tutor/logo.png\" alt=\"Deep Tutor\" width=\"60\" /\u003e\u003c/a\u003e\u0026nbsp;\u0026nbsp;\u003ca href=\"https://marketplace.dify.ai/plugins/langgenius/lemonade\" title=\"Dify\"\u003e\u003cimg src=\"https://raw.githubusercontent.com/lemonade-sdk/marketplace/main/apps/dify/logo.png\" alt=\"Dify\" width=\"60\" /\u003e\u003c/a\u003e\u0026nbsp;\u0026nbsp;\u003ca href=\"https://github.com/amd/gaia?tab=readme-ov-file#getting-started-guide\" title=\"Gaia\"\u003e\u003cimg src=\"https://raw.githubusercontent.com/lemonade-sdk/marketplace/main/apps/gaia/logo.png\" alt=\"Gaia\" width=\"60\" /\u003e\u003c/a\u003e\u0026nbsp;\u0026nbsp;\u003ca href=\"https://marketplace.visualstudio.com/items?itemName=lemonade-sdk.lemonade-sdk\" title=\"GitHub Copilot\"\u003e\u003cimg src=\"https://raw.githubusercontent.com/lemonade-sdk/marketplace/main/apps/github-copilot/logo.png\" alt=\"GitHub Copilot\" width=\"60\" /\u003e\u003c/a\u003e\u0026nbsp;\u0026nbsp;\u003ca href=\"https://github.com/lemonade-sdk/infinity-arcade\" title=\"Infinity Arcade\"\u003e\u003cimg src=\"https://raw.githubusercontent.com/lemonade-sdk/marketplace/main/apps/infinity-arcade/logo.png\" alt=\"Infinity Arcade\" width=\"60\" /\u003e\u003c/a\u003e\u0026nbsp;\u0026nbsp;\u003ca href=\"https://www.iterate.ai/\" title=\"Iterate.ai\"\u003e\u003cimg src=\"https://raw.githubusercontent.com/lemonade-sdk/marketplace/main/apps/iterate-ai/logo.png\" alt=\"Iterate.ai\" width=\"60\" /\u003e\u003c/a\u003e\u0026nbsp;\u0026nbsp;\u003ca href=\"https://n8n.io/integrations/lemonade-model/\" title=\"n8n\"\u003e\u003cimg src=\"https://raw.githubusercontent.com/lemonade-sdk/marketplace/main/apps/n8n/logo.png\" alt=\"n8n\" width=\"60\" /\u003e\u003c/a\u003e\u0026nbsp;\u0026nbsp;\u003ca href=\"https://lemonade-server.ai/docs/server/apps/open-webui/\" title=\"Open WebUI\"\u003e\u003cimg src=\"https://raw.githubusercontent.com/lemonade-sdk/marketplace/main/apps/open-webui/logo.png\" alt=\"Open WebUI\" width=\"60\" /\u003e\u003c/a\u003e\u0026nbsp;\u0026nbsp;\u003ca href=\"https://lemonade-server.ai/docs/server/apps/open-hands/\" title=\"OpenHands\"\u003e\u003cimg src=\"https://raw.githubusercontent.com/lemonade-sdk/marketplace/main/apps/openhands/logo.png\" alt=\"OpenHands\" width=\"60\" /\u003e\u003c/a\u003e\n\u003c/p\u003e\n\n\u003cp align=\"center\"\u003e\u003cem\u003e\u003ca href=\"https://lemonade-server.ai/marketplace\"\u003eView all apps →\u003c/a\u003e\u003c/br\u003eWant your app featured here? \u003ca href=\"https://github.com/lemonade-sdk/marketplace\"\u003eJust submit a marketplace PR!\u003c/a\u003e\u003c/em\u003e\u003c/p\u003e\n\u003c!-- MARKETPLACE_END --\u003e\n\n## Using the CLI\n\nTo run and chat with Gemma 3:\n\n```\nlemonade run Gemma-3-4b-it-GGUF\n```\n\nMore modalities:\n\n```\n# image gen\nlemonade run SDXL-Turbo\n\n# speech gen\nlemonade run kokoro-v1\n\n# transcription\nlemonade run Whisper-Large-v3-Turbo\n```\n\nTo see models availables and download them:\n\n```\nlemonade list\n\nlemonade pull Gemma-3-4b-it-GGUF\n```\n\nTo see the backends available on your PC:\n\n```\nlemonade recipes\n```\n\n\n## Model Library\n\n\u003cimg align=\"right\" src=\"https://github.com/lemonade-sdk/assets/blob/main/docs/model_manager_02.png?raw=true\" alt=\"Model Manager\" width=\"280\" /\u003e\n\nLemonade supports a wide variety of LLMs (**GGUF**, **FLM**, and **ONNX**), whisper, stable diffusion, etc. models across CPU, GPU, and NPU.\n\nUse `lemonade pull` or the built-in **Model Manager** to download models. You can also import custom GGUF/ONNX models from Hugging Face.\n\n**[Browse all built-in models →](https://lemonade-server.ai/models.html)**\n\n\u003cbr clear=\"right\"/\u003e\n\n## Supported Configurations\n\nLemonade supports multiple recipes (LLM, speech, TTS, and image generation), and each recipe has its own backend and hardware requirements.\n\n\u003ctable\u003e\n  \u003cthead\u003e\n    \u003ctr\u003e\n      \u003cth\u003eModality\u003c/th\u003e\n      \u003cth\u003eRecipe\u003c/th\u003e\n      \u003cth\u003eBackend\u003c/th\u003e\n      \u003cth\u003eDevice\u003c/th\u003e\n      \u003cth\u003eOS\u003c/th\u003e\n    \u003c/tr\u003e\n  \u003c/thead\u003e\n  \u003ctbody\u003e\n    \u003ctr\u003e\n      \u003ctd rowspan=\"7\"\u003e\u003cstrong\u003eText generation\u003c/strong\u003e\u003c/td\u003e\n      \u003ctd rowspan=\"5\"\u003e\u003ccode\u003ellamacpp\u003c/code\u003e\u003c/td\u003e\n      \u003ctd\u003e\u003ccode\u003evulkan\u003c/code\u003e\u003c/td\u003e\n      \u003ctd\u003e\u003ccode\u003ex86_64\u003c/code\u003e CPU, AMD iGPU, AMD dGPU\u003c/td\u003e\n      \u003ctd\u003eWindows, Linux\u003c/td\u003e\n    \u003c/tr\u003e\n    \u003ctr\u003e\n      \u003ctd\u003e\u003ccode\u003erocm\u003c/code\u003e\u003c/td\u003e\n      \u003ctd\u003eSupported AMD ROCm iGPU/dGPU families*\u003c/td\u003e\n      \u003ctd\u003eWindows, Linux\u003c/td\u003e\n    \u003c/tr\u003e\n    \u003ctr\u003e\n      \u003ctd\u003e\u003ccode\u003ecpu\u003c/code\u003e\u003c/td\u003e\n      \u003ctd\u003e\u003ccode\u003ex86_64\u003c/code\u003e CPU\u003c/td\u003e\n      \u003ctd\u003eWindows, Linux\u003c/td\u003e\n    \u003c/tr\u003e\n    \u003ctr\u003e\n      \u003ctd\u003e\u003ccode\u003emetal\u003c/code\u003e\u003c/td\u003e\n      \u003ctd\u003eApple Silicon GPU\u003c/td\u003e\n      \u003ctd\u003emacOS (beta)\u003c/td\u003e\n    \u003c/tr\u003e\n    \u003ctr\u003e\n      \u003ctd\u003e\u003ccode\u003esystem\u003c/code\u003e\u003c/td\u003e\n      \u003ctd\u003e\u003ccode\u003ex86_64\u003c/code\u003e CPU, GPU\u003c/td\u003e\n      \u003ctd\u003eLinux\u003c/td\u003e\n    \u003c/tr\u003e\n    \u003ctr\u003e\n      \u003ctd\u003e\u003ccode\u003eflm\u003c/code\u003e\u003c/td\u003e\n      \u003ctd\u003e\u003ccode\u003enpu\u003c/code\u003e\u003c/td\u003e\n      \u003ctd\u003eXDNA2 NPU\u003c/td\u003e\n      \u003ctd\u003eWindows, Linux\u003c/td\u003e\n    \u003c/tr\u003e\n    \u003ctr\u003e\n      \u003ctd\u003e\u003ccode\u003eryzenai-llm\u003c/code\u003e\u003c/td\u003e\n      \u003ctd\u003e\u003ccode\u003enpu\u003c/code\u003e\u003c/td\u003e\n      \u003ctd\u003eXDNA2 NPU\u003c/td\u003e\n      \u003ctd\u003eWindows\u003c/td\u003e\n    \u003c/tr\u003e\n    \u003ctr\u003e\n      \u003ctd rowspan=\"3\"\u003e\u003cstrong\u003eSpeech-to-text\u003c/strong\u003e\u003c/td\u003e\n      \u003ctd rowspan=\"3\"\u003e\u003ccode\u003ewhispercpp\u003c/code\u003e\u003c/td\u003e\n      \u003ctd\u003e\u003ccode\u003enpu\u003c/code\u003e\u003c/td\u003e\n      \u003ctd\u003eXDNA2 NPU\u003c/td\u003e\n      \u003ctd\u003eWindows\u003c/td\u003e\n    \u003c/tr\u003e\n    \u003ctr\u003e\n      \u003ctd\u003e\u003ccode\u003evulkan\u003c/code\u003e\u003c/td\u003e\n      \u003ctd\u003e\u003ccode\u003ex86_64\u003c/code\u003e CPU\u003c/td\u003e\n      \u003ctd\u003eLinux\u003c/td\u003e\n    \u003c/tr\u003e\n    \u003ctr\u003e\n      \u003ctd\u003e\u003ccode\u003ecpu\u003c/code\u003e\u003c/td\u003e\n      \u003ctd\u003e\u003ccode\u003ex86_64\u003c/code\u003e CPU\u003c/td\u003e\n      \u003ctd\u003eWindows, Linux\u003c/td\u003e\n    \u003c/tr\u003e\n    \u003ctr\u003e\n      \u003ctd\u003e\u003cstrong\u003eText-to-speech\u003c/strong\u003e\u003c/td\u003e\n      \u003ctd\u003e\u003ccode\u003ekokoro\u003c/code\u003e\u003c/td\u003e\n      \u003ctd\u003e\u003ccode\u003ecpu\u003c/code\u003e\u003c/td\u003e\n      \u003ctd\u003e\u003ccode\u003ex86_64\u003c/code\u003e CPU\u003c/td\u003e\n      \u003ctd\u003eWindows, Linux\u003c/td\u003e\n    \u003c/tr\u003e\n    \u003ctr\u003e\n      \u003ctd rowspan=\"2\"\u003e\u003cstrong\u003eImage generation\u003c/strong\u003e\u003c/td\u003e\n      \u003ctd rowspan=\"2\"\u003e\u003ccode\u003esd-cpp\u003c/code\u003e\u003c/td\u003e\n      \u003ctd\u003e\u003ccode\u003erocm\u003c/code\u003e\u003c/td\u003e\n      \u003ctd\u003eSupported AMD ROCm iGPU/dGPU families*\u003c/td\u003e\n      \u003ctd\u003eWindows, Linux\u003c/td\u003e\n    \u003c/tr\u003e\n    \u003ctr\u003e\n      \u003ctd\u003e\u003ccode\u003ecpu\u003c/code\u003e\u003c/td\u003e\n      \u003ctd\u003e\u003ccode\u003ex86_64\u003c/code\u003e CPU\u003c/td\u003e\n      \u003ctd\u003eWindows, Linux\u003c/td\u003e\n    \u003c/tr\u003e\n  \u003c/tbody\u003e\n\u003c/table\u003e\n\nTo check exactly which recipes/backends are supported on your own machine, run:\n\n```\nlemonade recipes\n```\n\n\u003cdetails\u003e\n\u003csummary\u003e\u003csmall\u003e\u003ci\u003e* See supported AMD ROCm platforms\u003c/i\u003e\u003c/small\u003e\u003c/summary\u003e\n\n\u003cbr\u003e\n\n\u003ctable\u003e\n  \u003cthead\u003e\n    \u003ctr\u003e\n      \u003cth\u003eArchitecture\u003c/th\u003e\n      \u003cth\u003ePlatform Support\u003c/th\u003e\n      \u003cth\u003eGPU Models\u003c/th\u003e\n    \u003c/tr\u003e\n  \u003c/thead\u003e\n  \u003ctbody\u003e\n    \u003ctr\u003e\n      \u003ctd\u003e\u003cb\u003egfx1151\u003c/b\u003e (STX Halo)\u003c/td\u003e\n      \u003ctd\u003eWindows, Ubuntu\u003c/td\u003e\n      \u003ctd\u003eRyzen AI MAX+ Pro 395\u003c/td\u003e\n    \u003c/tr\u003e\n    \u003ctr\u003e\n      \u003ctd\u003e\u003cb\u003egfx120X\u003c/b\u003e (RDNA4)\u003c/td\u003e\n      \u003ctd\u003eWindows, Ubuntu\u003c/td\u003e\n      \u003ctd\u003eRadeon AI PRO R9700, RX 9070 XT/GRE/9070, RX 9060 XT\u003c/td\u003e\n    \u003c/tr\u003e\n    \u003ctr\u003e\n      \u003ctd\u003e\u003cb\u003egfx110X\u003c/b\u003e (RDNA3)\u003c/td\u003e\n      \u003ctd\u003eWindows, Ubuntu\u003c/td\u003e\n      \u003ctd\u003eRadeon PRO W7900/W7800/W7700/V710, RX 7900 XTX/XT/GRE, RX 7800 XT, RX 7700 XT\u003c/td\u003e\n    \u003c/tr\u003e\n  \u003c/tbody\u003e\n\u003c/table\u003e\n\u003c/details\u003e\n\n## Project Roadmap\n\n| Under Development          | Under Consideration         | Recently Completed      |\n|---------------------------|-----------------------------|------------------------|\n| MLX support               | vLLM support                | macOS (beta)           |\n| More whisper.cpp backends | Enhanced custom model usage  | Image generation       |\n| More SD.cpp backends      |                              | Speech-to-text         |\n|                           |                              | Text-to-speech         |\n|                           |                              | Apps marketplace       |\n\n## Integrate Lemonade Server with Your Application\n\nYou can use any OpenAI-compatible client library by configuring it to use `http://localhost:8000/api/v1` as the base URL. A table containing official and popular OpenAI clients on different languages is shown below.\n\nFeel free to pick and choose your preferred language.\n\n\n| Python | C++ | Java | C# | Node.js | Go | Ruby | Rust | PHP |\n|--------|-----|------|----|---------|----|-------|------|-----|\n| [openai-python](https://github.com/openai/openai-python) | [openai-cpp](https://github.com/olrea/openai-cpp) | [openai-java](https://github.com/openai/openai-java) | [openai-dotnet](https://github.com/openai/openai-dotnet) | [openai-node](https://github.com/openai/openai-node) | [go-openai](https://github.com/sashabaranov/go-openai) | [ruby-openai](https://github.com/alexrudall/ruby-openai) | [async-openai](https://github.com/64bit/async-openai) | [openai-php](https://github.com/openai-php/client) |\n\n\n### Python Client Example\n```python\nfrom openai import OpenAI\n\n# Initialize the client to use Lemonade Server\nclient = OpenAI(\n    base_url=\"http://localhost:8000/api/v1\",\n    api_key=\"lemonade\"  # required but unused\n)\n\n# Create a chat completion\ncompletion = client.chat.completions.create(\n    model=\"Llama-3.2-1B-Instruct-Hybrid\",  # or any other available model\n    messages=[\n        {\"role\": \"user\", \"content\": \"What is the capital of France?\"}\n    ]\n)\n\n# Print the response\nprint(completion.choices[0].message.content)\n```\n\nFor more detailed integration instructions, see the [Integration Guide](./docs/server/server_integration.md).\n\n## FAQ\n\nTo read our frequently asked questions, see our [FAQ Guide](./docs/faq.md)\n\n## Contributing\n\nWe are actively seeking collaborators from across the industry. If you would like to contribute to this project, please check out our [contribution guide](./docs/contribute.md).\n\nNew contributors can find beginner-friendly issues tagged with \"Good First Issue\" to get started.\n\n\u003ca href=\"https://github.com/lemonade-sdk/lemonade/issues?q=is%3Aissue+is%3Aopen+label%3A%22good+first+issue%22\"\u003e\n  \u003cimg src=\"https://img.shields.io/badge/🍋Lemonade-Good%20First%20Issue-yellowgreen?colorA=38b000\u0026colorB=cccccc\" alt=\"Good First Issue\" /\u003e\n\u003c/a\u003e\n\n## Maintainers\n\nThis is a community project maintained by @amd-pworfolk @bitgamma @danielholanda @jeremyfowers @Geramy @ramkrishna2910 @siavashhub @sofiageo @superm1 @vgodsoe, and sponsored by AMD. You can reach us by filing an [issue](https://github.com/lemonade-sdk/lemonade/issues), emailing [lemonade@amd.com](mailto:lemonade@amd.com), or joining our [Discord](https://discord.gg/5xXzkMu8Zk).\n\n## Code Signing Policy\n\nFree code signing provided by [SignPath.io](https://signpath.io), certificate by [SignPath Foundation](https://signpath.org).\n\n- **Committers and reviewers**: [Maintainers](#maintainers) of this repo\n- **Approvers**: [Owners](https://github.com/orgs/lemonade-sdk/people?query=role%3Aowner)\n\n**Privacy policy**: This program will not transfer any information to other networked systems unless specifically requested by the user or the person installing or operating it. When the user requests it, Lemonade downloads AI models from [Hugging Face Hub](https://huggingface.co/) (see their [privacy policy](https://huggingface.co/privacy)).\n\n## License and Attribution\n\nThis project is:\n- Built with C++ (server) and React (app) with ❤️ for the open source community,\n- Standing on the shoulders of great tools from:\n  - [ggml/llama.cpp](https://github.com/ggml-org/llama.cpp)\n  - [ggml/whisper.cpp](https://github.com/ggerganov/whisper.cpp)\n  - [ggml/stable-diffusion.cpp](https://github.com/leejet/stable-diffusion.cpp)\n  - [kokoros](https://github.com/lucasjinreal/Kokoros)\n  - [OnnxRuntime GenAI](https://github.com/microsoft/onnxruntime-genai)\n  - [Hugging Face Hub](https://github.com/huggingface/huggingface_hub)\n  - [OpenAI API](https://github.com/openai/openai-python)\n  - [IRON/MLIR-AIE](https://github.com/Xilinx/mlir-aie)\n  - and more...\n- Accelerated by mentorship from the OCV Catalyst program.\n- Licensed under the [Apache 2.0 License](https://github.com/lemonade-sdk/lemonade/blob/main/LICENSE).\n  - Portions of the project are licensed as described in [NOTICE.md](./NOTICE.md).\n\n\u003c!--This file was originally licensed under Apache 2.0. It has been modified.\nModifications Copyright (c) 2025 AMD--\u003e\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Flemonade-sdk%2Flemonade","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Flemonade-sdk%2Flemonade","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Flemonade-sdk%2Flemonade/lists"}