{"id":13564111,"url":"https://github.com/pipecat-ai/pipecat","last_synced_at":"2026-04-14T21:00:59.829Z","repository":{"id":221736306,"uuid":"736272311","full_name":"pipecat-ai/pipecat","owner":"pipecat-ai","description":"Open Source framework for voice and multimodal conversational AI","archived":false,"fork":false,"pushed_at":"2026-04-10T00:39:57.000Z","size":143588,"stargazers_count":11100,"open_issues_count":151,"forks_count":1885,"subscribers_count":70,"default_branch":"main","last_synced_at":"2026-04-10T01:14:16.595Z","etag":null,"topics":["ai","chatbot-framework","chatbots","real-time","voice","voice-assistant"],"latest_commit_sha":null,"homepage":"https://pipecat.ai","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"bsd-2-clause","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/pipecat-ai.png","metadata":{"files":{"readme":"README.md","changelog":"CHANGELOG.md","contributing":"CONTRIBUTING.md","funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":"SECURITY.md","support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null,"zenodo":null,"notice":null,"maintainers":null,"copyright":null,"agents":null,"dco":null,"cla":null}},"created_at":"2023-12-27T12:59:00.000Z","updated_at":"2026-04-10T00:56:14.000Z","dependencies_parsed_at":"2024-02-12T22:42:56.699Z","dependency_job_id":"c924822c-dcd0-439a-b914-f4331e284a53","html_url":"https://github.com/pipecat-ai/pipecat","commit_stats":null,"previous_names":["daily-co/daily-ai-sdk","daily-co/pipecat","daily-co/dailyai","pipecat-ai/pipecat"],"tags_count":107,"template":false,"template_full_name":null,"purl":"pkg:github/pipecat-ai/pipecat","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/pipecat-ai%2Fpipecat","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/pipecat-ai%2Fpipecat/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/pipecat-ai%2Fpipecat/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/pipecat-ai%2Fpipecat/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/pipecat-ai","download_url":"https://codeload.github.com/pipecat-ai/pipecat/tar.gz/refs/heads/main","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/pipecat-ai%2Fpipecat/sbom","scorecard":null,"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":286080680,"owners_count":31815080,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2026-04-14T18:05:02.291Z","status":"ssl_error","status_checked_at":"2026-04-14T18:05:01.765Z","response_time":153,"last_error":"SSL_read: unexpected eof while reading","robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":false,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["ai","chatbot-framework","chatbots","real-time","voice","voice-assistant"],"created_at":"2024-08-01T13:01:26.662Z","updated_at":"2026-04-14T21:00:59.802Z","avatar_url":"https://github.com/pipecat-ai.png","language":"Python","readme":"\u003ch1\u003e\u003cdiv align=\"center\"\u003e\n \u003cimg alt=\"pipecat\" width=\"300px\" height=\"auto\" src=\"https://raw.githubusercontent.com/pipecat-ai/pipecat/main/pipecat.png\"\u003e\n\u003c/div\u003e\u003c/h1\u003e\n\n[![PyPI](https://img.shields.io/pypi/v/pipecat-ai)](https://pypi.org/project/pipecat-ai) ![Tests](https://github.com/pipecat-ai/pipecat/actions/workflows/tests.yaml/badge.svg) [![codecov](https://codecov.io/gh/pipecat-ai/pipecat/graph/badge.svg?token=LNVUIVO4Y9)](https://codecov.io/gh/pipecat-ai/pipecat) [![Docs](https://img.shields.io/badge/Documentation-blue)](https://docs.pipecat.ai) [![Discord](https://img.shields.io/discord/1239284677165056021)](https://discord.gg/pipecat) [![Ask DeepWiki](https://deepwiki.com/badge.svg)](https://deepwiki.com/pipecat-ai/pipecat)\n\n# 🎙️ Pipecat: Real-Time Voice \u0026 Multimodal AI Agents\n\n**Pipecat** is an open-source Python framework for building real-time voice and multimodal conversational agents. Orchestrate audio and video, AI services, different transports, and conversation pipelines effortlessly—so you can focus on what makes your agent unique.\n\n\u003e Want to dive right in? Run `pipecat init quickstart` or follow the [quickstart guide](https://docs.pipecat.ai/getting-started/quickstart).\n\n## 🚀 What You Can Build\n\n- **Voice Assistants** – natural, streaming conversations with AI\n- **AI Companions** – coaches, meeting assistants, characters\n- **Multimodal Interfaces** – voice, video, images, and more\n- **Interactive Storytelling** – creative tools with generative media\n- **Business Agents** – customer intake, support bots, guided flows\n- **Complex Dialog Systems** – design logic with structured conversations\n\n## 🧠 Why Pipecat?\n\n- **Voice-first**: Integrates speech recognition, text-to-speech, and conversation handling\n- **Pluggable**: Supports many AI services and tools\n- **Composable Pipelines**: Build complex behavior from modular components\n- **Real-Time**: Ultra-low latency interaction with different transports (e.g. WebSockets or WebRTC)\n\n## 🌐 Pipecat Ecosystem\n\n### 📱 Client SDKs\n\nBuilding client applications? You can connect to Pipecat from any platform using our official SDKs:\n\n\u003ca href=\"https://docs.pipecat.ai/client/js/introduction\"\u003eJavaScript\u003c/a\u003e | \u003ca href=\"https://docs.pipecat.ai/client/react/introduction\"\u003eReact\u003c/a\u003e | \u003ca href=\"https://docs.pipecat.ai/client/react-native/introduction\"\u003eReact Native\u003c/a\u003e |\n\u003ca href=\"https://docs.pipecat.ai/client/ios/introduction\"\u003eSwift\u003c/a\u003e | \u003ca href=\"https://docs.pipecat.ai/client/android/introduction\"\u003eKotlin\u003c/a\u003e | \u003ca href=\"https://docs.pipecat.ai/client/c++/introduction\"\u003eC++\u003c/a\u003e | \u003ca href=\"https://github.com/pipecat-ai/pipecat-esp32\"\u003eESP32\u003c/a\u003e\n\n### 🧭 Structured conversations\n\nLooking to build structured conversations? Check out [Pipecat Flows](https://github.com/pipecat-ai/pipecat-flows) for managing complex conversational states and transitions.\n\n### 🪄 Beautiful UIs\n\nWant to build beautiful and engaging experiences? Checkout the [Voice UI Kit](https://github.com/pipecat-ai/voice-ui-kit), a collection of components, hooks and templates for building voice AI applications quickly.\n\n### 🛠️ Create and deploy projects\n\nCreate a new project in under a minute with the [Pipecat CLI](https://github.com/pipecat-ai/pipecat-cli). Then use the CLI to monitor and deploy your agent to production.\n\n### 🔍 Debugging\n\nLooking for help debugging your pipeline and processors? Check out [Whisker](https://github.com/pipecat-ai/whisker), a real-time Pipecat debugger.\n\n### 🖥️ Terminal\n\nLove terminal applications? Check out [Tail](https://github.com/pipecat-ai/tail), a terminal dashboard for Pipecat.\n\n### 🤖 Claude Code Skills\n\nUse [Pipecat Skills](https://github.com/pipecat-ai/skills) with [Claude Code](https://claude.ai/code) to scaffold projects, deploy to Pipecat Cloud, and more. Install the marketplace with:\n\n```\nclaude plugin marketplace add pipecat-ai/skills\n```\n\nand install any of the available plugins.\n\n### 🧩 Community Integrations\n\nBuild and share your own Pipecat service integrations! Browse existing [community integrations](https://docs.pipecat.ai/server/services/community-integrations) or check out our [guide](COMMUNITY_INTEGRATIONS.md) to create your own.\n\n### 📺️ Pipecat TV Channel\n\nCatch new features, interviews, and how-tos on our [Pipecat TV](https://www.youtube.com/playlist?list=PLzU2zoMTQIHjqC3v4q2XVSR3hGSzwKFwH) channel.\n\n## 🎬 See it in action\n\n\u003cp float=\"left\"\u003e\n \u003ca href=\"https://github.com/pipecat-ai/pipecat-examples/tree/main/simple-chatbot\"\u003e\u003cimg src=\"https://raw.githubusercontent.com/pipecat-ai/pipecat-examples/main/simple-chatbot/image.png\" width=\"400\" /\u003e\u003c/a\u003e\u0026nbsp;\n \u003ca href=\"https://github.com/pipecat-ai/pipecat-examples/tree/main/storytelling-chatbot\"\u003e\u003cimg src=\"https://raw.githubusercontent.com/pipecat-ai/pipecat-examples/main/storytelling-chatbot/image.png\" width=\"400\" /\u003e\u003c/a\u003e\n \u003cbr/\u003e\n \u003ca href=\"https://github.com/pipecat-ai/pipecat-examples/tree/main/translation-chatbot\"\u003e\u003cimg src=\"https://raw.githubusercontent.com/pipecat-ai/pipecat-examples/main/translation-chatbot/image.png\" width=\"400\" /\u003e\u003c/a\u003e\u0026nbsp;\n \u003ca href=\"https://github.com/pipecat-ai/pipecat/blob/main/examples/vision/vision-moondream.py\"\u003e\u003cimg src=\"https://github.com/pipecat-ai/pipecat/blob/main/examples/assets/moondream.png\" width=\"400\" /\u003e\u003c/a\u003e\n\u003c/p\u003e\n\n## 🧩 Available services\n\n| Category | Services |\n| ------------------- | -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- |\n| Speech-to-Text | [AssemblyAI](https://docs.pipecat.ai/server/services/stt/assemblyai), [AWS](https://docs.pipecat.ai/server/services/stt/aws), [Azure](https://docs.pipecat.ai/server/services/stt/azure), [Cartesia](https://docs.pipecat.ai/server/services/stt/cartesia), [Deepgram](https://docs.pipecat.ai/server/services/stt/deepgram), [ElevenLabs](https://docs.pipecat.ai/server/services/stt/elevenlabs), [Fal Wizper](https://docs.pipecat.ai/server/services/stt/fal), [Gladia](https://docs.pipecat.ai/server/services/stt/gladia), [Google](https://docs.pipecat.ai/server/services/stt/google), [Gradium](https://docs.pipecat.ai/server/services/stt/gradium), [Groq (Whisper)](https://docs.pipecat.ai/server/services/stt/groq), [NVIDIA Riva](https://docs.pipecat.ai/server/services/stt/riva), [OpenAI (Whisper)](https://docs.pipecat.ai/server/services/stt/openai), [Sarvam](https://docs.pipecat.ai/server/services/stt/sarvam), [Soniox](https://docs.pipecat.ai/server/services/stt/soniox), [Speechmatics](https://docs.pipecat.ai/server/services/stt/speechmatics), [Whisper](https://docs.pipecat.ai/server/services/stt/whisper) |\n| LLMs | [Anthropic](https://docs.pipecat.ai/server/services/llm/anthropic), [AWS](https://docs.pipecat.ai/server/services/llm/aws), [Azure](https://docs.pipecat.ai/server/services/llm/azure), [Cerebras](https://docs.pipecat.ai/server/services/llm/cerebras), [DeepSeek](https://docs.pipecat.ai/server/services/llm/deepseek), [Fireworks AI](https://docs.pipecat.ai/server/services/llm/fireworks), [Gemini](https://docs.pipecat.ai/server/services/llm/gemini), [Grok](https://docs.pipecat.ai/server/services/llm/grok), [Groq](https://docs.pipecat.ai/server/services/llm/groq), [Mistral](https://docs.pipecat.ai/server/services/llm/mistral), [Nebius](https://docs.pipecat.ai/server/services/llm/nebius), [Novita](https://docs.pipecat.ai/server/services/llm/novita), [NVIDIA NIM](https://docs.pipecat.ai/server/services/llm/nvidia), [Ollama](https://docs.pipecat.ai/server/services/llm/ollama), [OpenAI](https://docs.pipecat.ai/server/services/llm/openai), [OpenRouter](https://docs.pipecat.ai/server/services/llm/openrouter), [Perplexity](https://docs.pipecat.ai/server/services/llm/perplexity), [Qwen](https://docs.pipecat.ai/server/services/llm/qwen), [SambaNova](https://docs.pipecat.ai/server/services/llm/sambanova), [Sarvam](https://docs.pipecat.ai/server/services/llm/sarvam), [Together AI](https://docs.pipecat.ai/server/services/llm/together) |\n| Text-to-Speech | [Async](https://docs.pipecat.ai/server/services/tts/asyncai), [AWS](https://docs.pipecat.ai/server/services/tts/aws), [Azure](https://docs.pipecat.ai/server/services/tts/azure), [Camb AI](https://docs.pipecat.ai/server/services/tts/camb), [Cartesia](https://docs.pipecat.ai/server/services/tts/cartesia), [Deepgram](https://docs.pipecat.ai/server/services/tts/deepgram), [ElevenLabs](https://docs.pipecat.ai/server/services/tts/elevenlabs), [Fish](https://docs.pipecat.ai/server/services/tts/fish), [Google](https://docs.pipecat.ai/server/services/tts/google), [Gradium](https://docs.pipecat.ai/server/services/tts/gradium), [Groq](https://docs.pipecat.ai/server/services/tts/groq), [Hume](https://docs.pipecat.ai/server/services/tts/hume), [Inworld](https://docs.pipecat.ai/server/services/tts/inworld), [Kokoro](https://docs.pipecat.ai/server/services/tts/kokoro), [LMNT](https://docs.pipecat.ai/server/services/tts/lmnt), [MiniMax](https://docs.pipecat.ai/server/services/tts/minimax), [Neuphonic](https://docs.pipecat.ai/server/services/tts/neuphonic), [NVIDIA Riva](https://docs.pipecat.ai/server/services/tts/riva), [OpenAI](https://docs.pipecat.ai/server/services/tts/openai), [Piper](https://docs.pipecat.ai/server/services/tts/piper), [Resemble](https://docs.pipecat.ai/server/services/tts/resemble), [Rime](https://docs.pipecat.ai/server/services/tts/rime), [Sarvam](https://docs.pipecat.ai/server/services/tts/sarvam), [Smallest](https://docs.pipecat.ai/server/services/tts/smallest), [Speechmatics](https://docs.pipecat.ai/server/services/tts/speechmatics), [xAI](https://docs.pipecat.ai/server/services/tts/xai), [XTTS](https://docs.pipecat.ai/server/services/tts/xtts) |\n| Speech-to-Speech | [AWS Nova Sonic](https://docs.pipecat.ai/server/services/s2s/aws), [Gemini Multimodal Live](https://docs.pipecat.ai/server/services/s2s/gemini), [Grok Voice Agent](https://docs.pipecat.ai/server/services/s2s/grok), [OpenAI Realtime](https://docs.pipecat.ai/server/services/s2s/openai), [Ultravox](https://docs.pipecat.ai/server/services/s2s/ultravox), |\n| Transport | [Daily (WebRTC)](https://docs.pipecat.ai/server/services/transport/daily), [FastAPI Websocket](https://docs.pipecat.ai/server/services/transport/fastapi-websocket), [LiveKit (WebRTC)](https://docs.pipecat.ai/server/services/transport/livekit), [SmallWebRTCTransport](https://docs.pipecat.ai/server/services/transport/small-webrtc), [WebSocket Server](https://docs.pipecat.ai/server/services/transport/websocket-server), [WhatsApp](https://docs.pipecat.ai/server/services/transport/whatsapp), Local |\n| Serializers | [Exotel](https://docs.pipecat.ai/server/services/serializers/exotel), [Genesys](https://docs.pipecat.ai/server/services/serializers/genesys), [Plivo](https://docs.pipecat.ai/server/services/serializers/plivo), [Twilio](https://docs.pipecat.ai/server/services/serializers/twilio), [Telnyx](https://docs.pipecat.ai/server/services/serializers/telnyx), [Vonage](https://docs.pipecat.ai/server/services/serializers/vonage) |\n| Video | [HeyGen](https://docs.pipecat.ai/server/services/video/heygen), [LemonSlice](https://docs.pipecat.ai/server/services/transport/lemonslice), [Tavus](https://docs.pipecat.ai/server/services/video/tavus), [Simli](https://docs.pipecat.ai/server/services/video/simli) |\n| Memory | [mem0](https://docs.pipecat.ai/server/services/memory/mem0) |\n| Vision \u0026 Image | [fal](https://docs.pipecat.ai/server/services/image-generation/fal), [Google Imagen](https://docs.pipecat.ai/server/services/image-generation/google-imagen), [Moondream](https://docs.pipecat.ai/server/services/vision/moondream) |\n| Audio Processing | [Silero VAD](https://docs.pipecat.ai/server/utilities/audio/silero-vad-analyzer), [Krisp Viva](https://docs.pipecat.ai/guides/features/krisp-viva), [Koala](https://docs.pipecat.ai/server/utilities/audio/koala-filter), [ai-coustics](https://docs.pipecat.ai/server/utilities/audio/aic-filter), [RNNoise](https://docs.pipecat.ai/server/utilities/audio/rnnoise-filter) |\n| Analytics \u0026 Metrics | [OpenTelemetry](https://docs.pipecat.ai/server/utilities/opentelemetry), [Sentry](https://docs.pipecat.ai/server/services/analytics/sentry) |\n| Community | [Browse community integrations →](https://docs.pipecat.ai/server/services/community-integrations) |\n\n📚 [View full services documentation →](https://docs.pipecat.ai/server/services/supported-services)\n\n## ⚡ Getting started\n\nYou can get started with Pipecat running on your local machine, then move your agent processes to the cloud when you're ready.\n\n1. Install uv\n\n ```bash\n curl -LsSf https://astral.sh/uv/install.sh | sh\n ```\n\n \u003e **Need help?** Refer to the [uv install documentation](https://docs.astral.sh/uv/getting-started/installation/).\n\n2. Install the module\n\n ```bash\n # For new projects\n uv init my-pipecat-app\n cd my-pipecat-app\n uv add pipecat-ai\n\n # Or for existing projects\n uv add pipecat-ai\n ```\n\n3. Set up your environment\n\n ```bash\n cp env.example .env\n ```\n\n4. To keep things lightweight, only the core framework is included by default. If you need support for third-party AI services, you can add the necessary dependencies with:\n\n ```bash\n uv add \"pipecat-ai[option,...]\"\n ```\n\n\u003e **Using pip?** You can still use `pip install pipecat-ai` and `pip install \"pipecat-ai[option,...]\"` to get set up.\n\n## 🧪 Code examples\n\n- [Foundational](https://github.com/pipecat-ai/pipecat/tree/main/examples) — small snippets that build on each other, introducing one or two concepts at a time\n- [Example apps](https://github.com/pipecat-ai/pipecat-examples) — complete applications that you can use as starting points for development\n\n## 🛠️ Contributing to the framework\n\n### Prerequisites\n\n**Minimum Python Version:** 3.11\n**Recommended Python Version:** \u003e= 3.12\n\n### Setup Steps\n\n1. Clone the repository and navigate to it:\n\n ```bash\n git clone https://github.com/pipecat-ai/pipecat.git\n cd pipecat\n ```\n\n2. Install development and testing dependencies:\n\n ```bash\n uv sync --group dev --all-extras \\\n --no-extra gstreamer \\\n --no-extra local \\\n ```\n\n3. Install the git pre-commit hooks:\n\n ```bash\n uv run pre-commit install\n ```\n\n\u003e **Note**: Some extras (local, gstreamer) require system dependencies. See documentation if you encounter build errors.\n\n### Claude Code Skills\n\nInstall development workflow skills for contributing to Pipecat with [Claude Code](https://claude.ai/code):\n\n```\nclaude plugin marketplace add pipecat-ai/pipecat\nclaude plugin install pipecat-dev@pipecat-dev-skills\n```\n\n### Running tests\n\nTo run all tests, from the root directory:\n\n```bash\nuv run pytest\n```\n\nRun a specific test suite:\n\n```bash\nuv run pytest tests/test_name.py\n```\n\n## 🤝 Contributing\n\nWe welcome contributions from the community! Whether you're fixing bugs, improving documentation, or adding new features, here's how you can help:\n\n- **Found a bug?** Open an [issue](https://github.com/pipecat-ai/pipecat/issues)\n- **Have a feature idea?** Start a [discussion](https://discord.gg/pipecat)\n- **Want to contribute code?** Check our [CONTRIBUTING.md](CONTRIBUTING.md) guide\n- **Documentation improvements?** [Docs](https://github.com/pipecat-ai/docs) PRs are always welcome\n\nBefore submitting a pull request, please check existing issues and PRs to avoid duplicates.\n\nWe aim to review all contributions promptly and provide constructive feedback to help get your changes merged.\n\n## 🛟 Getting help\n\n➡️ [Join our Discord](https://discord.gg/pipecat)\n\n➡️ [Read the docs](https://docs.pipecat.ai)\n\n➡️ [Reach us on X](https://x.com/pipecat_ai)\n","funding_links":[],"categories":["Python","Automation","\u003cspan id=\"game\"\u003eGame (World Model \u0026 Agent)\u003c/span\u003e","Other LLM Frameworks","Toolkits","其他LLM框架","🎙 Voice Agents","Frameworks \u0026 Platforms | 框架与平台","Repos","Learning","📋 Contents","Voice and Multimodal Agents"],"sub_categories":["Multimodal","\u003cspan id=\"tool\"\u003eLLM (LLM \u0026 Tool)\u003c/span\u003e","Videos Playlists","Codec","文章","Open-Source Voice","Comprehensive Frameworks | 综合性框架","Repositories","🖥️ 12. User Interfaces \u0026 Self-hosted Platforms","Codex Resources"],"project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fpipecat-ai%2Fpipecat","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fpipecat-ai%2Fpipecat","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fpipecat-ai%2Fpipecat/lists"}