Large Language Model | Ecosyste.ms: Awesome

https://github.com/SWE-agent/SWE-agent

[NeurIPS 2024] SWE-agent takes a GitHub issue and tries to automatically fix it, using GPT-4, or your LM of choice. It can also be employed for offensive cybersecurity or competitive coding challenges.

agent agent-based-model ai cybersecurity developer-tools llm lms

Last synced: 07 Aug 2025

https://princeton-nlp.github.io/SWE-agent

[NeurIPS 2024] SWE-agent takes a GitHub issue and tries to automatically fix it, using GPT-4, or your LM of choice. It can also be employed for offensive cybersecurity or competitive coding challenges.

agent agent-based-model ai cybersecurity developer-tools llm lms

Last synced: 11 Sep 2025

https://github.com/botpress/botpress

The open-source hub to build & deploy GPT/LLM Agents ⚡️

agent ai botpress chatbot chatgpt gpt gpt-4 langchain llm nlp openai prompt

Last synced: 08 Oct 2025

https://github.com/stas00/ml-engineering

Machine Learning Engineering Open Book

ai inference large-language-models llm machine-learning machine-learning-engineering mlops pytorch scalability slurm training transformers

Last synced: 14 May 2025

https://github.com/sgl-project/sglang

SGLang is a fast serving framework for large language models and vision language models.

cuda deepseek deepseek-llm deepseek-r1 deepseek-r1-zero deepseek-v3 inference llama llama3 llama3-1 llava llm llm-serving moe pytorch transformer vlm

Last synced: 12 May 2025

https://github.com/eosphoros-ai/DB-GPT

AI Native Data App Development framework with AWEL(Agentic Workflow Expression Language) and Agents

agents bgi database gpt gpt-4 hacktoberfest langchain llm private rag security vicuna

Last synced: 27 Mar 2025

https://github.com/skyvern-ai/skyvern

Automate browser-based workflows with LLMs and Computer Vision

api automation browser browser-automation computer gpt llm playwright python rpa vision workflow

Last synced: 12 May 2025

https://github.com/llmware-ai/llmware

Unified framework for building enterprise RAG pipelines with small, specialized models

agents generative-ai-tools llamacpp llm onnx openvino parsing retrieval-augmented-generation small-specialized-models

Last synced: 12 May 2025

https://github.com/cocktailpeanut/dalai

The simplest way to run LLaMA on your local machine

ai llama llm

Last synced: 13 May 2025

https://cocktailpeanut.github.io/dalai/

The simplest way to run LLaMA on your local machine

ai llama llm

Last synced: 25 Sep 2025

https://github.com/alibaba/mnn

MNN is a blazing fast, lightweight deep learning framework, battle-tested by business-critical use cases in Alibaba. Full multimodal LLM Android App:[MNN-LLM-Android](./apps/Android/MnnLlmChat/README.md). MNN TaoAvatar Android - Local 3D Avatar Intelligence: apps/Android/Mnn3dAvatar/README.md

arm convolution deep-learning embedded-devices llm machine-learning ml mnn transformer vulkan winograd-algorithm

Last synced: 09 Sep 2025

https://github.com/mastra-ai/mastra

The TypeScript AI agent framework. ⚡ Assistants, RAG, observability. Supports any LLM: GPT-4, Claude, Gemini, Llama.

agents ai chatbots evals javascript llm mcp nextjs nodejs reactjs tts typescript workflows

Last synced: 14 May 2025

https://github.com/Skyvern-AI/skyvern

Automate browser-based workflows with LLMs and Computer Vision

api automation browser browser-automation computer gpt llm playwright python rpa vision workflow

Last synced: 07 Apr 2025

https://github.com/paddlepaddle/paddlenlp

Easy-to-use and powerful LLM and SLM library with awesome model zoo.

bert compression distributed-training document-intelligence embedding ernie information-extraction llama llm neural-search nlp paddlenlp pretrained-models question-answering search-engine semantic-analysis sentiment-analysis transformers uie

Last synced: 09 Sep 2025

https://github.com/Skyvern-AI/Skyvern

Automate browser-based workflows with LLMs and Computer Vision

api automation browser browser-automation computer gpt llm playwright python rpa vision workflow

Last synced: 09 Mar 2025

https://github.com/78/xiaozhi-esp32

Build your own AI friend

chatbot esp32 llm

Last synced: 14 May 2025

https://github.com/voideditor/void

chatgpt claude copilot cursor developer-tools editor llm open-source openai visual-studio-code vscode vscode-extension

Last synced: 14 May 2025

https://github.com/CopilotKit/CopilotKit

React UI + elegant infrastructure for AI Copilots, in-app AI agents, AI chatbots, and AI-powered Textareas 🪁

agent agents ai ai-agent ai-assistant assistant copilot copilot-chat hacktoberfest langchain langgraph llm nextjs open-source react reactjs ts typescript

Last synced: 24 Mar 2025

https://github.com/PaddlePaddle/PaddleNLP

👑 Easy-to-use and powerful NLP and LLM library with 🤗 Awesome model zoo, supporting wide-range of NLP tasks from research to industrial applications, including 🗂Text Classification, 🔍 Neural Search, ❓ Question Answering, ℹ️ Information Extraction, 📄 Document Intelligence, 💌 Sentiment Analysis etc.

bert compression distributed-training document-intelligence embedding ernie information-extraction llama llm neural-search nlp paddlenlp pretrained-models question-answering search-engine semantic-analysis sentiment-analysis transformers uie

Last synced: 18 Mar 2025

https://github.com/HKUDS/LightRAG

"LightRAG: Simple and Fast Retrieval-Augmented Generation"

genai gpt gpt-4 graphrag knowledge-graph large-language-models llm rag retrieval-augmented-generation

Last synced: 27 Feb 2025

https://github.com/lightning-ai/litgpt

20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale.

ai artificial-intelligence deep-learning large-language-models llm llm-inference llms

Last synced: 12 May 2025

https://github.com/1Panel-dev/MaxKB

💬 Ready-to-use, flexible RAG Chatbot.

chatbot knowledgebase langchain llm maxkb ollama pgvector rag

Last synced: 24 Mar 2025

https://github.com/shishirpatil/gorilla

Gorilla: Training and Evaluating LLMs for Function Calls (Tool Calls)

api api-documentation chatgpt claude-api gpt-4-api llm openai-api openai-functions

Last synced: 13 May 2025

https://github.com/vercel-labs/ai

Build AI-powered applications with React, Svelte, Vue, and Solid

artificial-intelligence generative-ai generative-ui huggingface javascript language-model llm nextjs openai react solidjs svelte typescript vercel vue

Last synced: 20 Feb 2025

https://github.com/nirdiamant/genai_agents

This repository provides tutorials and implementations for various Generative AI Agent techniques, from basic to advanced. It serves as a comprehensive guide for building intelligent, interactive AI systems.

agents ai genai langchain langgraph llm llms openai tutorials

Last synced: 15 May 2025

https://github.com/Lightning-AI/litgpt

20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale.

ai artificial-intelligence deep-learning large-language-models llm llm-inference llms

Last synced: 26 Mar 2025

https://github.com/eugeneyan/open-llms

📋 A list of open LLMs available for commercial use.

commercial large-language-models llm llms

Last synced: 26 Mar 2025

https://github.com/h2oai/h2ogpt

Private chat with local GPT with document, images, video, etc. 100% private, Apache 2.0. Supports oLLaMa, Mixtral, llama.cpp, and more. Demo: https://gpt.h2o.ai/ https://gpt-docs.h2o.ai/

ai chatgpt embeddings generative gpt gpt4all llama2 llm mixtral pdf private privategpt vectorstore

Last synced: 13 May 2025

https://github.com/zai-org/CogVideo

text and image to video generation: CogVideoX (2024) and CogVideo (ICLR 2023)

cogvideox image-to-video llm sora text-to-video video-generation

Last synced: 30 Jul 2025

https://github.com/ShishirPatil/gorilla

Gorilla: Training and Evaluating LLMs for Function Calls (Tool Calls)

api api-documentation chatgpt claude-api gpt-4-api llm openai-api openai-functions

Last synced: 27 Mar 2025

https://github.com/rucaibox/llmsurvey

The official GitHub page for the survey paper "A Survey of Large Language Models".

chain-of-thought chatgpt in-context-learning instruction-tuning large-language-models llm llms natural-language-processing pre-trained-language-models pre-training rlhf

Last synced: 11 May 2025

https://github.com/ludwig-ai/ludwig

Low-code framework for building custom LLMs, neural networks, and other AI models

computer-vision data-centric data-science deep deep-learning deeplearning fine-tuning learning llama llama2 llm llm-training machine-learning machinelearning mistral ml natural-language natural-language-processing neural-network pytorch

Last synced: 23 Oct 2025

https://github.com/uber/ludwig

Low-code framework for building custom LLMs, neural networks, and other AI models

computer-vision data-centric data-science deep deep-learning deeplearning fine-tuning learning llama llama2 llm llm-training machine-learning machinelearning mistral ml natural-language natural-language-processing neural-network pytorch

Last synced: 24 Apr 2025

https://github.com/thudm/cogvideo

text and image to video generation: CogVideoX (2024) and CogVideo (ICLR 2023)

cogvideox image-to-video llm sora text-to-video video-generation

Last synced: 16 May 2025

https://github.com/bentoml/openllm

Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.

bentoml fine-tuning llama llama2 llama3-1 llama3-2 llama3-2-vision llm llm-inference llm-ops llm-serving llmops mistral mlops model-inference open-source-llm openllm vicuna

Last synced: 23 Oct 2025

https://github.com/unstructured-io/unstructured

Open source libraries and APIs to build custom preprocessing pipelines for labeling, training, or production machine learning pipelines.

data-pipelines deep-learning document-image-analysis document-image-processing document-parser document-parsing docx donut information-retrieval langchain llm machine-learning ml natural-language-processing nlp ocr pdf pdf-to-json pdf-to-text preprocessing

Last synced: 09 Sep 2025

https://github.com/langfuse/langfuse

🪢 Open source LLM engineering platform: LLM Observability, metrics, evals, prompt management, playground, datasets. Integrates with OpenTelemetry, Langchain, OpenAI SDK, LiteLLM, and more. 🍊YC W23

analytics autogen evaluation langchain large-language-models llama-index llm llm-evaluation llm-observability llmops monitoring observability open-source openai playground prompt-engineering prompt-management self-hosted ycombinator

Last synced: 13 May 2025

https://github.com/THUDM/CogVideo

text and image to video generation: CogVideoX (2024) and CogVideo (ICLR 2023)

cogvideox image-to-video llm sora text-to-video video-generation

Last synced: 28 Mar 2025

https://github.com/jujumilk3/leaked-system-prompts

Collection of leaked system prompts

llm prompt

Last synced: 10 Jul 2025

https://github.com/rockchinq/langbot

😎简单易用、🧩丰富生态 - 大模型原生即时通信机器人平台 | 适配 QQ / 微信（企业微信、个人微信）/ 飞书 / 钉钉 / Discord / Telegram / Slack 等平台 | 支持 ChatGPT、DeepSeek、Dify、Claude、Gemini、xAI、PPIO、Ollama、LM Studio、阿里云百炼、火山方舟、SiliconFlow、Qwen、Moonshot、ChatGLM、SillyTraven、MCP 等 LLM 的机器人 / Agent | LLM-based instant messaging bots platform, supports Discord, Telegram, WeChat, Lark, DingTalk, QQ, Slack

agent chatgpt deepseeek dify llm openai plugins qq telegram wechat

Last synced: 10 May 2025

https://github.com/RockChinQ/LangBot

😎简单易用、🧩丰富生态 - 大模型原生即时通信机器人平台 | 适配 QQ / 微信（企业微信、个人微信）/ 飞书 / 钉钉 / Discord / Telegram / Slack 等平台 | 支持 ChatGPT、DeepSeek、Dify、Claude、Gemini、xAI、PPIO、Ollama、LM Studio、阿里云百炼、火山方舟、SiliconFlow、Qwen、Moonshot、ChatGLM、SillyTraven、MCP 等 LLM 的机器人 / Agent | LLM-based instant messaging bots platform, supports Discord, Telegram, WeChat, Lark, DingTalk, QQ, Slack

agent chatgpt deepseeek dify llm openai plugins qq telegram wechat

Last synced: 11 May 2025

https://github.com/getumbrel/llama-gpt

A self-hosted, offline, ChatGPT-like chatbot. Powered by Llama 2. 100% private, with no data leaving your device. New: Code Llama support!

ai chatgpt code-llama codellama gpt gpt-4 gpt4all llama llama-2 llama-cpp llama2 llamacpp llm localai openai self-hosted

Last synced: 13 May 2025

https://github.com/neuml/txtai

💡 All-in-one open-source AI framework for semantic search, LLM orchestration and language model workflows

ai artificial-intelligence embeddings information-retrieval language-model large-language-models llm machine-learning nlp python rag retrieval-augmented-generation search search-engine semantic-search sentence-embeddings transformers txtai vector-database vector-search

Last synced: 12 May 2025

https://github.com/ther1d/shell_gpt

A command-line productivity tool powered by AI large language models like GPT-4, will help you accomplish your tasks faster and more efficiently.

chatgpt cheat-sheet cli commands gpt-3 gpt-4 linux llama llm ollama openai productivity python shell terminal

Last synced: 23 Apr 2025

https://github.com/googlecloudplatform/generative-ai

Sample code and notebooks for Generative AI on Google Cloud, with Gemini on Vertex AI

gcp gemini gemini-api gen-ai generative-ai google google-cloud google-gemini langchain large-language-models llm vertex-ai vertex-ai-gemini-api vertexai

Last synced: 12 May 2025

https://github.com/tensorzero/tensorzero

TensorZero is an open-source stack for industrial-grade LLM applications. It unifies an LLM gateway, observability, optimization, evaluation, and experimentation.

ai ai-engineering anthropic artificial-intelligence deep-learning genai generative-ai gpt large-language-models llama llm llmops llms machine-learning ml ml-engineering mlops openai python rust

Last synced: 23 Oct 2025

https://github.com/RockChinQ/QChatGPT

😎简单易用、🧩丰富生态 - 大模型原生即时通信机器人平台 | 适配 QQ / 微信（企业微信、个人微信）/ 飞书 / 钉钉 / Discord / Telegram / Slack 等平台 | 支持 ChatGPT、DeepSeek、Dify、Claude、Gemini、xAI Grok、Ollama、LM Studio、阿里云百炼、火山方舟、SiliconFlow、Qwen、Moonshot、ChatGLM、SillyTraven、MCP 等 LLM 的机器人 / Agent | LLM-based instant messaging bots platform, supports Discord, Telegram, WeChat, Lark, DingTalk, QQ, Slack

agent chatgpt deepseeek dify llm openai plugins qq telegram wechat

Last synced: 16 Apr 2025

https://github.com/explodinggradients/ragas

Supercharge Your LLM Application Evaluations 🚀

evaluation llm llmops

Last synced: 22 Aug 2025

https://github.com/microsoft/promptflow

Build high-quality LLM apps - from prototyping, testing to production deployment and monitoring.

ai ai-application-development ai-applications chatgpt gpt llm prompt prompt-engineering

Last synced: 12 May 2025

https://github.com/RUCAIBox/LLMSurvey

The official GitHub page for the survey paper "A Survey of Large Language Models".

chain-of-thought chatgpt in-context-learning instruction-tuning large-language-models llm llms natural-language-processing pre-trained-language-models pre-training rlhf

Last synced: 14 Mar 2025

https://github.com/mistralai/mistral-inference

Official inference library for Mistral models

llm llm-inference mistralai

Last synced: 12 May 2025

https://github.com/mistralai/mistral-inference?tab=readme-ov-file

Official inference library for Mistral models

llm llm-inference mistralai

Last synced: 16 Mar 2025

https://github.com/bentoml/OpenLLM

Run any open-source LLMs, such as Llama 3.1, Gemma, as OpenAI compatible API endpoint in the cloud.

bentoml fine-tuning llama llama2 llama3-1 llama3-2 llama3-2-vision llm llm-inference llm-ops llm-serving llmops mistral mlops model-inference open-source-llm openllm vicuna

Last synced: 14 Mar 2025

https://github.com/openai/openai-agents-python

A lightweight, powerful framework for multi-agent workflows

agents ai framework llm openai python

Last synced: 18 Nov 2025

https://github.com/GoogleCloudPlatform/generative-ai

Sample code and notebooks for Generative AI on Google Cloud, with Gemini on Vertex AI

gemini gemini-api generative-ai google google-cloud google-gemini langchain llm palm-api vertex-ai vertex-ai-gemini-api vertexai

Last synced: 17 Mar 2025

https://github.com/chainlit/chainlit

Build Conversational AI in minutes ⚡️

chatgpt langchain llm openai openai-chatgpt python ui

Last synced: 08 Oct 2025

https://github.com/flagopen/flagembedding

Retrieval and Retrieval-augmented LLMs

embeddings information-retrieval llm retrieval-augmented-generation sentence-embeddings text-semantic-similarity

Last synced: 12 May 2025

https://github.com/TheR1D/shell_gpt

A command-line productivity tool powered by AI large language models like GPT-4, will help you accomplish your tasks faster and more efficiently.

chatgpt cheat-sheet cli commands gpt-3 gpt-4 linux llama llm ollama openai productivity python shell terminal

Last synced: 20 Mar 2025

https://github.com/netflix/metaflow

Build, Manage and Deploy AI/ML Systems

agents ai aws azure data-science datascience gcp generative-ai high-performance-computing kubernetes llm llmops machine-learning ml ml-infrastructure ml-platform mlops model-management python

Last synced: 09 Sep 2025

https://github.com/Unstructured-IO/unstructured

Open source libraries and APIs to build custom preprocessing pipelines for labeling, training, or production machine learning pipelines.

data-pipelines deep-learning document-image-analysis document-image-processing document-parser document-parsing docx donut information-retrieval langchain llm machine-learning ml natural-language-processing nlp ocr pdf pdf-to-json pdf-to-text preprocessing

Last synced: 26 Mar 2025

https://github.com/doocs/md

✍ WeChat Markdown Editor | 一款高度简洁的微信 Markdown 编辑器：支持 Markdown 语法、自定义主题样式、内容管理、多图床、AI 助手等特性

ai-bot doocs editor llm markdown markdown-editor tailwindcss vite vue vue3 wechat weixin

Last synced: 12 May 2025

https://github.com/NirDiamant/RAG_Techniques

This repository showcases various advanced techniques for Retrieval-Augmented Generation (RAG) systems. RAG systems combine information retrieval with generative models to provide accurate and contextually rich responses.

ai langchain llama-index llm llms opeani python rag tutorials

Last synced: 21 Aug 2025

https://github.com/langchain4j/langchain4j

LangChain4j is an open-source Java library that simplifies the integration of LLMs into Java applications through a unified API, providing access to popular LLMs and vector databases. It makes implementing RAG, tool calling (including support for MCP), and agents easy. LangChain4j integrates seamlessly with various enterprise Java frameworks.

anthropic chatgpt chroma embeddings gemini gpt huggingface java langchain llama llm llms milvus ollama onnx openai openai-api pgvector pinecone vector-database

Last synced: 08 Oct 2025

https://neuml.github.io/txtai/

💡 All-in-one open-source embeddings database for semantic search, LLM orchestration and language model workflows

embeddings information-retrieval language-model large-language-models llm machine-learning neural-search nlp python rag retrieval-augmented-generation search search-engine semantic-search sentence-embeddings transformers txtai vector-database vector-search vector-search-engine

Last synced: 25 Sep 2025

https://github.com/jlowin/fastmcp

🚀 The fast, Pythonic way to build MCP servers and clients

fastmcp llm mcp mcp-client mcp-server model-context-protocol

Last synced: 13 May 2025

https://github.com/huggingface/chat-ui

Open source codebase powering the HuggingChat app

chatgpt hacktoberfest huggingface llm svelte svelte-kit sveltekit tailwindcss typescript

Last synced: 19 Oct 2025

https://github.com/nirdiamant/agents-towards-production

This repository delivers end-to-end, code-first tutorials covering every layer of production-grade GenAI agents, guiding you from spark to scale with proven patterns and reusable blueprints for real-world launches.

agent agent-framework agents ai-agents genai generative-ai llm llms mlops multi-agent production tool-integration tutorials

Last synced: 19 Oct 2025

https://github.com/explodinggradients/ragas?tab=readme-ov-file

Supercharge Your LLM Application Evaluations 🚀

evaluation llm llmops

Last synced: 04 Apr 2025

https://github.com/activeloopai/deeplake

Database for AI. Store Vectors, Images, Texts, Videos, etc. Use with LLMs/LangChain. Store, query, version, & visualize any AI data. Stream data in real-time to PyTorch/TensorFlow. https://activeloop.ai

ai computer-vision cv data-science datalake datasets deep-learning image-processing langchain large-language-models llm machine-learning ml mlops multi-modal python pytorch tensorflow vector-database vector-search

Last synced: 13 May 2025

https://github.com/FlagOpen/FlagEmbedding

Retrieval and Retrieval-augmented LLMs

embeddings information-retrieval llm retrieval-augmented-generation sentence-embeddings text-semantic-similarity

Last synced: 28 Mar 2025

https://github.com/microsoft/typechat

TypeChat is a library that makes it easy to build natural language interfaces using types.

ai llm natural-language types

Last synced: 13 May 2025

https://github.com/intel/ipex-llm

Accelerate local LLM inference and finetuning (LLaMA, Mistral, ChatGLM, Qwen, DeepSeek, Mixtral, Gemma, Phi, MiniCPM, Qwen-VL, MiniCPM-V, etc.) on Intel XPU (e.g., local PC with iGPU and NPU, discrete GPU such as Arc, Flex and Max); seamlessly integrate with llama.cpp, Ollama, HuggingFace, LangChain, LlamaIndex, vLLM, DeepSpeed, Axolotl, etc.

gpu llm pytorch transformers

Last synced: 13 Nov 2025

https://github.com/microsoft/TypeChat

TypeChat is a library that makes it easy to build natural language interfaces using types.

ai llm natural-language types

Last synced: 28 Mar 2025

https://github.com/nebuly-ai/optimate

A collection of libraries to optimise AI model performances

ai analytics artificial-intelligence deeplearning large-language-models llm

Last synced: 14 May 2025

https://github.com/nebuly-ai/nebullvm

A collection of libraries to optimise AI model performances

ai analytics artificial-intelligence deeplearning large-language-models llm

Last synced: 16 Mar 2025

https://github.com/fishaudio/Bert-VITS2

vits2 backbone with multilingual-bert

agent bert bert-vits bert-vits2 fish fish-speech llm tts vits vits2 vocoder

Last synced: 27 Mar 2025

https://microsoft.github.io/promptflow/

Build high-quality LLM apps - from prototyping, testing to production deployment and monitoring.

ai ai-application-development ai-applications chatgpt gpt llm prompt prompt-engineering

Last synced: 10 May 2025

https://github.com/dataelement/bisheng

BISHENG is an open LLM devops platform for next generation Enterprise AI applications. Powerful and comprehensive features include: GenAI workflow, RAG, Agent, Unified model management, Evaluation, SFT, Dataset Management, Enterprise-level System Management, Observability and more.

agent ai chatbot enterprise finetune genai gpt langchian llama llm llmdevops llmops ocr openai orchestration python rag react sft workflow

Last synced: 14 May 2025

https://github.com/greydgl/pentestgpt

A GPT-empowered penetration testing tool

large-language-models llm penetration-testing python

Last synced: 11 May 2025

https://github.com/sjtu-ipads/powerinfer

High-speed Large Language Model Serving for Local Deployment

large-language-models llama llm llm-inference local-inference

Last synced: 12 May 2025

https://github.com/e2b-dev/e2b

Secure open source cloud runtime for AI apps & AI agents

agent ai ai-agent ai-agents code-interpreter copilot development devtools gpt gpt-4 javascript llm nextjs openai python react software typescript

Last synced: 12 May 2025

https://github.com/leptonai/search_with_lepton

Building a quick conversation-based search demo with Lepton AI.

ai ai-applications leptonai llm

Last synced: 24 Oct 2025

https://github.com/SJTU-IPADS/PowerInfer

High-speed Large Language Model Serving on PCs with Consumer-grade GPUs

bamboo-7b falcon large-language-models llama llm llm-inference local-inference

Last synced: 18 Mar 2025

https://github.com/GreyDGL/PentestGPT

A GPT-empowered penetration testing tool

large-language-models llm penetration-testing python

Last synced: 15 Mar 2025

https://github.com/astrbotdevs/astrbot

✨ 易上手的多平台 LLM 聊天机器人及开发框架 ✨ 平台支持 QQ、QQ频道、Telegram、微信、企微、飞书 | MCP 服务器、OpenAI、DeepSeek、Gemini、硅基流动、月之暗面、Ollama、OneAPI、Dify 等。附带 WebUI。

agent ai chatbot chatgpt docker gemini gpt llama llm mcp openai python qq qqbot qqchannel telegram

Last synced: 28 Nov 2025

https://github.com/comet-ml/opik

Debug, evaluate, and monitor your LLM applications, RAG systems, and agentic workflows with comprehensive tracing, automated evaluations, and production-ready dashboards.

langchain llama-index llm llm-evaluation llm-observability llmops open-source openai playground prompt-engineering

Last synced: 13 May 2025

https://github.com/xorbitsai/inference

Replace OpenAI GPT with another LLM in your app by changing a single line of code. Xinference gives you the freedom to use any LLM you need. With Xinference, you're empowered to run inference with any open-source language models, speech recognition models, and multimodal models, whether in the cloud, on-premises, or even on your laptop.

artificial-intelligence chatglm deployment flan-t5 gemma ggml glm4 inference llama llama3 llamacpp llm machine-learning mistral openai-api pytorch qwen vllm whisper wizardlm

Last synced: 13 May 2025

https://github.com/agentscope-ai/agentscope

Start building LLM-empowered multi-agent applications in an easier way.

agent chatbot distributed-agents drag-and-drop gpt-4 gpt-4o large-language-models llama3 llm llm-agent mcp multi-agent multi-modal

Last synced: 17 Aug 2025

https://github.com/bentoml/bentoml

The easiest way to serve AI apps and models - Build Model Inference APIs, Job queues, LLM apps, Multi-model pipelines, and more!

ai-inference deep-learning generative-ai inference-platform llm llm-inference llm-serving llmops machine-learning ml-engineering mlops model-inference-service model-serving multimodal python

Last synced: 12 May 2025

https://github.com/canner/wrenai

🤖 Open-source GenBI AI Agent that empowers data-driven teams to chat with their data to generate Text-to-SQL, charts, spreadsheets, reports, dashboards and BI. 📈📊📋🧑‍💻

agent anthropic bedrock bigquery business-intelligence charts duckdb genbi llm openai postgresql rag spreadsheets sql sqlai text-to-sql text2sql vertex

Last synced: 12 May 2025

https://github.com/zilliztech/gptcache

Semantic cache for LLMs. Fully integrated with LangChain and llama_index.

aigc autogpt babyagi chatbot chatgpt chatgpt-api dolly gpt langchain llama llama-index llm memcache milvus openai redis semantic-search similarity-search vector-search

Last synced: 12 May 2025

https://github.com/opengvlab/internvl

[CVPR 2024 Oral] InternVL Family: A Pioneering Open-Source Alternative to GPT-4o. 接近GPT-4o表现的开源多模态对话模型

gpt gpt-4o gpt-4v image-classification image-text-retrieval llm multi-modal semantic-segmentation video-classification vision-language-model vit-22b vit-6b

Last synced: 12 May 2025

https://github.com/zilliztech/GPTCache

Semantic cache for LLMs. Fully integrated with LangChain and llama_index.

aigc autogpt babyagi chatbot chatgpt chatgpt-api dolly gpt langchain llama llama-index llm memcache milvus openai redis semantic-search similarity-search vector-search

Last synced: 24 Mar 2025

https://github.com/modelscope/ms-swift

Use PEFT or Full-parameter to CPT/SFT/DPO/GRPO 500+ LLMs (Qwen3, Qwen3-MoE, Llama4, InternLM3, GLM4, Mistral, Yi1.5, DeepSeek-R1, ...) and 200+ MLLMs (Qwen2.5-VL, Qwen2.5-Omni, Qwen2-Audio, Ovis2, InternVL3, Llava, MiniCPM-V-2.6, GLM4v, Xcomposer2.5, DeepSeek-VL2, Phi4, GOT-OCR2, ...).

deepseek-r1 deploy embedding grpo internvl liger llama llama4 llm lora megatron multimodal omni open-r1 peft qwen2-vl qwen3 qwen3-moe rft sft