Data

Tools

Indexes

Applications

Experiments

Awesome

An open API service indexing awesome lists of open source software.

awesome-llm-and-aigc

🚀🚀🚀A collection of some awesome public projects about Large Language Model(LLM), Vision Language Model(VLM), Vision Language Action(VLA), AI Generated Content(AIGC), the related Datasets and Applications.
https://github.com/coderonion/awesome-llm-and-aigc

Last synced: 20 days ago
JSON representation

Applications

提示语（魔法）

  • DINO - Research/DINO?style=social"/> : "DINO: DETR with Improved DeNoising Anchor Boxes for End-to-End Object Detection". (ICLR 2023).
  • DINOv2
  • GroundingDINO - Research/GroundingDINO?style=social"/> : "Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detection". (ECCV 2024).
  • lencx/ChatGPT
  • Synaptrix/ChatGPT-Desktop - Desktop?style=social"/> : Fuel your productivity with ChatGPT-Desktop - Blazingly fast and supercharged!
  • Poordeveloper/chatgpt-app - app?style=social"/> : A ChatGPT App for all platforms. Built with Rust + Tauri + Vue + Axum.
  • sonnylazuardi/chat-ai-desktop - ai-desktop?style=social"/> : Chat AI Desktop App. Unofficial ChatGPT desktop app for Mac & Windows menubar using Tauri & Rust.
  • m1guelpf/browser-agent - agent?style=social"/> : A browser AI agent, using GPT-4. docs.rs/browser-agent
  • sigoden/aichat - 3.5/GPT-4 in the terminal.
  • Cursor
  • ChatHub - dev/chathub?style=social"/> : ChatHub is an all-in-one chatbot client. chathub.gg/?utm_source=github
  • Ask-Anything - Anything?style=social"/> : [VideoChatGPT] ChatGPT with video understanding! And many more supported LMs such as miniGPT4, StableLM, and MOSS. vchat.opengvlab.com/. "VideoChat: Chat-Centric Video Understanding". (arXiv 2023).
  • InternLM/HuixiangDou - based Technical Assistance. "HuixiangDou" is a domain-specific knowledge assistant based on the LLM. “茴香豆”是一个基于 LLM 的领域知识助手。
  • a16z-infra/llama2-chatbot - infra/llama2-chatbot?style=social"/> : LLaMA 2 Chatbot App ⚡
  • fuergaosi233/wechat-chatgpt - chatgpt?style=social"/> : Use ChatGPT On Wechat via wechaty.
  • KMnO4-zx/xlab-huanhuan - zx/xlab-huanhuan?style=social"/> : Chat-甄嬛是利用《甄嬛传》剧本中所有关于甄嬛的台词和语句，基于InternLM2进行LoRA微调或全量微调得到的模仿甄嬛语气的聊天语言模型。
  • JimmyMa99/Roleplay-with-XiYou - with-XiYou?style=social"/> : Roleplay-with-XiYou 西游角色扮演。基于《西游记》原文、白话文、ChatGPT生成数据制作的，以InternLM2微调的角色扮演多LLM聊天室。 本项目将介绍关于角色扮演类 LLM 的一切，从数据获取、数据处理，到使用 XTuner 微调并部署至 OpenXLab，再到使用 LMDeploy 部署，以 openai api 的方式接入简单的聊天室，并可以观看不同角色的 LLM 互相交流、互怼。
  • LeRobot - of-the-art Machine Learning for Real-World Robotics in Pytorch.
  • BestAnHongjun/InternDog
  • GPT Pilot - io/gpt-pilot?style=social"/> : The first real AI developer. GPT Pilot doesn't just generate code, it builds apps! GPT Pilot is the core technology for the Pythagora VS Code extension that aims to provide the first real AI developer companion. Not just an autocomplete or a helper for PR messages but rather a real AI developer that can write full features, debug them, talk to you about issues, ask for review, etc.
  • StarCoder - project/starcoder?style=social"/> : 💫 StarCoder is a language model (LM) trained on source code and natural language text. Its training data incorporates more that 80 different programming languages as well as text extracted from GitHub issues and commits and from notebooks.
  • CodeGeeX2 - CN)
  • Langchain-Chatchat - space/Langchain-Chatchat?style=social"/> : lLangchain-Chatchat (formerly langchain-ChatGLM), local knowledge based LLM (like ChatGLM) QA app with langchain ｜ 基于 Langchain 与 ChatGLM 等语言模型的本地知识库问答。
  • yanqiangmiffy/Chinese-LangChain - LangChain?style=social"/> : Chinese-LangChain：中文langchain项目，基于ChatGLM-6b+langchain实现本地化知识库检索与智能答案生成。俗称：小必应，Q.Talk，强聊，QiangTalk。
  • labring/FastGPT - based question answering system built on the LLM. It offers out-of-the-box data processing and model invocation capabilities. Moreover, it allows for workflow orchestration through Flow visualization, thereby enabling complex question and answer scenarios! fastgpt.run
  • THUDM/WebGLM - enhanced Question Answering System (KDD 2023). "WebGLM: Towards An Efficient Web-Enhanced Question Answering System with Human Preferences". (arXiv 2023).
  • afaqueumer/DocQA
  • rese1f/MovieChat
  • binary-husky/gpt_academic - husky/gpt_academic?style=social"/> : 为ChatGPT/GLM提供图形交互界面，特别优化论文阅读/润色/写作体验，模块化设计，支持自定义快捷按钮&函数插件，支持Python和C++等项目剖析&自译解功能，PDF/LaTex论文翻译&总结功能，支持并行问询多种LLM模型，支持chatglm2等本地模型。兼容文心一言, moss, llama2, rwkv, claude2, 通义千问, 书生, 讯飞星火等。
  • kaixindelele/ChatPaper
  • GPTZero
  • BurhanUlTayyab/GPTZero - source implementation of GPTZero. GPTZero is an AI model with some mathematical formulation to determine if a particular text fed to it is written by AI or a human being.
  • BurhanUlTayyab/DetectGPT - source Pytorch implementation of DetectGPT. DetectGPT is an amazing method to determine whether a piece of text is written by large language models (like ChatGPT, GPT3, GPT2, BLOOM etc). However, we couldn't find any open-source implementation of it. Therefore this is the implementation of the paper. "DetectGPT: Zero-Shot Machine-Generated Text Detection using Probability Curvature". (arXiv 2023).
  • WangRongsheng/ChatGenTitle
  • nishiwen1214/ChatReviewer
  • Shiling42/web-simulator-by-GPT4 - simulator-by-GPT4?style=social"/> : Online Interactive Physical Simulation Generated by GPT-4. shilingliang.com/web-simulator-by-GPT4/
  • 本草[原名：华驼(HuaTuo) - HI/Huatuo-Llama-Med-Chinese?style=social"/> : Repo for BenTsao [original name: HuaTuo (华驼)], Llama-7B tuned with Chinese medical knowledge. 本草[原名：华驼(HuaTuo)]: 基于中文医学知识的LLaMA微调模型。本项目开源了经过中文医学指令精调/指令微调(Instruct-tuning) 的LLaMA-7B模型。我们通过医学知识图谱和GPT3.5 API构建了中文医学指令数据集，并在此基础上对LLaMA进行了指令微调，提高了LLaMA在医疗领域的问答效果。 "HuaTuo: Tuning LLaMA Model with Chinese Medical Knowledge". (arXiv 2023).
  • MedSAM - lab/MedSAM?style=social"/> : "Segment Anything in Medical Images". (arXiv 2023). "微信公众号「江大白」《MedSAM在医学领域，图像分割中的落地应用（附论文及源码）》"。
  • LLaVA-Med - Med?style=social"/> : "LLaVA-Med: Training a Large Language-and-Vision Assistant for Biomedicine in One Day". (arXiv 2023). "微信公众号「CVHub」《微软发布医学多模态大模型LLaVA-Med | 基于LLaVA的医学指令微调》"。
  • MedicalGPT
  • MedQA-ChatGLM - ChatGLM?style=social"/> : 🛰️ 基于真实医疗对话数据在ChatGLM上进行LoRA、P-Tuning V2、Freeze、RLHF等微调，我们的眼光不止于医疗问答。www.wangrs.co/MedQA-ChatGLM/. "MedQA-ChatGLM: A Medical QA Model Fine-tuned on ChatGLM Using Multiple fine-tuning Method and Real Medical QA Data".
  • xhu248/AutoSAM
  • 仲景 - world Multi-turn Dialogue". (arXiv 2023).
  • MeChat - turn to Multi-turn Inclusive Language Expansion via ChatGPT for Mental Health Support". (arXiv 2023).
  • SmartFlowAI/EmoLLM - 心理健康大模型是一系列能够支持 理解用户-支持用户-帮助用户 心理健康辅导链路的心理健康大模型，由 LLM指令微调而来。心理健康大模型、LLM、The Big Model of Mental Health、Finetune、InternLM2、Qwen、ChatGLM、Baichuan、DeepSeek、Mixtral。
  • ChatLaw - YuanGroup/ChatLaw?style=social"/> : ChatLaw-法律大模型。chatlaw.cloud/lawchat/
  • LaWGPT - song/LaWGPT?style=social"/> : 🎉 Repo for LaWGPT, Chinese-Llama tuned with Chinese Legal knowledge. LaWGPT 是一系列基于中文法律知识的开源大语言模型。该系列模型在通用中文基座模型（如 Chinese-LLaMA、ChatGLM 等）的基础上扩充法律领域专有词表、大规模中文法律语料预训练，增强了大模型在法律领域的基础语义理解能力。在此基础上，构造法律领域对话问答数据集、中国司法考试数据集进行指令精调，提升了模型对法律内容的理解和执行能力。
  • FinGPT - foundation/fingpt?style=social"/> : Data-Centric FinGPT. Open-source for open finance! Revolutionize 🔥 We'll soon release the trained model. "微信公众号「AINLPer」《FinGPT：一个「专用于金融领域」的开源大语言模型（LLM）框架，源码公开！》"。
  • Progressive-Hint - Zheng/Progressive-Hint?style=social"/> : "Progressive-Hint Prompting Improves Reasoning in Large Language Models". (arXiv 2023).
  • Goat - tuned LLaMA Outperforms GPT-4 on Arithmetic Tasks". (arXiv 2023). "微信公众号「AINLPer」《近乎完美！最强算术语言模型: Goar-7B，干翻GPT-4，怒越PaLM-540B！24G可训练》"。
  • AXYZdong/AMchat
  • GuoYiFantastic/IMelodist - IMelodist. Music large model based on InternLM2-chat.
  • flinkerlab/neural_speech_decoding - 024-00824-8)**). "微信公众号「量子位」《脑电合成自然语音！LeCun转发Nature子刊新成果，代码开源》"。
  • CLoT - sg/CLoT?style=social"/> : Creative Leap-of-Thought (CLoT). Official Codebase of our Paper: "Let's Think Outside the Box: Exploring Leap-of-Thought in Large Language Models with Creative Humor Generation" (CVPR 2024). zhongshsh.github.io/CLoT. "微信公众号「NewBeeNLP」《中山大学：“梗王”大模型，靠讲笑话登上CVPR》"。
  • SaaRaaS-1300/InternLM2_horowag - 1300/InternLM2_horowag?style=social"/> : 🍿InternLM2_Horowag🍿 🍏专门为 2024 书生·浦语大模型挑战赛 (春季赛) 准备的 Repo🍎收录了赫萝相关的微调模型。
  • SmartFlowAI/TheGodOfCookery
  • ToolBench - world APIs". (arXiv 2023).
  • DriveVLM - Language Models". (CoRL 2024). "微信公众号「清华大学交叉信息研究院」《DriveVLM：清华MARS Lab合作推出首个部署上车的自动驾驶视觉语言大模型》"。
  • UniAD - oriented Autonomous Driving". (CVPR 2023).
  • TransGPT|致远
  • LLMLight - hkust/LLMTSCS?style=social"/> : "LLMLight: Large Language Models as Traffic Signal Control Agents". (arXiv 2024).
  • llm-attacks/llm-attacks - attacks/llm-attacks?style=social"/> : "Universal and Transferable Adversarial Attacks on Aligned Language Models". (arXiv 2023). llm-attacks.org/. "微信公众号「新智元」《ChatGPT羊驼家族全沦陷！CMU博士击破LLM护栏，人类毁灭计划脱口而出》"。
  • MetaGPT - Agent Collaborative Framework". (arXiv 2023).
  • RealChar
  • FaceChain - learning toolchain for generating your Digital-Twin. FaceChain is a deep-learning toolchain for generating your Digital-Twin. With a minimum of 1 portrait-photo, you can create a Digital-Twin of your own and start generating personal portraits in different settings (multiple styles now supported!). You may train your Digital-Twin model and generate photos via FaceChain's Python scripts, or via the familiar Gradio interface. FaceChain是一个可以用来打造个人数字形象的深度学习模型工具。用户仅需要提供最低三张照片即可获得独属于自己的个人形象数字替身。FaceChain支持在gradio的界面中使用模型训练和推理能力，也支持资深开发者使用python脚本进行训练推理。
  • VirtualWife
  • GPT-vup - vup?style=social"/> : GPT-vup Live2D数字人直播。GPT-vup BIliBili | 抖音 | AI | 虚拟主播。
  • ChatVRM
  • SillyTavern
  • HeyGen
  • ChatGPT-Admin-Web - Admin-Web?style=social"/> : 带有用户管理和后台管理系统的 ChatGPT WebUI. caw.sku.moe
  • 202252197/ChatGPT_JCM
  • wieslawsoltes/ChatGPT
  • sigoden/aichat
  • amrrs/chatgpt-clone - clone?style=social"/> : Build Yo'own ChatGPT with OpenAI API & Gradio.
  • llama2-webui - eth/llama2-webui?style=social"/> : Run Llama 2 locally with gradio UI on GPU or CPU from anywhere (Linux/Windows/Mac). Supporting Llama-2-7B/13B/70B with 8-bit, 4-bit. Supporting GPU inference (6 GB VRAM) and CPU inference.
  • ricklamers/gpt-code-ui - code-ui?style=social"/> : An open source implementation of OpenAI's ChatGPT Code interpreter.
  • mckaywrigley/chatbot-ui - ui?style=social"/> :An open source ChatGPT UI. chatbotui.com
  • chieapp/chie
  • AUTOMATIC1111/stable-diffusion-webui - diffusion-webui?style=social"/> : Stable Diffusion web UI. A browser interface based on Gradio library for Stable Diffusion.
  • Mikubill/sd-webui-controlnet - webui-controlnet?style=social"/> : ControlNet for Stable Diffusion WebUI. The WebUI extension for ControlNet and other injection-based SD controls.
  • oobabooga/text-generation-webui - generation-webui?style=social"/> : Text generation web UI. A gradio web UI for running Large Language Models like LLaMA, llama.cpp, GPT-J, Pythia, OPT, and GALACTICA.
  • SolidUI - generated visualization prototyping and editing platform.
  • AIdea
  • Chainlit - like UIs on top of any Python code in minutes! docs.chainlit.io
  • YOLO-World - CVC/YOLO-World?style=social"/> : "YOLO-World: Real-Time Open-Vocabulary Object Detection". (CVPR 2024). www.yoloworld.cc
  • Autodistill
  • Lobe Chat - chat?style=social"/> : 🤯 Lobe Chat - an open-source, modern-design AI chat framework. Supports Multi AI Providers( OpenAI / Claude 3 / Gemini / Ollama / Qwen / DeepSeek), Knowledge Base (file upload / knowledge management / RAG ), Multi-Modals (Vision/TTS/Plugins/Artifacts). One-click FREE deployment of your private ChatGPT/ Claude application. chat-preview.lobehub.com
  • VideoChat - 23/VideoChat?style=social"/> : 实时语音交互数字人，支持端到端语音方案（GLM-4-Voice - THG）和级联方案（ASR-LLM-TTS-THG）。可自定义形象与音色，无须训练，支持音色克隆，首包延迟低至3s。Real-time voice interactive digital human, supporting end-to-end voice solutions (GLM-4-Voice - THG) and cascaded solutions (ASR-LLM-TTS-THG). Customizable appearance and voice, supporting voice cloning, with initial package delay as low as 3s.
  • DOSOD - Robotics-AI-Lab/DOSOD?style=social"/> : "A Light-Weight Framework for Open-Set Object Detection with Decoupled Feature Alignment in Joint Space". (arXiv 2024).
  • OpenEMMA - group/OpenEMMA?style=social"/> : "OpenEMMA: Open-Source Multimodal Model for End-to-End Autonomous Driving". (arXiv 2024).
  • SmartSchoolAI/ai-to-pptx - to-pptx?style=social"/> : Ai-to-pptx是一个使用AI技术(DeepSeek)制作PPTX的助手，支持在线生成和导出PPTX。 前端后端同时开源。 主要功能: 1 使用DeepSeek等大语言模型来生成大纲 2 生成PPTX的时候可以选择不同的模板 3 支持导出PPTX。pptx.dandian.net
  • HiveChat - sized teams, supporting models such as Deepseek, Open AI, Claude, and Gemini. 专为中小团队设计的 AI 聊天应用，支持 Deepseek、Open AI、Claude、Gemini 等模型。
  • OpenManus
  • MemGPT - term memory and custom tools 📚🦙. memgpt.readme.io
  • yetone/openai-translator - translator?style=social"/> : The translator that does more than just translation - powered by OpenAI.
  • privateGPT - ai/langchain), GPT4All, LlamaCpp, Chroma and SentenceTransformers.
  • ChatGPT-Next-Web - Next-Web?style=social"/> : A well-designed cross-platform ChatGPT UI (Web / PWA / Linux / Win / MacOS). 一键拥有你自己的跨平台 ChatGPT 应用。
  • Code Llama
  • cLangUI
  • DoctorGPT - platform, & your health data stays private.

Blogs

数据集