Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

https://github.com/HqWu-HITCS/Awesome-Chinese-LLM

整理开源的中文大语言模型,以规模较小、可私有化部署、训练成本较低的模型为主,包括底座模型,垂直领域微调及应用,数据集与教程等。

awesome-lists chatglm chinese llama llm nlp

Last synced: 06 Jul 2024

https://github.com/meta-llama/llama-recipes

Scripts for fine-tuning Meta Llama3 with composable FSDP & PEFT methods to cover single/multi-node GPUs. Supports default & custom datasets for applications such as summarization and Q&A. Supporting a number of candid inference solutions such as HF TGI, VLLM for local or cloud deployment. Demo apps to showcase Meta Llama3 for WhatsApp & Messenger.

ai finetuning langchain llama llama2 llm machine-learning python pytorch vllm

Last synced: 05 Jul 2024

https://github.com/l294265421/alpaca-rlhf

Finetuning LLaMA with RLHF (Reinforcement Learning with Human Feedback) based on DeepSpeed Chat

alpaca chatgpt language-model large-language-models llama llm reinforcement-learning rlhf

Last synced: 04 Jul 2024

https://github.com/jianzhnie/open-chatgpt

The open source implementation of ChatGPT, Alpaca, Vicuna and RLHF Pipeline. 从0开始实现一个ChatGPT.

chatgpt gpt llama llm lora peft ppo rlhf stanford-alpaca

Last synced: 04 Jul 2024

https://github.com/theodo-group/GenossGPT

One API for all LLMs either Private or Public (Anthropic, Llama V2, GPT 3.5/4, Vertex, GPT4ALL, HuggingFace ...) 🌈🐂 Replace OpenAI GPT with any LLMs in your app with one line.

api gpt gpt4all huggingface inference llama llm openai private public

Last synced: 04 Jul 2024

https://github.com/gbaptista/ollama-ai

A Ruby gem for interacting with Ollama's API that allows you to run open source AI LLMs (Large Language Models) locally.

ai alpaca bakllava dolphin llama llama2 llava llm mistral mistral-ai mixtral nano-bots ollama ollama-api openorca vicuna

Last synced: 03 Jul 2024

https://github.com/yoshoku/llama_cpp.rb

llama_cpp provides Ruby bindings for llama.cpp

ai gem llama llm ruby

Last synced: 03 Jul 2024

https://github.com/alexrozanski/LlamaChat

Chat with your favourite LLaMA models in a native macOS app

ai llama llamacpp machine-learning macos swift swiftui

Last synced: 02 Jul 2024

https://github.com/Mobile-Artificial-Intelligence/maid_llm

maid_llm is a dart implementation of llama.cpp used by the mobile artificial intelligence distribution (maid)

facebook flutter-ai gemma ggml gguf llama llama2 llamacpp llm llm-inference local-ai meta mistral mixtral mobile-ai

Last synced: 01 Jul 2024

https://github.com/the-finai/pixiu

This repository introduces PIXIU, an open-source resource featuring the first financial large language models (LLMs), instruction tuning data, and evaluation benchmarks to holistically assess financial LLMs. Our goal is to continually push forward the open-source development of financial artificial intelligence (AI).

aifinance chatgpt fintech gpt-4 large-language-models llama machine-learning named-entity-recognition natural-language-processing nlp pixiu question-answering sentiment-analysis stock-price-prediction text-classification

Last synced: 29 Jun 2024

https://github.com/ukairia777/tensorflow-nlp-tutorial

tensorflow를 사용하여 텍스트 전처리부터, Topic Models, BERT, GPT, LLM과 같은 최신 모델의 다운스트림 태스크들을 정리한 Deep Learning NLP 저장소입니다.

bert bert-ner dpo huggingface keras-tutorial llama llm lora named-entity-recognition natural-language-processing nlp nlp-tutorial question-answering sft tensorflow trainer transformers

Last synced: 29 Jun 2024

https://github.com/Troyanovsky/Local-LLM-Comparison-Colab-UI

Compare the performance of different LLM that can be deployed locally on consumer hardware. Run yourself with Colab WebUI.

ai gpt llama llm

Last synced: 28 Jun 2024

https://github.com/Guitaricet/relora

Official code for ReLoRA from the paper Stack More Layers Differently: High-Rank Training Through Low-Rank Updates

deep-learning distributed-training llama nlp peft transformer

Last synced: 28 Jun 2024

https://github.com/jmorganca/ollama

Get up and running with Llama 3, Mistral, Gemma, and other large language models.

gemma go golang llama llama2 llama3 llava llm llms mistral ollama phi3

Last synced: 26 Jun 2024

https://github.com/zhudotexe/kani

kani (カニ) is a highly hackable microframework for chat-based language models with tool use/function calling. (NLP-OSS @ EMNLP 2023)

chatgpt claude-2 framework function-calling gpt-3 gpt-4 large-language-models llama llama-2 llms microframework openai tool-use

Last synced: 26 Jun 2024

https://github.com/predibase/lorax

Multi-LoRA inference server that scales to 1000s of fine-tuned LLMs

fine-tuning gpt llama llm llm-inference llm-serving llmops lora model-serving pytorch transformers

Last synced: 26 Jun 2024

https://github.com/lawwu/awesome-llamas

Awesome repositories for LLaMA1 and LLaMA2

llama llama2

Last synced: 26 Jun 2024

https://github.com/OpenBMB/RepoAgent

An LLM-powered repository agent designed to assist developers and teams in generating documentation and understanding repositories quickly.

agent chatglm chatgpt chatgpt-api gpt gpt-4 langchain llama llama-index llms qwen rag repo-level-debugging

Last synced: 25 Jun 2024

https://github.com/airaria/Visual-Chinese-LLaMA-Alpaca

多模态中文LLaMA&Alpaca大语言模型(VisualCLA)

alpaca chinese llama llm lora multimodal nlp vision-language

Last synced: 23 Jun 2024

https://loraexchange.ai

Multi-LoRA inference server that scales to 1000s of fine-tuned LLMs

fine-tuning gpt llama llm llm-inference llm-serving llmops lora model-serving pytorch transformers

Last synced: 21 Jun 2024

https://github.com/TinyLLaVA/TinyLLaVA_Factory

A Framework of Small-scale Large Multimodal Models

large-multimodal-models llama llava nlp tinyllama transformers vision-language

Last synced: 17 Jun 2024

https://github.com/OFA-Sys/ExpertLLaMA

An opensource ChatBot built with ExpertPrompting which achieves 96% of ChatGPT's capability.

alignment alpaca chatgpt llama vicuna

Last synced: 16 Jun 2024

https://github.com/superiorlu/AiTreasureBox

🤖 Collect practical AI repos, tools, websites, papers and tutorials on AI. 实用的AI百宝箱 💎

agi ai aigc alpaca awesome-list chatgpt deep-learning gpt gpt-4 llama llama2 llms machine-learning openai stable-diffusion

Last synced: 16 Jun 2024

https://github.com/ChanLiang/CONNER

The implementation for EMNLP 2023 paper ”Beyond Factuality: A Comprehensive Evaluation of Large Language Models as Knowledge Generators“

chatgpt emnlp2023 factuality hallucinations large-language-models llama llm-evaluation nlg-evaluation

Last synced: 16 Jun 2024

https://github.com/chenking2020/findthechatgpter

ChatGPT爆火,开启了通往AGI的关键一步,本项目旨在汇总那些ChatGPT的开源平替们,包括文本大模型、多模态大模型等,为大家提供一些便利

agi alpaca autogpt baichuan belle ceval chatglm chatgpt codi guanaco learderboard linly llama llama2 llava lora minigpt4 self-instruct vicuna wizadlm

Last synced: 14 Jun 2024

https://github.com/xusenlinzy/api-for-open-llm

Openai style api for open large language models, using LLMs just as chatgpt! Support for LLaMA, LLaMA-2, BLOOM, Falcon, Baichuan, Qwen, Xverse, SqlCoder, CodeLLaMA, ChatGLM, ChatGLM2, ChatGLM3 etc. 开源大模型的统一后端接口

baichuan chatglm code-llama docker internlm langchain llama llama2 llms moss nlp openai phoenix qwen sqlcoder xverse

Last synced: 14 Jun 2024

https://github.com/minosvasilias/godot-dodo

Finetuning large language models for GDScript generation.

ai finetuning gdscript godot llama

Last synced: 14 Jun 2024

https://github.com/OpenLLMAI/OpenLLMWiki

OpenLLMWiki: Docs of OpenLLMAI. Survey, reproduction and domain/task adaptation of open source chatgpt alternatives/implementations. PiXiu-貔貅 means fortune.

chatglm chatgpt chatgpt-alternatives chatgpt-app chatgpt-bot chatzhangsan chatzhihu chinese-chatgpt llama openllm openllmai

Last synced: 14 Jun 2024

https://github.com/shibing624/textgen

TextGen: Implementation of Text Generation models, include LLaMA, BLOOM, GPT2, BART, T5, SongNet and so on. 文本生成模型,实现了包括LLaMA,ChatGLM,BLOOM,GPT2,Seq2Seq,BART,T5,UDA等模型的训练和预测,开箱即用。

bart bert chatglm chatgpt gpt2 llama seq2seq t5 text-generation textgen xlnet

Last synced: 14 Jun 2024

https://github.com/aandrew-me/tgpt

AI Chatbots in terminal without needing API keys

ai chatbot chatgpt cli go golang gpt3 linux llama macos mixtral terminal windows

Last synced: 14 Jun 2024

https://github.com/darrenburns/elia

A snappy, keyboard-centric terminal user interface for interacting with large language models. Chat with ChatGPT, Claude, Llama 3, Phi 3, Mistral, Gemma and more.

ai chatgpt claude gemma gpt large-language-models llama llama3 llm mistral mistral-ai mixtral ollama ollama-client ollama-interface phi-3 python terminal tui

Last synced: 14 Jun 2024

https://github.com/carlrobertoh/codegpt

JetBrains extension providing access to state-of-the-art LLMs, such as GPT-4, Claude 3, Code Llama, and others, all for free

codellama gpt-4 intellij intellij-plugin jetbrains llama pycharm pycharm-plugin

Last synced: 14 Jun 2024

https://github.com/cvi-szu/linly

Chinese-LLaMA 1&2、Chinese-Falcon 基础模型;ChatFlow中文对话模型;中文OpenLLaMA模型;NLP预训练/指令微调数据集

bert chatbot chatgpt chinese chinese-nlp gpt-3 language-model llama nlp zero-shot-learning

Last synced: 14 Jun 2024

https://github.com/aniketmaurya/llm-inference

Large Language Model (LLM) Inference API and Chatbot

chatbot langchain llama llm llm-inference mistral

Last synced: 14 Jun 2024

https://github.com/mbzuai-oryx/video-chatgpt

[ACL 2024 🔥] Video-ChatGPT is a video conversation model capable of generating meaningful conversation about videos. It combines the capabilities of LLMs with a pretrained visual encoder adapted for spatiotemporal video representation. We also introduce a rigorous 'Quantitative Evaluation Benchmarking' for video-based conversational models.

chatbot clip gpt-4 llama llava mulit-modal vicuna video-chatboat video-conversation vision-language vision-language-pretraining

Last synced: 14 Jun 2024

https://github.com/WangRongsheng/ChatGenTitle

🌟 ChatGenTitle:使用百万arXiv论文信息在LLaMA模型上进行微调的论文题目生成模型

arxiv large-language-models llama llm llms lora

Last synced: 14 Jun 2024

https://github.com/onejune2018/awesome-llm-eval

Awesome-LLM-Eval: a curated list of tools, datasets/benchmark, demos, leaderboard, papers, docs and models, mainly for Evaluation on LLMs. 一个由工具、基准/数据、演示、排行榜和大模型等组成的精选列表,主要面向基础大模型评测,旨在探求生成式AI的技术边界.

awsome-list awsome-lists benchmark bert chatglm chatgpt dataset evaluation gpt3 large-language-model leaderboard llama llm llm-evaluation machine-learning nlp openai qwen rag

Last synced: 14 Jun 2024

https://github.com/cgbur/llama2.zig

Inference Llama 2 in one file of pure Zig

llama llama2 llm llm-inference simd zig ziglang

Last synced: 14 Jun 2024

https://github.com/coreylowman/llama-dfdx

LLaMa 7b with CUDA acceleration implemented in rust. Minimal GPU memory needed!

cuda deep-learning inference language-model llama neural-network rust rust-lang

Last synced: 14 Jun 2024

https://github.com/DAMO-NLP-SG/Video-LLaMA

[EMNLP 2023 Demo] Video-LLaMA: An Instruction-tuned Audio-Visual Language Model for Video Understanding

blip2 cross-modal-pretraining large-language-models llama minigpt4 multi-modal-chatgpt video-language-pretraining vision-language-pretraining

Last synced: 14 Jun 2024

https://github.com/hiyouga/FastEdit

🩹Editing large language models within 10 seconds⚡

bloom chatbots chatgpt falcon gpt large-language-models llama llms pytorch transformers

Last synced: 14 Jun 2024

https://github.com/soulteary/docker-llama2-chat

Play LLaMA2 (official / 中文版 / INT4 / llama2.cpp) Together! ONLY 3 STEPS! ( non GPU / 5GB vRAM / 8~14GB vRAM)

llama llama2 llama2-docker llama2-playground llm

Last synced: 13 Jun 2024

https://github.com/vectorch-ai/ScaleLLM

A high-performance inference system for large language models, designed for production environments.

cuda efficiency gpu inference llama llama3 llm llm-inference model performance production serving speculative transformer

Last synced: 13 Jun 2024

https://github.com/neph1/LlamaTale

Giving the power of LLM's to a MUD lib.

generative-ai interactive-fiction large-language-models llama llm mud roleplaying

Last synced: 12 Jun 2024

https://github.com/princeton-nlp/LLM-Shearing

[ICLR 2024] Sheared LLaMA: Accelerating Language Model Pre-training via Structured Pruning

efficiency llama llama2 llm nlp pre-training pruning

Last synced: 12 Jun 2024

https://github.com/cycneuramus/signal-aichat

An AI chatbot for Signal powered by Google Bard, Bing Chat, ChatGPT, HuggingChat, and llama.cpp

ai-bot bard bing-chat chatgpt chatgpt-bot google-bard huggingchat llama llamacpp signal-bot signal-messenger

Last synced: 12 Jun 2024

https://github.com/soulteary/llama-docker-playground

Quick Start LLaMA models with multiple methods, and fine-tune 7B/65B with One-Click.

alpaca-lora docker llama llm lora

Last synced: 12 Jun 2024

https://github.com/InternLM/lmdeploy

LMDeploy is a toolkit for compressing, deploying, and serving LLMs.

codellama cuda-kernels deepspeed fastertransformer internlm llama llama2 llama3 llm llm-inference turbomind

Last synced: 11 Jun 2024

https://github.com/Atome-FE/llama-node

Believe in AI democratization. llama for nodejs backed by llama-rs, llama.cpp and rwkv.cpp, work locally on your laptop CPU. support llama/alpaca/gpt4all/vicuna/rwkv model.

ai embeddings gpt langchain large-language-models llama llama-node llama-rs llamacpp llm napi napi-rs nodejs rwkv

Last synced: 11 Jun 2024

https://github.com/withcatai/node-llama-cpp

Run AI models locally on your machine with node.js bindings for llama.cpp. Force a JSON schema on the model output on the generation level

ai bindings catai cmake cmake-js cuda gguf grammar json-schema llama llama-cpp llm metal nodejs prebuilt-binaries self-hosted

Last synced: 11 Jun 2024

https://github.com/jianzhnie/llamatuner

Easy and Efficient Finetuning LLMs. (Supported LLama, LLama2, LLama3, Qwen, Baichuan, GLM , Falcon) 大模型高效量化训练+部署.

chatgpt dpo llama llama3 mixtral ppo qlora qwen rlhf

Last synced: 11 Jun 2024

https://github.com/xorbitsai/inference

Replace OpenAI GPT with another LLM in your app by changing a single line of code. Xinference gives you the freedom to use any LLM you need. With Xinference, you're empowered to run inference with any open-source language models, speech recognition models, and multimodal models, whether in the cloud, on-premises, or even on your laptop.

artificial-intelligence chatglm chatglm2 deployment flan-t5 gemma ggml inference llama llama2 llamacpp llm machine-learning mistral openai-api pytorch vllm whisper wizardlm

Last synced: 11 Jun 2024

https://github.com/camenduru/text-generation-webui-colab

A colab gradio web UI for running Large Language Models

alpaca colab colab-notebook colaboratory gradio koala lama llama llamas llm vicuna

Last synced: 11 Jun 2024

https://github.com/guinmoon/llmfarm_core.swift

Swift library to work with llama and other large language models.

ai falcon gpt-2 gptneox llama llama2 rwkv starcoder swift

Last synced: 11 Jun 2024

https://github.com/vitoplantamura/OnnxStream

Lightweight inference library for ONNX files, written in C++. It can run SDXL on a RPI Zero 2 but also Mistral 7B on desktops and servers.

llama machine-learning mistral onnx raspberry-pi stable-diffusion tinyml

Last synced: 11 Jun 2024

https://github.com/SilasMarvin/lsp-ai

LSP-AI is an open-source language server that serves as a backend for AI-powered functionality, designed to assist and empower software engineers, not replace them.

ai auto-completion developer-tools ide language-client llama llamacpp llm lsp mistral openai self-hosted

Last synced: 10 Jun 2024

https://github.com/avilum/llama-saas

A client/server for LLaMA (Large Language Model Meta AI) that can run ANYWHERE.

ai client-server facebook llama llm nlp

Last synced: 09 Jun 2024

https://github.com/gotzmann/llama.go

llama.go is like llama.cpp in pure Golang!

alpaca chatgpt dalai gpt gpt3 gpt4 gpt4all llama llama-cpp llm vicuna

Last synced: 09 Jun 2024

https://github.com/codingonion/awesome-llm-and-aigc

🚀🚀🚀A collection of some awesome public projects about Large Language Model, Vision Foundation Model and AI Generated Content.

aigc awesome-list chatglm chatgpt computer-vision datasets gemma gpt hugging-face internlm jobs langchain large-language-models llama llama3 llm openai sora stable-diffusion yolo

Last synced: 09 Jun 2024

https://github.com/xNul/code-llama-for-vscode

Use Code Llama with Visual Studio Code and the Continue extension. A local LLM alternative to GitHub Copilot.

assistant code code-llama codellama continue continuedev copilot llama llama2 llamacpp llm local meta ollama studio visual vscode

Last synced: 09 Jun 2024

https://github.com/SeungyounShin/Llama2-Code-Interpreter

Make Llama2 use Code Execution, Debug, Save Code, Reuse it, Access to Internet

codeinterpreter codellama llama llm

Last synced: 09 Jun 2024

https://github.com/RahulSChand/llama2.c-for-dummies

Step by step explanation/tutorial of llama2.c

llama llama2 llm

Last synced: 09 Jun 2024

https://github.com/subbu963/bott

bott: Your Terminal Copilot

chatbot chatgpt llama llm ollama openai terminal-based

Last synced: 08 Jun 2024

https://github.com/LlamaFamily/Llama-Chinese

Llama中文社区,Llama3在线体验和微调模型已开放,实时汇总最新Llama3学习资料,已将所有代码更新适配Llama3,构建最好的中文Llama大模型,完全开源可商用

finetune-llm llama llama3 llm pretraining

Last synced: 08 Jun 2024

https://github.com/snowby666/poe-api-wrapper

👾 A Python API wrapper for Poe.com. With this, you will have free access to ChatGPT, Claude, Llama, Gemini, Google-PaLM and more! 🚀

api chatbot chatgpt claude claude-3 code-llama dall-e gemini gpt-4 llama openai palm2 poe poe-api python quora reverse-engineering stable-diffusion

Last synced: 08 Jun 2024

https://github.com/unslothai/unsloth

Finetune Llama 3, Mistral & Gemma LLMs 2-5x faster with 80% less memory

ai fine-tuning finetuning gemma llama llama2 llms lora mistral qlora

Last synced: 08 Jun 2024

https://github.com/louisfb01/start-llms

A complete guide to start and improve your LLM skills in 2024 with little background in the field and stay up-to-date with the latest news and state-of-the-art techniques!

ai fine-tuning gpt gpt-4 language-model large-language-models llama llm llms rag retrieval-augmented-generation

Last synced: 08 Jun 2024

https://github.com/Beomi/KoAlpaca

KoAlpaca: 한국어 명령어를 이해하는 오픈소스 언어모델

alpaca chatkoalpaca koalpaca korean-nlp llama polyglot-ko

Last synced: 07 Jun 2024

https://github.com/mpociot/llamero

A GUI application to easily try out Facebook's LLaMA models.

ai llama llm

Last synced: 07 Jun 2024

https://github.com/cedrickchee/awesome-transformer-nlp

A curated list of NLP resources focused on Transformer networks, attention mechanism, GPT, BERT, ChatGPT, LLMs, and transfer learning.

attention-mechanism awesome awesome-list bert chatgpt gpt-2 gpt-3 gpt-4 language-model llama natural-language-processing neural-networks nlp pre-trained-language-models transfer-learning transformer xlnet

Last synced: 06 Jun 2024

https://github.com/wenge-research/YaYi

雅意大模型:为客户打造安全可靠的专属大模型,基于大规模中英文多领域指令数据训练的 LlaMA 2 & BLOOM 系列模型,由中科闻歌算法团队研发。(Repo for YaYi Chinese LLMs based on LlaMA2 & BLOOM)

bloom chat chinese llama llama2 llm lora yayi

Last synced: 04 Jun 2024

https://github.com/ddzipp/AutoAudit

AutoAudit—— the LLM for Cyber Security 网络安全大语言模型

alpaca-lora chatgpt cyber-security fine-tuning gpt llama lora sqlinjection transformer

Last synced: 04 Jun 2024

https://github.com/MetaGLM/FinGLM

FinGLM: 致力于构建一个开放的、公益的、持久的金融大模型项目,利用开源开放来促进「AI+金融」。

chatglm finacial gpt llama llm

Last synced: 04 Jun 2024

https://github.com/HyperMink/inferenceable

Scalable AI Inference Server for CPU and GPU with Node.js | Utilizes llama.cpp and parts of llamafile C/C++ core under the hood.

ai chatgpt generative-ai gpt inference inference-engine llama llama3 llava llms localai nodejs phi3 vision vision-api

Last synced: 03 Jun 2024

https://github.com/icebaker/ruby-nano-bots

Ruby Implementation of Nano Bots: small, AI-powered bots that can be easily shared as a single file, designed to support multiple providers such as Cohere Command, Google Gemini, Maritaca AI MariTalk, Mistral AI, Ollama, OpenAI ChatGPT, and others, with support for calling tools (functions).

alpaca chatgpt cohere-ai gemini gemini-pro google-ai google-gemini google-vertex-ai gpt gpt-4 llama llm maritaca-ai mistral mistral-ai nano-bots ollama openai openai-api vicuna

Last synced: 02 Jun 2024

https://github.com/young-geng/EasyLM

Large language models (LLMs) made easy, EasyLM is a one stop solution for pre-training, finetuning, evaluating and serving LLMs in JAX/Flax.

chatbot deep-learning flax jax language-model large-language-models llama natural-language-processing transformer

Last synced: 02 Jun 2024