Projects in Awesome Lists tagged with llm

https://github.com/irgolic/autopr

Run AI-powered workflows over your codebase

action actions ai chatgpt github-action github-actions gpt gpt-3 gpt-4 llm openai

Last synced: 13 Oct 2024

https://github.com/agenta-ai/agenta

The all-in-one LLM developer platform: prompt management, evaluation, human feedback, and deployment all in one place.

human-annotation langchain large-language-models llama-index llm llm-evaluation llm-framework llm-tools llmops llms prompt-engineering prompt-management prompt-toolkit rag rag-evaluation

Last synced: 19 Nov 2024

https://github.com/tongjilibo/bert4torch

An elegent pytorch implement of transformers

belle bert bert4keras bert4torch chatglm large-language-models llama llm named-entity-recognition nlp pytorch relation-extraction seq2seq text-classification transformers

Last synced: 19 Nov 2024

https://github.com/foundationvision/llamagen

Autoregressive Model Beats Diffusion: 🦙 Llama for Scalable Image Generation

auto-regressive-model diffusion diffusion-models image-generation llama llm text2image

Last synced: 10 Oct 2024

https://github.com/SkyworkAI/Skywork

Skywork series models are pre-trained on 3.2TB of high-quality multilingual (mainly Chinese and English) and code data. We have open-sourced the model, training data, evaluation data, evaluation methods, etc. 天工系列模型在3.2TB高质量多语言和代码数据上进行预训练。我们开源了模型参数，训练数据，评估数据，评估方法。

llm

Last synced: 14 Nov 2024

https://github.com/skyworkai/skywork

Skywork series models are pre-trained on 3.2TB of high-quality multilingual (mainly Chinese and English) and code data. We have open-sourced the model, training data, evaluation data, evaluation methods, etc. 天工系列模型在3.2TB高质量多语言和代码数据上进行预训练。我们开源了模型参数，训练数据，评估数据，评估方法。

llm

Last synced: 14 Oct 2024

https://github.com/Tongjilibo/bert4torch

An elegent pytorch implement of transformers

belle bert bert4keras bert4torch chatglm large-language-models llama llm named-entity-recognition nlp pytorch relation-extraction seq2seq text-classification transformers

Last synced: 06 Nov 2024

https://github.com/ray-project/aviary

RayLLM - LLMs on Ray

distributed-systems large-language-models llm llm-inference llm-serving llmops ray serving transformers

Last synced: 29 Aug 2024

https://github.com/ray-project/ray-llm

RayLLM - LLMs on Ray

distributed-systems large-language-models llm llm-inference llm-serving llmops ray serving transformers

Last synced: 15 Oct 2024

https://github.com/jncraton/languagemodels

Explore large language models in 512MB of RAM

llm nlp python

Last synced: 20 Nov 2024

https://github.com/microsoft/rd-agent

Research and development (R&D) is crucial for the enhancement of industrial productivity, especially in the AI era, where the core aspects of R&D are mainly focused on data and models. We are committed to automating these high-value generic R&D processes through our open source R&D automation tool RD-Agent, which lets AI drive data-driven AI.

agent ai automation data-mining data-science development llm research

Last synced: 19 Nov 2024

https://github.com/BoundaryML/baml

BAML is a language that helps you get structured data from LLMs, with the best DX possible. Works with all languages. Check out the promptfiddle.com playground

baml boundaryml guardrails llm llm-playground playground prompt prompt-config prompt-templates structured-data structured-generation structured-output vscode

Last synced: 20 Oct 2024

https://github.com/vercel/modelfusion

The TypeScript library for building AI applications.

ai artificial-intelligence chatbot claude dall-e embedding gpt-3 huggingface javascript js llamacpp llm mistral multi-modal ollama openai stable-diffusion ts typescript whisper

Last synced: 06 Nov 2024

https://github.com/lgrammel/ai-utils.js

The TypeScript library for building AI applications.

ai artificial-intelligence chatbot claude dall-e embedding gpt-3 huggingface javascript js llamacpp llm mistral multi-modal ollama openai stable-diffusion ts typescript whisper

Last synced: 09 Nov 2024

https://github.com/pku-alignment/safe-rlhf

Safe RLHF: Constrained Value Alignment via Safe Reinforcement Learning from Human Feedback

ai-safety alpaca beaver datasets deepspeed gpt large-language-models llama llm llms reinforcement-learning reinforcement-learning-from-human-feedback rlhf safe-reinforcement-learning safe-reinforcement-learning-from-human-feedback safe-rlhf safety transformer transformers vicuna

Last synced: 10 Oct 2024

https://github.com/RahulSChand/gpu_poor

Calculate token/s & GPU memory requirement for any LLM. Supports llama.cpp/ggml/bnb/QLoRA quantization

ggml gpu huggingface language-model llama llama2 llamacpp llm pytorch quantization

Last synced: 08 Nov 2024

https://github.com/ax-llm/ax

The unofficial DSPy framework. Build LLM powered Agents and "Agentic workflows" based on the Stanford DSP paper.

ai anthropic claude cohere gemini google gpt-4 javascript large-language-models llm nodejs ollama openai opensource rag together-compute typescript vectordb

Last synced: 19 Nov 2024

https://github.com/explosion/spacy-llm

🦙 Integrating LLMs into structured NLP pipelines

anthropic claude cohere dolly falcon gpt-3 gpt-4 large-language-models llama llm machine-learning named-entity-recognition natural-language-processing nlp openai prompt-engineering spacy text-classification

Last synced: 19 Nov 2024

https://github.com/nlkitai/nlux

The 𝗣𝗼𝘄𝗲𝗿𝗳𝘂𝗹 Conversational AI JavaScript Library 💬 — UI for any LLM, supporting LangChain / HuggingFace / Vercel AI, and more 🧡 React, Next.js, and plain JavaScript ⭐️

artificial-intelligence chatbot chatgpt huggingface javascript large-language-models llm openai reactjs vercel-ai-sdk

Last synced: 19 Nov 2024

https://github.com/axilla-io/ax

The TypeScript framework for AI development

ai llm typescript

Last synced: 09 Nov 2024

https://github.com/SciPhi-AI/R2R

The framework for fast development and deployment of RAG backends.

artificial-intelligence chatbot data-pipelines deep-learning langchain large-language-models llama-index llm machine-learning ocr pdf question-answering retrieval retrieval-augmented-generation retrieval-systems search

Last synced: 28 Oct 2024

https://github.com/sciphi-ai/r2r

The framework for fast development and deployment of RAG backends.

artificial-intelligence chatbot data-pipelines deep-learning langchain large-language-models llama-index llm machine-learning ocr pdf question-answering retrieval retrieval-augmented-generation retrieval-systems search

Last synced: 18 Nov 2024

https://github.com/mangiucugna/json_repair

A python module to repair invalid JSON, commonly used to parse the output of LLMs

deep-learning gpt-4 json llama3 llm machine-learning mistral openai-api parser repair

Last synced: 19 Nov 2024

https://github.com/axflow/axflow

The TypeScript framework for AI development

ai llm typescript

Last synced: 14 Oct 2024

https://github.com/lupantech/chameleon-llm

Codes for "Chameleon: Plug-and-Play Compositional Reasoning with Large Language Models".

ai chatgpt gpt-4 llm openai python tool

Last synced: 09 Oct 2024

https://github.com/gabrielchua/RAGxplorer

Open-source tool to visualise your RAG 🔮

interactive llm python rag streamlit visualization

Last synced: 29 Oct 2024

https://github.com/gabrielchua/ragxplorer

Open-source tool to visualise your RAG 🔮

interactive llm python rag streamlit visualization

Last synced: 10 Oct 2024

https://github.com/yusufcanb/tlm

Local CLI Copilot, powered by CodeLLaMa. 💻🦙

bash codellama llama2 llm powershell starcoder2

Last synced: 10 Oct 2024

https://github.com/lunary-ai/lunary

The production toolkit for LLMs. Observability, prompt management and evaluations.

ai evaluation hacktoberfest langchain llm logs monitoring observability openai prompts self-hosted testing

Last synced: 19 Nov 2024

https://github.com/squeezeailab/llmcompiler

LLMCompiler: An LLM Compiler for Parallel Function Calling

efficient-inference function-calling large-language-models llama llama2 llm llm-agent llm-agents llm-framework llms natural-language-processing nlp parallel-function-call transformer

Last synced: 10 Oct 2024

https://github.com/ggozad/oterm

a text-based terminal client for Ollama

llm llms machine-learning ollama python terminal

Last synced: 19 Nov 2024

https://github.com/storia-ai/sage

Chat with any codebase in under two minutes | Fully local or via third-party APIs

ai anthropic claude copilot developer-tools hacktoberfest hacktoberfest-2024 hacktoberfest2024 langchain llm openai pinecone python rag

Last synced: 16 Nov 2024

https://github.com/bbuf/how-to-optim-algorithm-in-cuda

how to optimize some algorithm in cuda.

cuda llm

Last synced: 15 Oct 2024

https://github.com/BBuf/how-to-optim-algorithm-in-cuda

how to optimize some algorithm in cuda.

cuda llm

Last synced: 27 Oct 2024

https://github.com/langchain-ai/langchain-extract

🦜⛏️ Did you say you like data?

extraction extraction-data fastapi langchain langchain-python llm llms

Last synced: 07 Oct 2024

https://github.com/TEN-framework/TEN-Agent

TEN Agent is the world’s first real-time multimodal agent integrated with the OpenAI Realtime API, RTC, and features weather checks, web search, vision, and RAG capabilities.

agent ai asr cpp gemini golang gpt-4 gpt-4o llm low-latency multimodal nextjs14 openai python rag real-time realtime tts vision voice-assistant

Last synced: 22 Oct 2024

https://github.com/lazyagi/lazyllm

Easiest and laziest way for building multi-agent LLMs applications.

agents ai-agent data deep-learning documentation-tool finetuning framework knowlege-graph langchain lazyllm llamaindex llm llms rag

Last synced: 20 Nov 2024

https://github.com/LazyAGI/LazyLLM

Easiest and laziest way for building multi-agent LLMs applications.

agents ai-agent data deep-learning documentation-tool finetuning framework knowlege-graph langchain lazyllm llamaindex llm llms rag

Last synced: 13 Nov 2024

https://github.com/unit-mesh/unit-minions

《AI 研发提效：自己动手训练 LoRA》，包含 Llama （Alpaca LoRA）模型、ChatGLM （ChatGLM Tuning）相关 Lora 的训练。训练内容：用户故事生成、测试代码生成、代码辅助生成、文本转 SQL、文本生成代码……

llm lora

Last synced: 16 Nov 2024

https://github.com/hymie122/RAG-Survey

Collecting awesome papers of RAG for AIGC. We propose a taxonomy of RAG foundations, enhancements, and applications in paper "Retrieval-Augmented Generation for AI-Generated Content: A Survey".

aigc diffusion-models llm multimodality rag survey

Last synced: 09 Nov 2024

https://github.com/zabirauf/AutoGPT.js

Auto-GPT on the browser

autogpt gpt gpt-4 gpt3 llm

Last synced: 10 Nov 2024

https://github.com/sozercan/kubectl-ai

✨ Kubectl plugin to create manifests with LLMs

ai chatgpt gpt gpt-4 hacktoberfest k8s kubectl kubectl-plugins kubernetes llm localllama open-llm openai openai-api

Last synced: 09 Oct 2024

https://github.com/zabirauf/autogpt.js

Auto-GPT on the browser

autogpt gpt gpt-4 gpt3 llm

Last synced: 14 Oct 2024

https://github.com/ricklamers/shell-ai

LangChain powered shell command generator and runner CLI

automation cli gpt langchain llm openai shell

Last synced: 20 Nov 2024

https://github.com/withcatai/node-llama-cpp

Run AI models locally on your machine with node.js bindings for llama.cpp. Enforce a JSON schema on the model output on the generation level

ai bindings catai cmake cmake-js cuda embedding function-calling gguf gpu grammar json-schema llama llama-cpp llm metal nodejs prebuilt-binaries self-hosted vulkan

Last synced: 19 Nov 2024

https://github.com/vectara/hallucination-leaderboard

Leaderboard Comparing LLM Performance at Producing Hallucinations when Summarizing Short Documents

generative-ai hallucinations llm

Last synced: 15 Oct 2024

https://github.com/protectai/vulnhuntr

Zero shot vulnerability discovery using LLMs

ai llm security static-analysis vulnerability-detection

Last synced: 15 Nov 2024

https://github.com/kantord/SeaGOAT

local-first semantic code search engine

ai ai-project code-search code-search-engine embeddings grep grep-like hacktoberfest hacktoberfest2023 llm regular-expression ripgrep vector-database vector-embeddings

Last synced: 31 Oct 2024

https://github.com/kantord/seagoat

local-first semantic code search engine

ai ai-project code-search code-search-engine embeddings grep grep-like hacktoberfest hacktoberfest2023 llm regular-expression ripgrep vector-database vector-embeddings

Last synced: 20 Nov 2024

https://github.com/fetchai/uAgents

A fast and lightweight framework for creating decentralized agents with ease.

agents ai ai-agents llm multi-agent-systems

Last synced: 06 Nov 2024

https://github.com/allenai/dolma

Data and tools for generating and inspecting OLMo pre-training data.

data-processing large-language-models llm machile-learning nlp

Last synced: 05 Nov 2024

https://github.com/safevideo/autollm

Ship RAG based LLM web apps in seconds.

anthropic bedrock cohere fastapi gradio langchain large-language-models llama-index llama2 llm openai palm pypi python retrieval-augmented-generation vector-database vertex-ai

Last synced: 27 Sep 2024

https://github.com/pinecone-io/canopy

Retrieval Augmented Generation (RAG) framework and context engine powered by Pinecone

generative-ai llm rag vector-database

Last synced: 20 Nov 2024

https://github.com/microsoft/tora

ToRA is a series of Tool-integrated Reasoning LLM Agents designed to solve challenging mathematical reasoning problems by interacting with tools [ICLR'24].

autonomous-agents language-model llm mathematical-reasoning tool-learning

Last synced: 05 Nov 2024

https://github.com/MLSysOps/MLE-agent

🤖 MLE-Agent: Your intelligent companion for seamless AI engineering and research. 🔍 Integrate with arxiv and paper with code to provide better code/research plans 🧰 OpenAI, Anthropic, Ollama, etc supported. :fireworks: Code RAG

agent ai llm ml mle mlops

Last synced: 08 Sep 2024

https://github.com/kennethleungty/Llama-2-Open-Source-LLM-CPU-Inference

Running Llama 2 and other Open-Source LLMs on CPU Inference Locally for Document Q&A

c-transformers chatgpt cpu cpu-inference deep-learning document-qa faiss langchain language-models large-language-models llama llama-2 llm machine-learning natural-language-processing nlp open-source-llm python sentence-transformers transformers

Last synced: 16 Nov 2024

https://github.com/woop/rebuff

LLM Prompt Injection Detector

llm llmops prompt-engineering prompt-injection prompts security

Last synced: 06 Aug 2024

https://github.com/protectai/rebuff

LLM Prompt Injection Detector

llm llmops prompt-engineering prompt-injection prompts security

Last synced: 15 Nov 2024

https://github.com/kennethleungty/llama-2-open-source-llm-cpu-inference

Running Llama 2 and other Open-Source LLMs on CPU Inference Locally for Document Q&A

c-transformers chatgpt cpu cpu-inference deep-learning document-qa faiss langchain language-models large-language-models llama llama-2 llm machine-learning natural-language-processing nlp open-source-llm python sentence-transformers transformers

Last synced: 10 Oct 2024

https://github.com/IntelLabs/fastRAG

Efficient Retrieval Augmentation and Generation Framework

benchmark colbert diffusion generative-ai information-retrieval knowledge-graph llm multi-modal nlp question-answering semantic-search sentence-transformers summarization transformers

Last synced: 28 Oct 2024

https://github.com/intellabs/fastrag

Efficient Retrieval Augmentation and Generation Framework

benchmark colbert diffusion generative-ai information-retrieval knowledge-graph llm multi-modal nlp question-answering semantic-search sentence-transformers summarization transformers

Last synced: 13 Nov 2024

https://github.com/hollobit/GenAI_LLM_timeline

ChatGPT, GenerativeAI and LLMs Timeline

agi chatgpt chatgpt-api claude copilot generative-ai generative-models gpt langchain large-language-models llama llm midjourney openai palm-e stable-diffusion timeline transformer vall-e

Last synced: 06 Nov 2024

https://github.com/hollobit/genai_llm_timeline

ChatGPT, GenerativeAI and LLMs Timeline

agi chatgpt chatgpt-api claude copilot generative-ai generative-models gpt langchain large-language-models llama llm midjourney openai palm-e stable-diffusion timeline transformer vall-e

Last synced: 10 Oct 2024

https://github.com/dillionverma/llm.report

📊 llm.report is an open-source logging and analytics platform for OpenAI: Log your ChatGPT API requests, analyze costs, and improve your prompts.

aiops gpt-3 gpt-4 llm llmops mlops nextjs nodejs open-source openai react shadcn-ui typescript

Last synced: 21 Oct 2024

https://github.com/iterative/datachain

AI-data warehouse to enrich, transform and analyze data from cloud storages

ai cv data-analytics data-wrangling embeddings llm llm-eval mlops multimodal

Last synced: 09 Nov 2024

https://github.com/replit/replitLM

Inference code and configs for the ReplitLM model family

ai ai4code llm

Last synced: 07 Nov 2024

https://github.com/replit/replitlm

Inference code and configs for the ReplitLM model family

ai ai4code llm

Last synced: 13 Nov 2024

https://github.com/MiuLab/Taiwan-LLaMa

Traditional Mandarin LLMs for Taiwan

langauge-model llm taiwan traditional-mandarin

Last synced: 05 Sep 2024

https://github.com/MiuLab/Taiwan-LLM

Traditional Mandarin LLMs for Taiwan

langauge-model llm taiwan traditional-mandarin

Last synced: 25 Oct 2024

https://github.com/replit/ReplitLM

Inference code and configs for the ReplitLM model family

ai ai4code llm

Last synced: 05 Nov 2024

https://github.com/bricks-cloud/BricksLLM

🔒 Enterprise-grade API gateway that helps you monitor and impose cost or rate limits per API key. Get fine-grained access control and monitoring per user, application, or environment. Supports OpenAI, Azure OpenAI, Anthropic, vLLM, and open-source LLMs.

ai anthropic api artificial-intelligence azure docker generative-ai golang gpt llm open-source openai postgresql privacy rest-api security self-hosted vllm ycombinator

Last synced: 06 Nov 2024

https://github.com/deepseek-ai/janus

Janus: Decoupling Visual Encoding for Unified Multimodal Understanding and Generation

any-to-any foundation-models llm multimodal vision-language-pretraining

Last synced: 15 Nov 2024

https://github.com/BruceMacD/chatd

Chat with your documents using local AI

chat desktop electron llama2 llm mistral mistral-7b ollama rag

Last synced: 05 Nov 2024

https://github.com/punica-ai/punica

Serving multiple LoRA finetuned LLM as one

large-language-models llm lora

Last synced: 16 Nov 2024

https://github.com/t41372/open-llm-vtuber

Talk to any LLM with hands-free voice interaction, voice interruption, Live2D taking face, and long-term memory running locally across platforms

ai ai-vtuber ai-waifu chatbots live2d live2d-web llm neuro-sama ollama

Last synced: 15 Nov 2024

https://github.com/brucemacd/chatd

Chat with your documents using local AI

chat desktop electron llama2 llm mistral mistral-7b ollama rag

Last synced: 10 Oct 2024

https://github.com/msoedov/langcorn

⛓️ Serving LangChain LLM apps and agents automagically with FastApi. LLMops

api fastapi langchain langchain-python large-language-models llm llmops openai-api rest-api vercel vercel-serverless-functions

Last synced: 11 Oct 2024

https://github.com/microsoft/ToRA

ToRA is a series of Tool-integrated Reasoning LLM Agents designed to solve challenging mathematical reasoning problems by interacting with tools [ICLR'24].

autonomous-agents language-model llm mathematical-reasoning tool-learning

Last synced: 05 Nov 2024

https://github.com/Troyanovsky/Local-LLM-Comparison-Colab-UI

Compare the performance of different LLM that can be deployed locally on consumer hardware. Run yourself with Colab WebUI.

ai gpt llama llm

Last synced: 09 Aug 2024

https://github.com/troyanovsky/local-llm-comparison-colab-ui

Compare the performance of different LLM that can be deployed locally on consumer hardware. Run yourself with Colab WebUI.

ai gpt llama llm

Last synced: 10 Oct 2024

https://github.com/bilibili/index-1.9b

A SOTA lightweight multilingual LLM

llm nlp

Last synced: 11 Nov 2024

https://github.com/srush/llm-training-puzzles

What would you do with 1000 H100s...

llm puzzles

Last synced: 12 Nov 2024

https://github.com/protectai/llm-guard

The Security Toolkit for LLM Interactions

adversarial-machine-learning chatgpt large-language-models llm llm-security llmops prompt-engineering prompt-injection security-tools transformers

Last synced: 15 Nov 2024

https://github.com/srush/LLM-Training-Puzzles

What would you do with 1000 H100s...

llm puzzles

Last synced: 12 Nov 2024

https://github.com/llmonitor/llmonitor

The production toolkit for LLMs. Observability, prompt management and evaluations.

ai evaluation hacktoberfest langchain llm logs monitoring observability openai prompts self-hosted testing

Last synced: 27 Aug 2024

https://github.com/pjlab-sys4nlp/llama-moe

⛷️ LLaMA-MoE: Building Mixture-of-Experts from LLaMA with Continual Pre-training (EMNLP 2024)

continual-pre-training expert-partition llama llm mixture-of-experts moe

Last synced: 16 Nov 2024

https://github.com/zjunlp/prompt4reasoningpapers

[ACL 2023] Reasoning with Language Model Prompting: A Survey

arithmetic-reasoning artificial-intelligence awsome-list chain-of-thought chatgpt commonsense-reasoning datasets gpt-3 language-models large-language-models llm logical-reasoning natural-language-processing nlp paper-list prompt prompt-engineering reasoning survey symbolic-reasoning

Last synced: 09 Nov 2024

https://github.com/ymcui/chinese-llama-alpaca-3

中文羊驼大模型三期项目 (Chinese Llama-3 LLMs) developed from Meta Llama 3

alpaca large-language-models llama llama-2 llama-3 llama3 llm nlp

Last synced: 10 Oct 2024

https://github.com/dabit3/react-native-ai

Full stack framework for building cross-platform mobile AI apps

ai cross-platform express llm react react-native streaming

Last synced: 16 Nov 2024

https://github.com/yuchenlin/llm-blender

[ACL2023] We introduce LLM-Blender, an innovative ensembling framework to attain consistently superior performance by leveraging the diverse strengths of multiple open-source LLMs. LLM-Blender cut the weaknesses through ranking and integrate the strengths through fusing generation to enhance the capability of LLMs.

ensamble-methods large-language-models llm natural-language-processing

Last synced: 13 Nov 2024

https://github.com/InternLM/lagent

A lightweight framework for building LLM-based agents

agent gpt llm transformers

Last synced: 06 Nov 2024

https://github.com/internlm/lagent

A lightweight framework for building LLM-based agents

agent gpt llm transformers

Last synced: 18 Nov 2024

https://github.com/lastmile-ai/aiconfig

AIConfig is a config-based framework to build generative AI applications.

ai developer-tools generative-ai llm llm-ops

Last synced: 14 Nov 2024

https://github.com/codefuse-ai/modelcache

A LLM semantic caching system aiming to enhance user experience by reducing response time via cached query-result pairs.

llm semantic-cache

Last synced: 13 Nov 2024

https://github.com/Atome-FE/llama-node

Believe in AI democratization. llama for nodejs backed by llama-rs, llama.cpp and rwkv.cpp, work locally on your laptop CPU. support llama/alpaca/gpt4all/vicuna/rwkv model.

ai embeddings gpt langchain large-language-models llama llama-node llama-rs llamacpp llm napi napi-rs nodejs rwkv

Last synced: 08 Nov 2024

https://github.com/atome-fe/llama-node

Believe in AI democratization. llama for nodejs backed by llama-rs, llama.cpp and rwkv.cpp, work locally on your laptop CPU. support llama/alpaca/gpt4all/vicuna/rwkv model.

ai embeddings gpt langchain large-language-models llama llama-node llama-rs llamacpp llm napi napi-rs nodejs rwkv