An open API service indexing awesome lists of open source software.

Projects in Awesome Lists tagged with llm-framework

A curated list of projects in awesome lists tagged with llm-framework .

https://github.com/microsoft/autogen

A programming framework for agentic AI 🤖 PyPi: autogen-agentchat Discord: https://aka.ms/autogen-discord Office Hour: https://aka.ms/autogen-officehour

agentic agentic-agi agents ai autogen autogen-ecosystem chatgpt framework llm-agent llm-framework

Last synced: 09 Sep 2025

https://github.com/agenta-ai/agenta

The open-source LLMOps platform: prompt playground, prompt management, LLM evaluation, and LLM observability all in one place.

agents evaluation llm-as-a-judge llm-evaluation llm-framework llm-monitoring llm-observability llm-platform llm-playground llm-tools llmops observability prompt-engineering prompt-management rag-evaluation

Last synced: 11 Mar 2026

https://github.com/agentera/agently

[GenAI Application Development Framework] 🚀 Build GenAI application quick and easy 💬 Easy to interact with GenAI agent in code using structure data and chained-calls syntax 🧩 Use Event-Driven Flow *TriggerFlow* to manage complex GenAI working logic 🔀 Switch to any model without rewrite application code

agent agent-based-framework agent-framework chatglm claude deepseek ernie framework gemini google-gemini gpt llm-agent llm-application llm-apps llm-framework llmops llms minimax python

Last synced: 25 May 2026

https://github.com/trypromptly/LLMStack

No-code multi-agent framework to build LLM Agents, workflows and applications with your data

agents ai ai-agents-framework generative-ai llm-agents llm-chain llm-framework llmops llms no-code-ai platform

Last synced: 28 Mar 2025

https://github.com/Maplemx/Agently

[GenAI Application Development Framework] 🚀 Build GenAI application quick and easy 💬 Easy to interact with GenAI agent in code using structure data and chained-calls syntax 🧩 Use Agently Workflow to manage complex GenAI working logic 🔀 Switch to any model without rewrite application code

agent agent-based-framework agent-framework chatglm claude ernie framework gemini google-gemini gpt llm-agent llm-application llm-apps llm-framework llmops llms minimax python wenxinyiyan

Last synced: 06 May 2025

https://github.com/Agenta-AI/agenta

The all-in-one LLM developer platform: prompt management, evaluation, human feedback, and deployment all in one place.

human-annotation langchain large-language-models llama-index llm llm-evaluation llm-framework llm-tools llmops llms prompt-engineering prompt-management prompt-toolkit rag rag-evaluation

Last synced: 13 Mar 2025

https://github.com/xingyaoww/code-act

Official Repo for ICML 2024 paper "Executable Code Actions Elicit Better LLM Agents" by Xingyao Wang, Yangyi Chen, Lifan Yuan, Yizhe Zhang, Yunzhu Li, Hao Peng, Heng Ji.

llm llm-agent llm-finetuning llm-framework

Last synced: 16 May 2025

https://github.com/scale3-labs/langtrace

Langtrace 🔍 is an open-source, Open Telemetry based end-to-end observability tool for LLM applications, providing real-time tracing, evaluations and metrics for popular LLMs, LLM frameworks, vectorDBs and more.. Integrate using Typescript, Python. 🚀💻📊

ai datasets evaluations gpt langchain llm llm-framework llmops observability open-source open-telemetry openai prompt-engineering tracing

Last synced: 15 May 2025

https://github.com/Scale3-Labs/langtrace

Langtrace 🔍 is an open-source, Open Telemetry based end-to-end observability tool for LLM applications, providing real-time tracing, evaluations and metrics for popular LLMs, LLM frameworks, vectorDBs and more.. Integrate using Typescript, Python. 🚀💻📊

ai datasets evaluations gpt langchain llm llm-framework llmops observability open-source open-telemetry openai prompt-engineering tracing

Last synced: 30 Oct 2025

https://github.com/maximilian-winter/llama-cpp-agent

The llama-cpp-agent framework is a tool designed for easy interaction with Large Language Models (LLMs). Allowing users to chat with LLM models, execute structured function calls and get structured output. Works also with models not fine-tuned to JSON output and function calls.

agents function-calling llamacpp llm llm-agent llm-framework llms parallel-function-call

Last synced: 15 May 2025

https://github.com/The-Pocket/PocketFlow

Minimalist LLM Framework in 100 Lines. Enable LLMs to Program Themselves.

agentic-workflow agents ai flow-based-programming flow-engineering framework llm llm-agent llm-framework llm-workflow open-source rag

Last synced: 28 Feb 2025

https://github.com/Maximilian-Winter/llama-cpp-agent

The llama-cpp-agent framework is a tool designed for easy interaction with Large Language Models (LLMs). Allowing users to chat with LLM models, execute structured function calls and get structured output. Works also with models not fine-tuned to JSON output and function calls.

agents function-calling llamacpp llm llm-agent llm-framework llms parallel-function-call

Last synced: 09 Apr 2025

https://github.com/gensx-inc/gensx

The TypeScript framework for agents & workflows with react-like components. Lightning fast dev loop. Easy to learn. Easy to extend.

generative-ai llm-framework llms workflow

Last synced: 15 May 2025

https://github.com/internlm/internevo

InternEvo is an open-sourced lightweight training framework aims to support model pre-training without the need for extensive dependencies.

910b deepspeed-ulysses flash-attention gemma internlm internlm2 llama3 llava llm-framework llm-training multi-modal pipeline-parallelism pytorch ring-attention sequence-parallelism tensor-parallelism transformers-models zero3

Last synced: 07 Oct 2025

https://github.com/InternLM/InternEvo

InternEvo is an open-sourced lightweight training framework aims to support model pre-training without the need for extensive dependencies.

910b deepspeed-ulysses flash-attention gemma internlm internlm2 llama3 llava llm-framework llm-training multi-modal pipeline-parallelism pytorch ring-attention sequence-parallelism tensor-parallelism transformers-models zero3

Last synced: 27 Mar 2025

https://github.com/craftgen/craftgen

Integrating AI into every workflow with our open-source, no-code platform, powered by the actor model for dynamic, graph-based solutions.

actor-framework agent agent-based-framework ai chat gpt llm-agent llm-framework llmops

Last synced: 30 Apr 2025

https://github.com/expectedparrot/edsl

Design, conduct and analyze results of AI-powered surveys and experiments. Simulate social science and market research with large numbers of AI agents and LLMs.

anthropic data-labeling deepinfra domain-specific-language experiments llama2 llm llm-agent llm-framework llm-inference market-research mixtral open-source openai python social-science surveys synthetic-data

Last synced: 15 May 2025

https://github.com/axar-ai/axar

Minimal typescript agent framework that keeps it simple and gives you control - no BS

agent-framework agent-framework-javascript agentic-ai agents ai generative-ai javascript llm llm-framework nodejs typescript workflows

Last synced: 12 Mar 2026

https://github.com/swarmauri/swarmauri-sdk

a monorepo featuring modular microkernel frameworks and single purpose extensions

agents ai chunking factories llm-framework measures metrics modular monorepo nlp orchestration orchestration-framework parsing tooling tools vectors

Last synced: 20 May 2026

https://github.com/albertocubeddu/extensionOS

Imagine a world where everyone can access powerful AI models—LLMs, generative image models, and speech recognition—directly in their web browser. Integrating AI into daily browsing will revolutionise online interactions, offering instant, intelligent assistance tailored to individual needs.

ai artificial-intelligence artificial-intelligence-projects chatgpt gpt groq groq-ai groq-integration llm-framework ollama productivity-booster togetherai

Last synced: 11 Aug 2025

https://github.com/cyberark/agentwatch

A powerful AI observability framework that provides comprehensive insights into agent interactions across platforms, enabling developers to monitor, analyze, and optimize AI-driven applications with minimal integration effort.

agent agentic agentic-ai ai cybersecurity large-language-models llm llm-framework llm-observability llm-tools machine-learning monitoring observability security

Last synced: 22 Jul 2025

https://github.com/fsprojects/furnace

Production-grade ML - F# power & precision guiding Torch performance

ai data-science differential-equations dotnet fsharp llm-framework machine-learning ml optimization

Last synced: 07 Apr 2025

https://github.com/llmrb/llm

Ruby adapter for various LLM providers

ai llm llm-agents llm-framework llm-frameworks llms ruby-lib ruby-library

Last synced: 11 May 2025

https://github.com/pingcap/linguflow

LinguFlow, a low-code tool designed for LLM application development, simplifies the building, debugging, and deployment process for developers.

chatgpt gpt llm-framework llm-inference openai

Last synced: 07 Apr 2025

https://github.com/j4nn0/llm-rag

LLMs prompt augmentation with RAG by integrating external custom data from a variety of sources, allowing chat with such documents

chat-application chatapp chatbot chatgpt custom-data llama llama-index llama2 llamacpp llm llm-apps llm-framework llms local-llama local-llm mixtral mixtral-8x7b rag rag-embeddings retrieval-augmented-generation

Last synced: 14 Aug 2025

https://github.com/amanpriyanshu/geneticpromptlab

GeneticPromptLab uses genetic algorithms for automated prompt engineering (for LLMs), enhancing quality and diversity through iterative selection, crossover, and mutation, while efficiently exploring minimal yet diverse samples from the training set.

ai automated-prompt-engineering evolutionary-algorithm evolutionary-algorithms genetic-algorithm genetic-algorithms genetic-optimization-algorithm llm llm-framework llms optimization prompt prompt-engineering prompt-generator prompt-learning prompt-toolkit prompt-tuning prompting prompts

Last synced: 22 Mar 2025

https://github.com/jwwelbor/agentmap

AgentMap: Build and deploy LangGraph workflows from CSV files. Create complex LLM agent graphs without coding, convert simple spreadsheets into powerful AI agents, and orchestrate multi-agent systems with ease. Integrates with OpenAI, Anthropic, and Google AI models. Includes CLI and FastAPI server for quick deployment.

agentic-ai langgraph langgraph-python llm-framework

Last synced: 01 Mar 2026

https://github.com/synapsekit/synapsekit

Ship LLM apps faster. Production-grade LLM framework for Python. Async-native RAG, agents, and graph workflows. 2 dependencies. Zero magic.

agents ai anthropic async generative-ai graph-workflow langchain-alternative llm llm-framework machine-learning nlp openai pip-install python rag rag-pipeline retrieval-augmented-generation streaming synapsekit vector-database

Last synced: 07 Apr 2026

https://github.com/holasoymalva/llm-glossary

Glossary of key concepts in Large Language Models (LLMs), Artificial Intelligence (AI), Natural Language Processing (NLP), and Machine Learning (ML). Clear definitions and resources for developers, researchers, and AI enthusiasts exploring generative language technologies.

ai artificial-intelligence artificial-intelligence-algorithms artificial-intelligence-framework artificial-intelligence-models generative-ai generative-ai-model glossary hacktoberfest large-language-models llm llm-agents llm-evaluation llm-framework llm-inference llm-tools llm-training llms machine-learning-models

Last synced: 24 Jun 2026

https://github.com/randomittin/heimdall

Autonomous Claude Code agent — 14 specialized agents, 10-parallel execution, project-specific skill learning, mechanical checkpointing, wave-based planning with acceptance gates, caveman ultra (~75% token savings). One prompt → finished project.

agent-orchestration ai-agent ai-coding ai-orchestration anthropic automation autonomous-agent claude-agent claude-ai claude-code claude-plugin claude-skill cli coding-assistant developer-tools devtools llm-agent llm-framework llm-tools multi-agent

Last synced: 16 Jun 2026

https://github.com/lahadiyani/soami

soami adalah starter framework modular yang bisa anda customisasi untuk membangun dan menjalankan AI Agents (seperti `Researcher`, `Planner`, dan `Coder`) berbasis Python, Flask. Cocok untuk membangun prototype AGI atau AI tooling dengan sistem orchestrator, memory, tools, dan vectorstore.

ai-agents llm-framework workflow

Last synced: 12 Jun 2025

https://github.com/sergio11/streamlit_llm_langchain_applications

Explore innovative Language Model applications (LLMs) with Streamlit-based Proof of Concepts (POCs) 🚀. These demos showcase open-source models using Groq for cloud-based inference and LangChain for efficient orchestration 🌐. From writing assistants to blog post generators, experience AI-driven tools enhancing productivity and creativity 📚💡.

chromadb faiss faiss-vector-database groq-ai groq-api langchain langchain-python llama3 llm llm-framework llm-inference llms mistral-7b streamlit tavily

Last synced: 01 Mar 2026

https://github.com/zbigniewsobiecki/llmist

Streaming-first multi-provider LLM client in TypeScript with home-made tool calling

agent-framework agents ai anthropic bun function-calling gemini generative-ai llm llm-framework multi-provider nodejs openai streaming tool-calling typescript

Last synced: 04 Mar 2026

https://github.com/es7/introduction-to-llms

In this repository I have explained the application of Large Language Models (LLMs). Starting from how to use LLMs in our own application till how to build a LLM.

computer-vision deep-learning huggingface llm llm-framework llm-inference llm-training machine-learning natural-language-processing prompt-engineering prompt-learning

Last synced: 12 Oct 2025

https://github.com/randomittin/superx

One prompt → finished project. Autonomous Claude Code agent with wave-based parallel execution, pixel-art dashboard, and ~75% token savings.

agent-orchestration ai-agent ai-coding ai-orchestration anthropic automation autonomous-agent claude-agent claude-ai claude-code claude-plugin claude-skill cli coding-assistant developer-tools devtools llm-agent llm-framework llm-tools multi-agent

Last synced: 19 Apr 2026

https://github.com/null-core-ai/null-lens

The missing protocol between user requests and AI actions. Standardized intent parsing for every AI system. Converts any input into [Motive] [Scope] [Priority].

agent agentic agentic-ai agentic-workflow agents ai ai-agent ai-agents llm llm-agents llm-framework llm-tools llms prompt-engineering prompts semantic

Last synced: 14 Dec 2025

https://github.com/chrissmartin/dataset-miner

Generates standardised datasets from given docs for use in LLM training.

ai context context-extraction dataset-generation fine-tuning llm llm-framework

Last synced: 04 Feb 2026

https://github.com/askmanu/acorn

LLM framework for long running agents

ai ai-agents llm-framework

Last synced: 24 Feb 2026

https://github.com/leopeng1995/qwergpt

A Lightweight Framework for building LLM applications.

langchain llamaindex llm-framework

Last synced: 11 Feb 2026

https://github.com/erdogant/llmlight

LLMlight is a lightweight Python library for running local language models with built-in memory, retrieval, and prompt optimization, requiring minimal dependencies.

agentic-ai llm llm-framework local-llm python-library retrieval-augmented-generation-rag

Last synced: 10 Mar 2026

https://github.com/mr-dark-debug/pocketllm

🚀 A powerful Flutter-based AI chat application that lets you run LLMs directly on your mobile device or connect to local model servers. Features offline model execution, Ollama/LLMStudio integration, and a beautiful modern UI. Privacy-focused, cross-platform, and fully open source.

flutter flutter-desktop flutter-mobile llm llm-framework llm-inference local-llm local-llm-integration ollama ollama-api ollama-app ollama-gui ollama-interface ollama-ui self-hosted

Last synced: 09 Sep 2025

https://github.com/playgirlkaybraz11/electron-builder

A complete solution to package and build a ready for distribution Electron app with “auto update” support out of the box

code-generation elasticsearch element-ui gmail-smtp llm-framework mysql-database paypal paypal-payment-gateway plugin

Last synced: 02 Oct 2025

https://github.com/frontllm/frontllm-sdk

FrontLLM is your public gateway to LLMs. Request LLM directly from your front-end code. No backend needed.

ai gateway-api llm llm-framework llm-gateway openai

Last synced: 05 Sep 2025

https://github.com/mangobanaani/sktk

Convenience layer over Semantic Kernel for Python

agent-framework ai-agents anthropic llm llm-framework multi-agent openai python rag semantic-kernel

Last synced: 20 Apr 2026

https://github.com/liliang-cn/contract

An LLM agents framework

llm llm-agent llm-framework llm-local

Last synced: 14 Feb 2026

https://github.com/thomashartm/rockstar-2024-embed

AEM Rockstars 2024 Project - ChatAEM Embeddings Generation Scripts

langchain-typescript llm-framework rag

Last synced: 01 May 2026

https://github.com/angrysky56/task-portal

MCP-Server tool use project concept for Claude and compatible AI.

ai-agents llm-framework mcp-servers

Last synced: 12 Jan 2026

https://github.com/patrik-fredon/ai-chat

Step into the future with AI Chat, a neon-lit, cyberpunk-themed messaging app that revolutionizes your conversations. Featuring advanced AI memory that recalls your last 5 messages, it ensures richer, more meaningful interactions. The app's visually stunning interface includes animated backgrounds, neon glow effects.

ai chat-ai chatbox interference llm-chat-interface llm-framework llm-inference

Last synced: 16 Mar 2025

https://github.com/ahmed-khi/niflheim-x

The 5-minute AI agent framework - build agents 10x faster with 50KB instead of 50MB

ai cross-platform llm llm-framework npm pypi

Last synced: 20 Jan 2026