Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

Awesome Lists | Featured Topics | Projects

https://github.com/kdeps/kdeps

Kdeps reduces the complexity of building self-hosted RAG AI Agents and APIs powered by open-source LLMs
https://github.com/kdeps/kdeps

agents ai-agents api artificial-intelligence cuda docker dockerized fine-tuning huggingface llama llm llm-agent llmops mistral mlops model-inference multimodal nvidia opensource vicuna

Last synced: 2 days ago
JSON representation

Kdeps reduces the complexity of building self-hosted RAG AI Agents and APIs powered by open-source LLMs

Awesome Lists containing this project

README

        

Kdeps is a multi-model AI agent framework that is optimized for creating purpose-built
Dockerized AI agent APIs ready to be deployed on/off cloud. It utilizes self-contained
open-source LLM models that are orchestrated by a graph-based dependency workflow.

Kdeps - Demo

Kdeps is packed with features:
- ๐Ÿš€ Run Kdeps in single-execution or API Mode
- ๐Ÿค– Use Multiple Open-Source LLMs
- ๐Ÿ Run Python scripts in isolated environments using Anaconda
- ๐Ÿ–ฅ๏ธ Execute Custom Shell-Scripts
- ๐Ÿงช Anaconda Support
- ๐Ÿ”„ Share and Remix AI Agents
- ๐ŸŒ Interact with external HTTP APIs directly into the resource
- ๐Ÿ“Š Generate structured outputs from LLMs
- ๐Ÿ“ฆ Install dependent Ubuntu packages from within the workflow configuration
- ๐Ÿ“œ Define custom Ubuntu repositories and PPAs in the workflow
- ๐Ÿ“ˆ RAG Graph-based workflow execution
- โšก Written in Golang

## Installation

Please see the installation instructions [here](https://kdeps.github.io/kdeps/getting-started/introduction/installation.html).

## Quickstart

Take a look at our quickstart guide [here](https://kdeps.github.io/kdeps/getting-started/introduction/quickstart.html).