Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

Awesome Lists | Featured Topics | Projects

https://github.com/melih-unsal/DemoGPT

🤖 Everything you need to create an LLM Agent—tools, prompts, frameworks, and models—all in one place.
https://github.com/melih-unsal/DemoGPT

agent agents ai artificial-intelligence autogpt autonomous-agents chatgpt chatgpt-api demo gpt-4 gpt3-turbo langchain langchain-app langchain-python llama2 llms openai python streamlit streamlit-application

Last synced: about 1 month ago
JSON representation

🤖 Everything you need to create an LLM Agent—tools, prompts, frameworks, and models—all in one place.

Awesome Lists containing this project

README 

        
# 🤖 From Demo to Product: The All-in-One Agent Library





DemoGPT logo: Generate automatic LangChain pipelines






⚡ Everything you need to create an LLM Agent is here. Access a comprehensive suite of tools, prompts, frameworks, and a knowledge hub of LLM models—all in one place to streamline your agent development.





Downloads

Releases

Official Website

DemoGPT Documentation






CN doc

EN doc

roadmap

roadmap

License: MIT






Open an issue

Closed issues

DemoGPT  Stars

 






Twitter Follow

DemoGPT Medium

DemoGPT - Auto generative AI app generator with the power of Llama 2 | Product Hunt






Streamlit application






## ⭐ Star History



[![Star History Chart](https://api.star-history.com/svg?repos=melih-unsal/DemoGPT&type=Timeline)](https://star-history.com/#melih-unsal/DemoGPT&Timeline)



⭐ Consider starring us if you're using DemoGPT so more people hear about us!



## 🔥 Demo



For quick demo, you can visit [our website](https://demogpt.io)



![Tweet Generator](assets/web_blogger.gif)



## 📚 Documentation



See our documentation site [here](https://docs.demogpt.io/) for full how-to docs and guidelines



⚡ With DemoGPT v1.3, API usage will be possible with the power of **Gorilla** within 2 weeks.

After this release, you will be able use external APIs autonomously. ⚡



## 📦 Using DemoGPT Package



The DemoGPT package is now available and can be installed using pip. Run the following command to install the package:



```sh

pip install demogpt

```



To use the DemoGPT application, simply type "demogpt" into your terminal:



```sh

demogpt

```



## 📑 Table of Contents



- [Introduction](#-introduction)

- [Architecture](#%EF%B8%8F-architecture)

- [Installation](#-installation)

- [Usage](#-usage)

- [To-Do](#to-do-)

- [Contribute](#-contribute)

- [Citations](#-citations) 

- [License](#-license)



## 📌 Introduction



Welcome to DemoGPT, a revolutionary open-source initiative that is reshaping the landscape of Large Language Model (LLM) based application development.



At the heart of DemoGPT, the capabilities of GPT-3.5-turbo come to life, driving the automatic generation of LangChain code. This process is enriched with a sophisticated architecture that translates user instructions into interactive Streamlit applications.



### How DemoGPT Works



1. **Planning:** DemoGPT starts by generating a plan from the user's instruction.

2. **Task Creation:** It then creates specific tasks from the plan and instruction.

3. **Code Snippet Generation:** These tasks are transferred into code snippets.

4. **Final Code Assembly:** The code snippets are combined into a final code, resulting in an interactive Streamlit app.



The LangChain code, once generated, is not a mere endpoint but a transformative stage. It evolves into a user-friendly Streamlit application, adding an interactive dimension to the logic crafted. This metamorphosis embodies DemoGPT's commitment to user engagement and experience.



### Future Enhancements



We are planning to add a publicly available database that will accelerate the generation process by retrieving similar examples during the refining process. This innovation will further streamline the development workflow, making it more efficient and responsive.



### Model Flexibility



DemoGPT is designed to be adaptable, capable of using any LLM model that meets specific performance criteria in terms of code generation. This flexibility ensures that DemoGPT remains at the forefront of technology, embracing new advancements in LLM.



DemoGPT's iterative development process remains a cornerstone of its innovation. Each code segment undergoes individual testing, and the self-refining strategy ensures an efficient and error-minimized workflow. This fusion of meticulous testing and refinement is a testament to DemoGPT's pursuit of excellence.



By transcending traditional coding paradigms, DemoGPT is pioneering a new era in LLM-based applications. It's not just about code generation; it's about crafting intelligent, interactive, and inclusive solutions.



In summary, DemoGPT is more than a project; it's a visionary approach, pushing the boundaries of what's possible in LLM-based application development.



In the next release, we are gonna integrate **Gorilla** to DemoGPT to enable DemoGPT to use external APIs autonomously. The future is bright, and the journey has just begun. Join us in this exciting adventure!



## ⚙️ Architecture

### DemoGPT Architecture

![DemoGPT Architecture](assets/plan_based_pipeline.png?raw=true "DemoGPT Architecture")



## 🔧 Installation



### For the Package Version



You can install the DemoGPT package by running the following command:



```sh

pip install demogpt

```



### For the Source Code Version



1. Clone the repository:

    ```sh

    git clone https://github.com/melih-unsal/DemoGPT.git

    ```

2. Navigate into the project directory:

    ```sh

    cd DemoGPT

    ```

3. Install DemoGPT: 

    ```sh

    pip install .

    ```



## 🎮 Usage



### 📦 For the Package Version



Once the DemoGPT package is installed, you can use it by running the following command in your terminal:



```sh

demogpt

```



### 🐍 For the Python Interface



You can now use DemoGPT as a library in your Python applications:



```python

from demogpt import DemoGPT

agent = DemoGPT(model_name="gpt-3.5-turbo") # if OPENAI_API_KEY is not set in env variables, put it with openai_api_key argument

instruction = "Your instruction here"

title = "Your title here"

code = ""

for phase in agent(instruction=instruction, title=title):

    print(phase) # this will display the resulting json for each generation stage

    if phase["done"]:

        code = phase["code"] # final code

print(code)

```



Example Output (truncated):



```bash

# phases

{'stage': 'draft', 'completed': False, 'percentage': 60, ...}

{'stage': 'draft', 'completed': False, 'percentage': 64, 'code': '#Get the source language ...'}

...

{'stage': 'final', 'completed': True, 'percentage': 100, ... , 'code': 'import streamlit as st\n...'}

```



```python

# Code

import streamlit as st

from langchain.chains import LLMChain

from langchain_community.chat_models import ChatOpenAI

from langchain.prompts.chat import (ChatPromptTemplate,

                                    HumanMessagePromptTemplate,

                                    SystemMessagePromptTemplate)

...

```



### 🌐 For the Source Code Version



If you have cloned the repository and wish to run the source code version, you can use DemoGPT by running the following command:



```sh

streamlit run demogpt/app.py

```



## To-Do 📝

- [x] Implement new DemoGPT pipeline including plan generation, task creation, code snippet generation, and final code assembly.

- [x] Add feature to allow users to select models.

- [x] Define useful LangChain tasks

- [x] Publish release with the new pipeline without refinement

- [ ] Implement remaining LangChain tasks

- [ ] Implement self-refining strategy for model response refinement.

- [ ] Integrate 🦍 Gorilla model for API calls.

- [ ] Add Rapid API for expanding available API calls. 

- [ ] Add 🦙 Llama2 integration

- [ ] Implement publicly available database to accelerate the generation process by retrieving similar examples during the refining process.

- [ ] Add all successfully generated steps to a DB to eliminate redundant refinement.



## 🤝 Contribute



Contributions to the DemoGPT project are welcomed! Whether you're fixing bugs, improving the documentation, or proposing new features, your efforts are highly appreciated. Please check the open issues before starting any work.



> Please read [`CONTRIBUTING`](CONTRIBUTING.md) for details on our [`CODE OF CONDUCT`](CODE_OF_CONDUCT.md), and the process for submitting pull requests to us.



## 📄 Citations



DemoGPT has been referenced in various research papers for its innovative approach to app creation using autonomous AI agents. Below is a list of papers that have cited DemoGPT:



- Lei Wang, Chen Ma , Xueyang Feng , Zeyu Zhang, Hao Yang, Jingsen Zhang, Zhiyuan Chen, Jiakai Tang, Xu Chen, Yankai Lin, Wayne Xin , Zhao, Zhewei Wei, Ji-Rong Wen, "A Survey on Large Language Model based Autonomous Agents", 2023. [Link to paper](https://arxiv.org/pdf/2308.11432.pdf)

- Yuan Li, Yixuan Zhang, Lichao Sun, "METAAGENTS: SIMULATING INTERACTIONS OF HUMAN BEHAVIORS FOR LLM-BASED TASK-ORIENTED COORDINATION VIA COLLABORATIVE GENERATIVE AGENTS" Journal/Conference, 2023. [Link to paper](https://arxiv.org/pdf/2310.06500.pdf)

- Yuheng Cheng, Ceyao Zhang, Zhengwen Zhang, Xiangrui Meng, Sirui Hong, Wenhao Li, Zihao Wang, Zekai Wang, Feng Yin, Junhua Zhao, Xiuqiang He, "EXPLORING LARGE LANGUAGE MODEL BASED INTELLIGENT AGENTS: DEFINITIONS, METHODS, AND PROSPECTS", 2024. [Link to paper](https://arxiv.org/pdf/2401.03428.pdf)

- Mikhail, Poludin. Optimalizace LLM agentů pro analýzu tabulkových dat: Integrace LoRA pro zvýšení kvality. MS thesis. České vysoké učení technické v Praze. Vypočetní a informační centrum., 2024. [Link to paper](https://dspace.cvut.cz/bitstream/handle/10467/115388/F3-DP-2024-Poludin-Mikhail-Optimizing_LLM-Powered_Agents_for_Tabular_Data_Analytics_Integrating_LoRA_for_Enhanced_Quality.pdf?sequence=-1)



This acknowledgment from the academic community highlights the potential and utility of DemoGPT in advancing the field of AI-driven development tools.



## 📜 License



DemoGPT is an open-source project licensed under [MIT License](LICENSE).



---



For any issues, questions, or comments, please feel free to contact us or open an issue. We appreciate your feedback to make DemoGPT better.