Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/weaigc/gradio-chatbot
A tool that can automatically convert ๐ค Huggingface Spaces,้ญๆญๅ็ฉบ้ด and Gradio ChatBot into free APIs. Supports GPT4Free,ChatGPT,Llama2,MPT,Falcon Chat,ChatGLM,้ไนๅ้ฎ and many other chatbot like spaces.
https://github.com/weaigc/gradio-chatbot
chatgpt gpt4free gradio-interface huggingface llama2 mpt
Last synced: 29 days ago
JSON representation
A tool that can automatically convert ๐ค Huggingface Spaces,้ญๆญๅ็ฉบ้ด and Gradio ChatBot into free APIs. Supports GPT4Free,ChatGPT,Llama2,MPT,Falcon Chat,ChatGLM,้ไนๅ้ฎ and many other chatbot like spaces.
- Host: GitHub
- URL: https://github.com/weaigc/gradio-chatbot
- Owner: weaigc
- License: apache-2.0
- Created: 2023-07-02T13:30:09.000Z (over 1 year ago)
- Default Branch: main
- Last Pushed: 2024-05-15T14:56:42.000Z (6 months ago)
- Last Synced: 2024-10-10T05:38:47.831Z (29 days ago)
- Topics: chatgpt, gpt4free, gradio-interface, huggingface, llama2, mpt
- Language: TypeScript
- Homepage: https://weaigc.github.io/gradio-chatbot-ui/
- Size: 2.57 MB
- Stars: 148
- Watchers: 6
- Forks: 23
- Open Issues: 8
-
Metadata Files:
- Readme: README.md
- Changelog: CHANGELOG.md
- License: LICENSE
Awesome Lists containing this project
- awesome-ChatGPT-repositories - gradio-chatbot - A tool that can automatically convert ๐ค Huggingface Spaces,้ญๆญๅ็ฉบ้ด and Gradio ChatBot into free APIs. Supports GPT4Free,ChatGPT,Llama2,MPT,Falcon Chat,ChatGLM,้ไนๅ้ฎ and many other chatbot like spaces. (Chatbots)
README
# Gradio Chatbot
> A tool that can automatically convert [Huggingface Spaces](https://huggingface.co/spaces), [Modelscope Studios](https://www.modelscope.cn/studios) and Gradio ChatBot into free APIs. It basically supports any space with a chatbot, and currently perfectly supports many model spaces such as [GPT4Free, ChatGPT, Llama 2, Vicuna, MPT-30B, Falcon, ChatGLM, Qwen and so on](#model-list).
English | [ไธญๆ](README_CN.md)
[](https://www.npmjs.com/package/gradio-chatbot)
[](https://github.com/weaigc/gradio-chatbot/blob/main/license)
Online Demo: https://weaigc.github.io/gradio-chatbot
> Due to the current high demand on the [ChatGPT](https://huggingface.co/spaces/yuntian-deng/ChatGPT) space on Huggingface, there is a noticeable delay in response time. If you have your own ChatGPT account, it is recommended to use [gpt-web](https://github.com/weaigc/gpt-web).
- [Quick Start](#quick-start)
- [Installation](#installation)
- [NPM](#npm)
- [Docker](#docker)
- [Usage](#usage)
- [CLI Mode](#cli-mode)
- [API Service](#api-service)
- [API Function](#api-function)
- [OpenAI](#using-openai)
- [API Docs](#api-document)
- [Model List](#model-list)
- [Compatibility](#compatibility)
- [ChangeLog](#change-log)
- [Credits](#credits)
- [License](#license)
## Quick Start
### NPM
* Experience a free ChatGPT.
```bash
npx gradio-chatbot
# or
npm install -g gradio-chatbot
# call the default model
chatbot
```
* Experience Llama2.
```bash
chatbot 2
# or
chatbot https://huggingface.co/spaces/huggingface-projects/llama-2-13b-chat
```
> More usage just type `chatbot help`
### Docker
```
docker build . -t gradio-server
docker run --rm -it -p 8000:8000 gradio-server
```
[](https://asciinema.org/a/0ki5smP795eyXdXGlx53UDmTB)
## Installation
You can use npm or yarn to install gradio-chatbot. Node version 18 or higher is required.
```bash
npm install gradio-chatbot
# or
yarn add gradio-chatbot
```
## Usage
Currently supports three modes.
### CLI mode
Refer to [Quickstart](#Quickstart).
### API Service
To make it easy to use, two forms of interfaces are provided.
Streaming output, simply visit http://localhost:8000/api/conversation?model=0&text=hello.
Non-streaming output, the calling method is the same as ChatGPT API. The following is an example of a call.
### API Function
```ts
import { GradioChatBot } from 'gradio-chatbot'
const bot = new GradioChatBot();
async function start() {
const message = await bot.chat('hello', {
onMessage(partialMsg) {
console.log('stream output:', partialMsg);
}
});
console.log('message', message);
}
start();
```
You can also input the spatial address you want to convert, such as https://huggingface.co/spaces/h2oai/h2ogpt-chatbot.
```ts
import { GradioChatBot } from 'gradio-chatbot'
const bot = new GradioChatBot({
url: 'https://huggingface.co/spaces/h2oai/h2ogpt-chatbot',
fnIndex: 35,
}); // ่ฐ็จ่ชๅฎไน ChatBot ๆจกๅ
async function start() {
console.log(await bot.chat('Hello'));
}
```
In addition, the NPM package has built-in support for 10 popular spaces from [Hugging Face Spaces](https://huggingface.co/spaces) and [Modelscope Studios](https://www.modelscope.cn/studios). You can directly use the model index to access them. Please refer to the [Model List](#model-list) for more details.
```ts
import { GradioChatBot } from 'gradio-chatbot';
const bot = new GradioChatBot('1');
async function start() {
console.log(await bot.chat('Tell me about ravens.'));
}
start();
```
For more examples, please visit the directory: [Examples](./examples/) .
> Note: Some models on Hugging Face may collect the information you input. If you have data security concerns, it is recommended not to use them, and using self-hosted models is a better choice.
### Using OpenAI
#### Python
```
import openai
openai.api_key = "dummy"
openai.api_base = "http://127.0.0.1:8080/v1"
# create a chat completion
chat_completion = openai.ChatCompletion.create(model="10", messages=[{"role": "user", "content": "Hello"}])
# print the completion
print(chat_completion.choices[0].message.content)
```
> For more usage instructions, please refer to https://github.com/openai/openai-python
#### Node.js
```
import OpenAI from 'openai';
const openai = new OpenAI({
baseURL: 'http://127.0.0.1:8080/v1'
});
async function main() {
const stream = await openai.chat.completions.create({
model: '10',
messages: [{ role: 'user', content: 'Hello' }],
stream: true,
});
for await (const part of stream) {
process.stdout.write(part.choices[0]?.delta?.content || '');
}
}
main();
```
> For more usage instructions, please refer to https://github.com/openai/openai-node
## API Document
See [API Document](./API.md)
## Model List
Index | Type | Description | Model
-----|-----|------|-------
0 | Huggingface Spaces | ChatGPT | https://huggingface.co/spaces/yizhangliu/chatGPT
1 | Huggingface Spaces | GPT Free | https://huggingface.co/spaces/justest/gpt4free
2 | Huggingface Spaces | Llama2 Spaces | https://huggingface.co/spaces/ysharma/Explore_llamav2_with_TGI
3 | Huggingface Spaces | MosaicML MPT-30B-Chat | https://huggingface.co/spaces/mosaicml/mpt-30b-chat
4 | Huggingface Spaces | Falcon Chat | https://huggingface.co/spaces/HuggingFaceH4/falcon-chat
5 | Huggingface Spaces | Star Chat | https://huggingface.co/spaces/HuggingFaceH4/starchat-playground
6 | Huggingface Spaces | ChatGLM2 | https://huggingface.co/spaces/mikeee/chatglm2-6b-4bit
7 | Huggingface Spaces | ChatGLM | https://huggingface.co/spaces/multimodalart/ChatGLM-6B
8 | Huggingface Spaces | Vicuna | https://chat.lmsys.org/
9 | Huggingface Spaces | Qwen 7B Chat | https://huggingface.co/spaces/mikeee/qwen-7b-chat
10 | ModelScope | Qwen 7B Chat | https://modelscope.cn/studios/qwen/Qwen-7B-Chat-Demo/summary
11 | ModelScope | ChatGLM2 | https://modelscope.cn/studios/AI-ModelScope/ChatGLM6B-unofficial/summary
12 | ModelScope | Jiang Ziya V1.1 | https://modelscope.cn/studios/Fengshenbang/Ziya_LLaMA_13B_v1_online/summary
13 | ModelScope | Character Dialogue Chatbot developed by Alibaba DAMO Academy | https://modelscope.cn/studios/damo/role_play_chat/summary
> More useful models are welcome to contribute in the [issue](https://github.com/weaigc/gradio-chatbot/issues) section.
## Change Log
See [CHANGELOG.md](./CHANGELOG.md)
## Compatibility
- This package supports `node >= 18`.
## Credits
- Huge thanks to [@gradio/client](https://github.com/gradio-app/gradio/tree/main/client/js)
- [OpenAI](https://openai.com) for creating [ChatGPT](https://openai.com/blog/chatgpt/) ๐ฅ
## License
Apache 2.0 ยฉ [LICENSE](https://github.com/weaigc/gradio-chatbot/blob/main/LICENSE).