Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

Awesome Lists | Featured Topics | Projects

https://github.com/llmapi-io/llmapi-cli

Command-line client and python development library for accessing LLM's OpenAPI :computer:
https://github.com/llmapi-io/llmapi-cli

chatbot chatgpt cli gpt-3 large-language-models llama llm openai openapi welm

Last synced: about 12 hours ago
JSON representation

Command-line client and python development library for accessing LLM's OpenAPI :computer:

Awesome Lists containing this project

README

        


LLMApi Cli

LLMApi Cli


Talk to LLMs like ChatGPT in command line

# Introduction

[中文文档](README.zh.md)

`llmapi_cli` is a command-line tool that can directly chat with `chatgpt`/`gpt3` and more large language models(LLM), based on the `llmapi-server` interface.
At the same time llmapi_cli also provides Python module (`LLMClient`).

> For more information visit: [llmapi.io](https://llmapi.io)

## Install

```bash
# install from pypi
python3 -m pip install llmapi_cli
```

```bash
# install locally
python3 setup.py install
```

## Usage

```bash
# The first time you use this command,
# you need to specify parameters, this
# will be cached after successful connection.
#
# If you use your own llmapi-server:
llmapi_cli --host='http://127.0.0.1:5050' --bot=mock
#
# If you use api.llmapi.io (which is default host):
llmapi_cli --bot=mock --apikey='your apikey on llmapi.io'
```

```bash
# You can directly use this command again:
llmapi_cli
#
# Or change the bot type:
llmapi_cli --bot=gpt3
#
# Or redesignate params like first time.
```

### Screenshot
![image](imgs/llmapi_cli_demo.png)

# Currently supported bot type

> View [llmapi-server](https://github.com/llmapi-io/llmapi-server) for more information.

Warning: Currently for testing only

- `chatgpt`: openai's official ChatGPT,[see more](https://openai.com/blog/introducing-chatgpt-and-whisper-apis)
- `gpt3`: openai's official GPT-3
- `welm`: Tencent weixin's llm,[see more](https://welm.weixin.qq.com/docs/introduction/)
- `newbing`: microsoft's new bing chat, `UNOFFICIAL INTERFACE`