Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/hyunwoongko/openchat
OpenChat: Easy to use opensource chatting framework via neural networks
https://github.com/hyunwoongko/openchat
Last synced: 15 days ago
JSON representation
OpenChat: Easy to use opensource chatting framework via neural networks
- Host: GitHub
- URL: https://github.com/hyunwoongko/openchat
- Owner: hyunwoongko
- License: apache-2.0
- Created: 2021-02-28T02:04:34.000Z (over 3 years ago)
- Default Branch: main
- Last Pushed: 2023-07-15T05:29:35.000Z (over 1 year ago)
- Last Synced: 2024-10-14T21:48:34.494Z (27 days ago)
- Language: Python
- Homepage:
- Size: 465 KB
- Stars: 437
- Watchers: 16
- Forks: 57
- Open Issues: 10
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
# OpenChat: Easy to use opensource chatting framework via neural networks
```
____ ____ ______ _ __ ______ __ __ ___ ______
/ __ \ / __ \ / ____// | / / / ____// / / // | /_ __/
/ / / // /_/ // __/ / |/ / / / / /_/ // /| | / /
/ /_/ // ____// /___ / /| / / /___ / __ // ___ | / /
\____//_/ /_____//_/ |_/ \____//_/ /_//_/ |_|/_/
```
- OpenChat is easy to use opensource chatting framework.
- OpenChat supports 40+ dialogue model based on neural networks.
- You can talk with AI with **only one line of code.**
## Installation
```console
pip install openchat
```
## Supported Models
- OpenChat supports 40+ dialogue models based on neural networks.
- Use these names as parameter
model='name'when you createOpenChat. -
Click here if you want to check supported models.
GPT-Neo
- gptneo.small
- gptneo.medium
- gptneo.large
- gptneo.xlarge
Blender
- blender.small
- blender.medium
- blender.large
- blender.xlarge
- blender.xxlarge
DialoGPT
- dialogpt.small
- dialogpt.medium
- dialogpt.large
Dodecathlon
- dodecathlon.all_tasks_mt
- dodecathlon.convai2
- dodecathlon.wizard_of_wikipedia
- dodecathlon.empathetic_dialogues
- dodecathlon.eli5
- dodecathlon.reddit
- dodecathlon.twitter
- dodecathlon.ubuntu
- dodecathlon.image_chat
- dodecathlon.cornell_movie
- dodecathlon.light_dialog
- dodecathlon.daily_dialog
Reddit
- reddit.xlarge
- reddit.xxlarge
Safety
- safety.offensive
- safety.sensitive
Unlikelihood
- unlikelihood.wizard_of_wikipedia.context_and_label
- unlikelihood.wizard_of_wikipedia.context
- unlikelihood.wizard_of_wikipedia.label
- unlikelihood.convai2.context_and_label
- unlikelihood.convai2.context
- unlikelihood.convai2.label
- unlikelihood.convai2.vocab.alpha.1e-0
- unlikelihood.convai2.vocab.alpha.1e-1
- unlikelihood.convai2.vocab.alpha.1e-2
- unlikelihood.convai2.vocab.alpha.1e-3
- unlikelihood.eli5.context_and_label
- unlikelihood.eli5.context
- unlikelihood.eli5.label
Wizard of Wikipedia
- wizard_of_wikipedia.end2end_generator
## Usage
- Just import and create a object. That's all.
```python
>>> from openchat import OpenChat
>>> OpenChat(model="blender.medium", device="cpu")
```
- Set param `device='cuda'` If you want to use GPU acceleration.
```python
>>> from openchat import OpenChat
>>> OpenChat(model="blender.medium", device="cuda")
```
- Set param `device='cuda:n'` If you want to use a specific GPU.
```python
>>> from openchat import OpenChat
>>> OpenChat(model="blender.medium", device="cuda:2") # <--- use 3rd GPU
>>> OpenChat(model="blender.medium", device="cuda:0") # <--- use 1st GPU
```
- Set `**kwargs` if you want to change decoding options.
- method (str): one of `["greedy", "beam", "top_k", "nucleus"]`,
- num_beams (int): size of beam search
- top_k (int): K value for top-k sampling
- top_p: (float): P value for nucleus sampling
- no_repeat_ngram_size (int): beam search n-gram blocking size for removing repetition,
- length_penalty (float): length penalty (1.0=None, UP=Longer, DOWN=Shorter)
- Decoding options must be `keyword argument` not `positional argument`.
```python
>>> from openchat import OpenChat
>>> OpenChat(
... model="blender.medium",
... device="cpu",
... method="top_k",
... top_k=20,
... no_repeat_ngram_size=3,
... length_penalty=0.6,
... )
```
- For `safety.offensive` model, parameter `method` must be one of `["both", "string-match", "bert"]`
```python
>>> from openchat import OpenChat
>>> OpenChat(
... model="safety.offensive",
... device="cpu"
... method="both" # ---> both, string-match, bert
... )
```
## Special Tasks
### 1. GPT-Neo
- The GPT-Neo model was released in the EleutherAI/gpt-neo repository.
- It is a GPT2 like causal language model trained on the Pile dataset.
- Openchat supports the above Prompt based dialogues via GPT-Neo.
- Below models provides custom prompt setting. (`*` means all models)
- `gptneo.*`
### 2. ConvAI2
- ConvAI2 is one of the most famous conversational AI challenges about a persona.
- Openchat provides custom persona setting like above image.
- Below models provides custom perona setting. (`*` means all models)
- `blender.*`
- `dodecathlon.convai2`
- `unlikelihood.convai2.*`
### 3. Wizard of Wikipedia
- Wizard of wikipedia is one of most famous knowledge grounded dialogue dataset.
- Openchat provides custom topic setting like above image.
- Below models provides custom topic setting. (`*` means all models)
- `wizard_of_wikipedia.end2end_generator`
- `dodecathlon.wizard_of_wikipedia`
- `unlikelihood.wizard_of_wikipedia.*`
### 4. Safety Agents
- Openchat provides a dialog safety model to help you design conversation model.
- Below models provides dialog safety features.
- `safety.offensive`: offensive words classification
- `safety.sensitive`: sensitive topic classification
## License
```
Copyright 2021 Hyunwoong Ko.
Licensed under the Apache License, Version 2.0 (the "License");
you may not use this file except in compliance with the License.
You may obtain a copy of the License at
http://www.apache.org/licenses/LICENSE-2.0
Unless required by applicable law or agreed to in writing, software
distributed under the License is distributed on an "AS IS" BASIS,
WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
See the License for the specific language governing permissions and
limitations under the License.
```