https://github.com/PaddlePaddle/Knover

Large-scale open domain KNOwledge grounded conVERsation system based on PaddlePaddle
https://github.com/PaddlePaddle/Knover

Last synced: about 2 months ago
JSON representation

Large-scale open domain KNOwledge grounded conVERsation system based on PaddlePaddle

• Host: GitHub
• URL: https://github.com/PaddlePaddle/Knover
• Owner: PaddlePaddle
• License: apache-2.0
• Created: 2020-07-03T08:14:38.000Z (about 4 years ago)
• Default Branch: develop
• Last Pushed: 2024-03-06T03:28:32.000Z (6 months ago)
• Last Synced: 2024-04-23T02:40:02.522Z (5 months ago)
• Language: Python
• Homepage:
• Size: 4.41 MB
• Stars: 672
• Watchers: 23
• Forks: 131
• Open Issues: 65
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

• Awesome-Open-domain-Dialogue-Models - 项目地址 - KAG) | 中文知识型对话 | (中文对话模型 / PLATO系列)

README

        
# Knover

Knover is a toolkit for knowledge grounded dialogue generation based on PaddlePaddle. Knover allows researchers and developers to carry out efficient training/inference of large-scale dialogue generation models. 

### What's New:

* October 2022: We are opening [Q-TOD](projects/Q-TOD/README.md), a novel query-driven task-oriented dialogue system.

* March 2022: We are opening [PLATO-KAG](projects/PLATO-KAG/README.md), an unsupervised learning approach for end-to-end knowledge-grounded conversation modeling.

* February 2022: We are opening our TOD-DA dataset, models and code in [DSTC10-Track2](projects/DSTC10-Track2/README.md).

* December 2021: We are opening the dialogue generation model of [PLATO-XL](projects/PLATO-XL/README.md), with up to 11 billion parameters.

* October 2021: We are opening [AG-DST](projects/AG-DST/README.md), an amendable generation for dialogue state tracking.

* February 2021: We are opening our implementation (Team 19) in [DSTC9-Track1](projects/DSTC9-Track1/README.md).

* July 2020: We are opening [PLATO-2](projects/PLATO-2/README.md), a large-scale generative model with latent space for open-domain dialogue systems.

## Requirements and Installation

* python version >= 3.7

* paddlepaddle-gpu version >= 2.4.0

    * You can install PaddlePaddle following [the instructions](https://www.paddlepaddle.org.cn/documentation/docs/en/install/index_en.html).

    * The specific version of PaddlePaddle is also based on your [CUDA version](https://developer.nvidia.com/cuda-downloads) (recommended version: 10.1) and [CuDNN version](https://developer.nvidia.com/rdp/cudnn-download) (recommended version: 7.6). See more information on [PaddlePaddle document about GPU support](https://www.paddlepaddle.org.cn/documentation/docs/en/install/index_en.html#paddlepaddle-s-support-for-gpu)

* sentencepiece

* termcolor

* If you want to run distributed training, you'll also need [NCCL](https://developer.nvidia.com/nccl/nccl-download)

* Install Knover locally:

```bash

git clone https://github.com/PaddlePaddle/Knover.git

cd Knover

pip3 install -e .

```

* Or you can setup `PYTHONPATH` only:

```bash

export PYTHONPATH=/abs/path/to/Knover:$PYTHONPATH

```

## Basic usage

- See [usage document](docs/usage.md).

## Disclaimer

This project aims to facilitate further research progress in dialogue generation. Baidu is not responsible for the 3rd party's generation with the pre-trained system.

## Contact information

For help or issues using Knover, please submit a GitHub issue.