https://github.com/chin-gyou/MovieChats

https://github.com/chin-gyou/MovieChats

Last synced: about 1 month ago
JSON representation

• Host: GitHub
• URL: https://github.com/chin-gyou/MovieChats
• Owner: chin-gyou
• Created: 2020-12-18T08:09:16.000Z (about 4 years ago)
• Default Branch: main
• Last Pushed: 2020-12-18T09:07:58.000Z (about 4 years ago)
• Last Synced: 2024-08-03T09:07:12.905Z (5 months ago)
• Language: Python
• Size: 172 KB
• Stars: 20
• Watchers: 1
• Forks: 1
• Open Issues: 4
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

• StarryDivineSky - chin-gyou/MovieChats

README

        
# MovieChats

![Training](/pic/train.png)

![Inference-1](/pic/inference_1.png)

![Inference-2](/pic/inference_2.png)

## Dataset & Model Download

[MovieData](https://drive.google.com/file/d/11J4ATJ4IYMG8KgKBOZspQn3PZAG1e_SH/view?usp=sharing)

[chitchat_pretrain_model](https://drive.google.com/file/d/1kxN23eH1WXW4MVnf0JFieMQgF6gv6FmE/view?usp=sharing)

[fine-tuned model](https://drive.google.com/file/d/1LC80U5Gck6PCicdqyd2s5KDUgD4EEq1Q/view?usp=sharing)

## Preprocessing: 

Each dialogue turn will be represented as a sequence, which contains previous user/system turns, dialog act, knowledge(None), and response

```

[context][user]你觉得血色身材这部电影好看吗？[system]我觉得简直是太精彩了，[user]是吗？[system]就要讲述的故事，一环扣一环，剧情特别的惊心动魄，[user]是不是给人一种特别的紧张感？[system]简直你说的太实在了，[user]是吧，我觉得这部电影算是精品吧，[system]我觉得是精品中的精品，[user]怎么你对这部片儿的评价很高呀？[system]是啊，因为我喜欢看这一种嘛，简直是太好看了，[endofcontext][action][endofaction][knowledge][endofknowledge]

[response]行，那以后我要是有这种电影的话，我还推荐给你[endofresponse]

```

## Usage

unzip ul_model_best.zip

unzip pretrain_model.zip

unzip movie_data.zip

**Requirements**

* python 2.7+

* transformers==2.1.1

**Run**

``` bash

./train_ul_best.sh

```

train the model

``` bash

python ./train_ul_best.py --epochs 8 --batch_size 64 --pretrained_model ./pretrain_model/pytorch_model.bin  

```

### hyper-parameter settings

```json

{

  "initializer_range": 0.02,

  "layer_norm_epsilon": 1e-05,

  "n_ctx": 300,

  "n_embd": 768,

  "n_head": 12,

  "n_layer": 12,

  "n_positions": 300,

  "vocab_size": 13317

}

```

## Reference

```TeX

@inproceedings{su2020moviechats,

  title={MovieChats: Chat like Humans in a Closed Domain},

  author={Su, Hui and Shen, Xiaoyu and Xiao, Zhou and Zhang, Zheng and Chang, Ernie and Zhang, Cheng and Niu, Cheng and Zhou, Jie},

  booktitle={Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP)},

  pages={6605--6619},

  year={2020}

} 

```

## Thanks 

GPT2-chitchat(https://github.com/yangjianxin1/GPT2-chitchat)

CDial-GPT(https://github.com/thu-coai/CDial-GPT)