https://github.com/jm12138/CPM-Generate-Paddle

Chinese Pre-Trained Language Models (CPM-LM) Version-I for PaddlePaddle 2.x
https://github.com/jm12138/CPM-Generate-Paddle

Last synced: 2 months ago
JSON representation

Chinese Pre-Trained Language Models (CPM-LM) Version-I for PaddlePaddle 2.x

• Host: GitHub
• URL: https://github.com/jm12138/CPM-Generate-Paddle
• Owner: jm12138
• License: apache-2.0
• Created: 2020-11-28T11:34:39.000Z (over 3 years ago)
• Default Branch: main
• Last Pushed: 2021-03-09T03:58:40.000Z (over 3 years ago)
• Last Synced: 2024-01-21T22:10:54.200Z (5 months ago)
• Language: Python
• Homepage:
• Size: 871 KB
• Stars: 54
• Watchers: 3
• Forks: 9
• Open Issues: 7
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Lists

• awesome-pretrained-chinese-nlp-models - CPM-Generate-Paddle

README

        
# CPM-Generate-Paddle

本Repo将模型转换为PaddlePaddle版本，原Repo https://github.com/TsinghuaAI/CPM-Generate

原项目首页：https://cpm.baai.ac.cn/

原项目介绍文章：https://mp.weixin.qq.com/s/oI2Ak-M57MSuycLVpVEiHw

## 更新

基于 PaddleNLP 的新版本已更新[【项目链接】](https://aistudio.baidu.com/aistudio/projectdetail/1612806)

## 项目说明

参考[CPM-Generate](https://github.com/TsinghuaAI/CPM-Generate)、[CPM-LM-TF2](https://github.com/qhduan/CPM-LM-TF2)、[gpt-2-Pytorch](https://github.com/graykode/gpt-2-Pytorch)等项目开发

感谢上述项目的开源代码和模型

## 快速试用

可以使用百度AIStudio平台简单快速的体验试用这个模型，[项目链接](https://aistudio.baidu.com/aistudio/projectdetail/1279908)

## 使用说明

* 克隆本项目代码

```shell

$ git clone https://github.com/jm12138/CPM-Generate-Paddle

$ cd CPM-Generate-Paddle

```

* 准备模型文件

  * 如果你没有原版模型可以直接下载：[下载链接](http://bj.bcebos.com/v1/ai-studio-online/61492e028f1e4a5e863abbab062b4cfc428c114c8e794429a3448da9610180e4?responseContentDisposition=attachment%3B%20filename%3DCPM-LM.pdparams&authorization=bce-auth-v1%2F0ef6765c1e494918bc0d4c3ca3e5c6d1%2F2020-12-02T16%3A21%3A57Z%2F-1%2F%2Fffcd85aa00f73ab708450dd6b4d880519c7d72458a8d8e88027b4cfe5bb59377)

  * 如果已经下载了原版模型可以自己进行转换：请参考[转换代码](https://github.com/jm12138/CPM-Generate-Paddle/blob/main/convert.py)

* 安装如下依赖

```

sentencepiece 

jieba

paddlepaddle>=2.0.0rc0

```

* 运行测试Demo

```shell

$ python AI_Bot.py --pretrained_model [path to the pretrained model]

```

## 引用

> @article{cpm-v1,

  title={CPM: A Large-scale Generative Chinese Pre-trained Language Model},

  author={Zhang, Zhengyan and Han, Xu, and Zhou, Hao, and Ke, Pei, and Gu, Yuxian and Ye, Deming and Qin, Yujia and Su, Yusheng and Ji, Haozhe and Guan, Jian and Qi, Fanchao and Wang, Xiaozhi and Zheng, Yanan and Cao, Jiannan and Zeng, Guoyang and Cao, Huanqi and Chen, Shengqi and Li, Daixuan and Sun, Zhenbo and Liu, Zhiyuan and Huang, Minlie and Han, Wentao and Tang, Jie and Li, Juanzi and Sun, Maosong},

  year={2020}

}