https://github.com/starxsky/gpt
Refactored GPT-2 based on TF2/Pytorch
https://github.com/starxsky/gpt
deep-learning gpt-2 image-gpt ml python pytorch tensorflow2
Last synced: about 1 year ago
JSON representation
Refactored GPT-2 based on TF2/Pytorch
- Host: GitHub
- URL: https://github.com/starxsky/gpt
- Owner: StarxSky
- License: mit
- Created: 2022-02-02T04:24:10.000Z (over 4 years ago)
- Default Branch: main
- Last Pushed: 2022-07-21T08:21:36.000Z (almost 4 years ago)
- Last Synced: 2025-04-06T21:24:34.272Z (over 1 year ago)
- Topics: deep-learning, gpt-2, image-gpt, ml, python, pytorch, tensorflow2
- Language: Python
- Homepage: https://d4mucfpksywv.cloudfront.net/better-language-models/language-models.pdf
- Size: 1.75 MB
- Stars: 13
- Watchers: 1
- Forks: 3
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
# GPT(GPT-2 & Image-GPT)
 
|特点
|----------------------------------
| Use Tensorflow2.7.0 / Pytorch Build OpenAI'GPT-2
| 使用Pytorch复现了OpenAI的iGPT模型
| 使用最新tensorflow2.7.0 / pytorch构建openai官方的GPT-2 NLP模型
# Binder
[](https://mybinder.org/v2/gh/StarxSky/GPT-2/HEAD)
# 进度/News
|进度
|----------------------------------
|增加测试版的[BNNGPT-2](https://github.com/StarxSky/GPT/tree/main/BNNGPT)模型（贝叶斯神经网络GPT模型） --2022/06/13
|新增web交互 Dash application: A nice web interface for the dialogue model (Author: [xiejiachen](https://github.com/xiejiachen)) --2022/04/08
|增添了交互模式[CNGPT](https://github.com/StarxSky/GPT-2/tree/main/CNGPT) --2022/04/08
|新增[CNGPT](https://github.com/StarxSky/GPT-2/tree/main/CNGPT)可以实现在中文数据集上运行GPT -- 2022/03/15
|示例效果
|----------------------------------
|
# 优点
- 使用无监督技术
- 拥有大量词汇量
- 可实现续写
- 实现对话后续将应用于[FloatTech的Bot](https://github.com/FloatTech/AI-Bot/blob/main/TF2_GPT-2/README.md)
# 食用方法
|使用方法
|------------------------------------------------------
| [(iGPT) Pytorch复现iGPT](https://github.com/StarxSky/GPT/blob/main/iGPT)
| [(TensorFlow）TF2_GPT-2生成英文文章的教程](https://github.com/StarxSky/GPT/blob/main/%E7%AE%80%E4%BB%8B/TF2_GPT-2.md)
| [(Pytorch) 如果想训练中文GPT-2请您移步至CNGPT](https://github.com/StarxSky/GPT-2/tree/main/CNGPT)
# Setting
* python >= 3.6
* numpy==1.16.4
* sentencepiece==0.1.83
* tensorflow-gpu==2.7.0
* torch
# Test Results
# Link
- [New GELU Activate Function](https://arxiv.org/abs/1606.08415)
- [OpenAi-GPT-2](https://github.com/openai/gpt-2)
# Thanks To My Friends
- [FloatTech](https://github.com/FloatTech)
- [夜黎](https://github.com/DawnNights)
- [MayuriNFC](https://github.com/MayuriNFC)
- [理酱](https://github.com/Yiwen-Chan)
# [LICENCE](https://github.com/StarxSky/TF2_GPT-2/blob/main/LICENSE)
```
██████ ███ ███████ ██████ ██████████████████████
██████ ███ ███████ ██████ ██████████████████████
██████ ███ ███████ ██████ █████
██████ ███ ███████ █████
██████ ███ ███████ ██████ █████
██████ ███████ ██████ █████
██████ ███████ ██████ █████
██████ ███████ ██████ █████
```