{"id":19858897,"url":"https://github.com/starxsky/gpt","last_synced_at":"2025-05-02T02:31:16.772Z","repository":{"id":47729419,"uuid":"454641616","full_name":"StarxSky/GPT","owner":"StarxSky","description":"Refactored GPT-2 based on TF2/Pytorch","archived":false,"fork":false,"pushed_at":"2022-07-21T08:21:36.000Z","size":1839,"stargazers_count":13,"open_issues_count":0,"forks_count":3,"subscribers_count":1,"default_branch":"main","last_synced_at":"2025-04-06T21:24:34.272Z","etag":null,"topics":["deep-learning","gpt-2","image-gpt","ml","python","pytorch","tensorflow2"],"latest_commit_sha":null,"homepage":"https://d4mucfpksywv.cloudfront.net/better-language-models/language-models.pdf","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/StarxSky.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null}},"created_at":"2022-02-02T04:24:10.000Z","updated_at":"2024-12-25T22:29:23.000Z","dependencies_parsed_at":"2022-07-26T16:45:13.571Z","dependency_job_id":null,"html_url":"https://github.com/StarxSky/GPT","commit_stats":null,"previous_names":[],"tags_count":1,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/StarxSky%2FGPT","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/StarxSky%2FGPT/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/StarxSky%2FGPT/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/StarxSky%2FGPT/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/StarxSky","download_url":"https://codeload.github.com/StarxSky/GPT/tar.gz/refs/heads/main","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":251972485,"owners_count":21673613,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["deep-learning","gpt-2","image-gpt","ml","python","pytorch","tensorflow2"],"created_at":"2024-11-12T14:24:51.373Z","updated_at":"2025-05-02T02:31:12.648Z","avatar_url":"https://github.com/StarxSky.png","language":"Python","funding_links":[],"categories":[],"sub_categories":[],"readme":"# GPT(GPT-2 \u0026 Image-GPT)\n![Pytorch](https://avatars.githubusercontent.com/u/21003710?s=88\u0026v=4) ![TensorFlow](https://avatars.githubusercontent.com/u/15658638?s=88\u0026v=4)\n\n|特点\n|----------------------------------\n| Use Tensorflow2.7.0 / Pytorch Build OpenAI'GPT-2\n| 使用Pytorch复现了OpenAI的iGPT模型\n| 使用最新tensorflow2.7.0 / pytorch构建openai官方的GPT-2 NLP模型\n\n\n# Binder \n[![Binder](https://mybinder.org/badge_logo.svg)](https://mybinder.org/v2/gh/StarxSky/GPT-2/HEAD)\n\n# 进度/News\n|进度\n|----------------------------------\n|增加测试版的[BNNGPT-2](https://github.com/StarxSky/GPT/tree/main/BNNGPT)模型（贝叶斯神经网络GPT模型） --2022/06/13\n|新增web交互 Dash application: A nice web interface for the dialogue model (Author: [xiejiachen](https://github.com/xiejiachen)) --2022/04/08\n|增添了交互模式[CNGPT](https://github.com/StarxSky/GPT-2/tree/main/CNGPT) --2022/04/08\n|新增[CNGPT](https://github.com/StarxSky/GPT-2/tree/main/CNGPT)可以实现在中文数据集上运行GPT -- 2022/03/15\n\n\n|示例效果\n|----------------------------------\n|![im](https://github.com/StarxSky/GPT-2/blob/main/%E7%AE%80%E4%BB%8B/h.png?raw=true)\n\n\n# 优点\n\n- 使用无监督技术\n- 拥有大量词汇量\n- 可实现续写\n- 实现对话后续将应用于[FloatTech的Bot](https://github.com/FloatTech/AI-Bot/blob/main/TF2_GPT-2/README.md)\n\n# 食用方法\n|使用方法\n|------------------------------------------------------\n| [(iGPT) Pytorch复现iGPT](https://github.com/StarxSky/GPT/blob/main/iGPT)\n| [(TensorFlow）TF2_GPT-2生成英文文章的教程](https://github.com/StarxSky/GPT/blob/main/%E7%AE%80%E4%BB%8B/TF2_GPT-2.md)\n| [(Pytorch) 如果想训练中文GPT-2请您移步至CNGPT](https://github.com/StarxSky/GPT-2/tree/main/CNGPT)\n\n# Setting\n\n*  python \u003e= 3.6\n*  numpy==1.16.4\n*  sentencepiece==0.1.83\n*  tensorflow-gpu==2.7.0\n*  torch\n\n# Test Results\n![Test](https://github.com/StarxSky/GPT/blob/main/%E7%AE%80%E4%BB%8B/loss.jpg)\n\n# Link\n\n- [New GELU Activate Function](https://arxiv.org/abs/1606.08415)\n- [OpenAi-GPT-2](https://github.com/openai/gpt-2)\n\n\n# Thanks To My Friends \n- [FloatTech](https://github.com/FloatTech)\n- [夜黎](https://github.com/DawnNights)\n- [MayuriNFC](https://github.com/MayuriNFC)\n- [理酱](https://github.com/Yiwen-Chan)\n\n\n\n# [LICENCE](https://github.com/StarxSky/TF2_GPT-2/blob/main/LICENSE)\n\n```\n██████   ███   ███████       ██████          ██████████████████████\n██████   ███   ███████       ██████          ██████████████████████       \n██████   ███   ███████       ██████                  █████\n██████   ███   ███████                               █████\n██████   ███   ███████       ██████                  █████\n██████         ███████       ██████                  █████\n██████         ███████       ██████                  █████\n██████         ███████       ██████                  █████\n```\n\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fstarxsky%2Fgpt","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fstarxsky%2Fgpt","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fstarxsky%2Fgpt/lists"}