{"id":25070299,"url":"https://github.com/shivanandroy/simplet5","last_synced_at":"2025-04-12T22:37:10.562Z","repository":{"id":39569236,"uuid":"371631642","full_name":"Shivanandroy/simpleT5","owner":"Shivanandroy","description":"simpleT5 is built on top of PyTorch-lightning⚡️ and Transformers🤗 that lets you quickly train your T5 models.","archived":false,"fork":false,"pushed_at":"2023-05-19T08:06:50.000Z","size":369,"stargazers_count":394,"open_issues_count":39,"forks_count":62,"subscribers_count":6,"default_branch":"main","last_synced_at":"2025-04-04T01:29:42.315Z","etag":null,"topics":["classification","fine-tuning","finetune","pytorch","simplet5","summarization","t5","t5-model","training","transformers","translation"],"latest_commit_sha":null,"homepage":"","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/Shivanandroy.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2021-05-28T08:23:12.000Z","updated_at":"2025-02-14T03:38:37.000Z","dependencies_parsed_at":"2024-06-18T22:39:46.037Z","dependency_job_id":"be7cfd36-7847-478d-a0a0-a97edf9bb2fb","html_url":"https://github.com/Shivanandroy/simpleT5","commit_stats":{"total_commits":68,"total_committers":4,"mean_commits":17.0,"dds":0.4558823529411765,"last_synced_commit":"cb4d89299824312ca468b741298fd3cc391e29e2"},"previous_names":[],"tags_count":5,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Shivanandroy%2FsimpleT5","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Shivanandroy%2FsimpleT5/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Shivanandroy%2FsimpleT5/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Shivanandroy%2FsimpleT5/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/Shivanandroy","download_url":"https://codeload.github.com/Shivanandroy/simpleT5/tar.gz/refs/heads/main","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":248643006,"owners_count":21138353,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["classification","fine-tuning","finetune","pytorch","simplet5","summarization","t5","t5-model","training","transformers","translation"],"created_at":"2025-02-06T21:19:39.690Z","updated_at":"2025-04-12T22:37:10.541Z","avatar_url":"https://github.com/Shivanandroy.png","language":"Python","funding_links":[],"categories":[],"sub_categories":[],"readme":"\u003cimg align=\"center\" src=\"data/st5.png\" alt=\"simpleT5\"\u003e\n\n\u003cp align=\"center\"\u003e\n\u003cb\u003eQuickly train T5/mT5/byT5/CodeT5 models in just 3 lines of code\n\u003c/b\u003e\n\u003c/p\u003e\n\u003cp align=\"center\"\u003e\n\u003ca href=\"https://badge.fury.io/py/simplet5\"\u003e\u003cimg src=\"https://badge.fury.io/py/simplet5.svg\" alt=\"PyPI version\" height=\"18\"\u003e\u003c/a\u003e\n\n\u003ca href=\"https://badge.fury.io/py/simplet5\"\u003e\n        \u003cimg alt=\"Stars\" src=\"https://img.shields.io/github/stars/Shivanandroy/simpleT5?color=blue\"\u003e\n    \u003c/a\u003e\n\u003ca href=\"https://pepy.tech/project/simplet5\"\u003e\n        \u003cimg alt=\"Stats\" src=\"https://static.pepy.tech/personalized-badge/simplet5?period=total\u0026units=international_system\u0026left_color=black\u0026right_color=brightgreen\u0026left_text=Downloads\"\u003e\n    \u003c/a\u003e\n\u003ca href=\"https://opensource.org/licenses/MIT\"\u003e\n        \u003cimg alt=\"License\" src=\"https://img.shields.io/badge/License-MIT-yellow.svg\"\u003e\n    \u003c/a\u003e\n\u003c/p\u003e\n\n\n**simpleT5** is built on top of PyTorch-lightning⚡️ and Transformers🤗 that lets you quickly train your T5 models.\n\u003e T5 models can be used for several NLP tasks such as summarization, QA , QG , translation , text generation, and more. \n\n\nHere's a link to [Medium article](https://snrspeaks.medium.com/simplet5-train-t5-models-in-just-3-lines-of-code-by-shivanand-roy-2021-354df5ae46ba) along with an [example colab notebook](https://colab.research.google.com/drive/1JZ8v9L0w0Ai3WbibTeuvYlytn0uHMP6O?usp=sharing) \n\n## Install\n```python\n# It's advisable to create a new python environment and install simplet5\npip install --upgrade simplet5\n```\n\n\n## Usage \n**simpleT5** for summarization task [![Open In Collab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/drive/1JZ8v9L0w0Ai3WbibTeuvYlytn0uHMP6O?usp=sharing)\n```python\n# import\nfrom simplet5 import SimpleT5\n\n# instantiate\nmodel = SimpleT5()\n\n# load (supports t5, mt5, byT5 and CodeT5 models)\nmodel.from_pretrained(\"t5\",\"t5-base\")\n\n# train\nmodel.train(train_df=train_df, # pandas dataframe with 2 columns: source_text \u0026 target_text\n            eval_df=eval_df, # pandas dataframe with 2 columns: source_text \u0026 target_text\n            source_max_token_len = 512, \n            target_max_token_len = 128,\n            batch_size = 8,\n            max_epochs = 5,\n            use_gpu = True,\n            outputdir = \"outputs\",\n            early_stopping_patience_epochs = 0,\n            precision = 32\n            )\n\n# load trained T5 model\nmodel.load_model(\"t5\",\"path/to/trained/model/directory\", use_gpu=False)\n\n# predict\nmodel.predict(\"input text for prediction\")\n\n```\n## Articles\n- [Geek Culture: simpleT5 — Train T5 Models in Just 3 Lines of Code](https://medium.com/geekculture/simplet5-train-t5-models-in-just-3-lines-of-code-by-shivanand-roy-2021-354df5ae46ba)\n- [Abstractive Summarization with SimpleT5⚡️](https://snrspeaks.medium.com/abstractive-summarization-with-simplet5-%EF%B8%8F-344a78f73265)\n- [Training T5 model in just 3 lines of Code with ONNX Inference](https://medium.com/mlearning-ai/training-t5-model-in-just-3-lines-of-code-with-onnx-inference-ff5b6678c757)\n- [Kaggle: simpleT5⚡️ -  Generating one line summary of papers](https://www.kaggle.com/mathurinache/simplet5-generating-one-line-summary-of-papers)\n- [Youtube: Abstractive Summarization Demo with SimpleT5](https://www.youtube.com/watch?v=jgKj-7v2UYU)\n\n## Acknowledgements\n- [Transformers by HuggingFace 🤗](https://huggingface.co/transformers/)\n- [Pytorch Lightning ⚡️](https://www.pytorchlightning.ai/)\n- [Fastt5](https://github.com/Ki6an/fastT5)\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fshivanandroy%2Fsimplet5","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fshivanandroy%2Fsimplet5","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fshivanandroy%2Fsimplet5/lists"}