{"id":41168681,"url":"https://github.com/cosmoquester/transformers-tf-finetune","last_synced_at":"2026-01-22T19:37:54.477Z","repository":{"id":46636859,"uuid":"383035005","full_name":"cosmoquester/transformers-tf-finetune","owner":"cosmoquester","description":"Scripts to finetune huggingface transformers models with Tensorflow 2","archived":false,"fork":false,"pushed_at":"2025-02-11T13:38:11.000Z","size":116,"stargazers_count":6,"open_issues_count":0,"forks_count":1,"subscribers_count":1,"default_branch":"master","last_synced_at":"2025-09-05T01:42:10.786Z","etag":null,"topics":["nlp","tensorflow","transformers"],"latest_commit_sha":null,"homepage":"","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/cosmoquester.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":"CITATION.cff","codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null,"zenodo":null}},"created_at":"2021-07-05T06:19:42.000Z","updated_at":"2023-04-15T07:12:22.000Z","dependencies_parsed_at":"2025-04-13T05:58:46.630Z","dependency_job_id":"13617b72-a211-42b1-92b5-26646fbf2616","html_url":"https://github.com/cosmoquester/transformers-tf-finetune","commit_stats":null,"previous_names":[],"tags_count":0,"template":false,"template_full_name":"cosmoquester/tf2-keras-template","purl":"pkg:github/cosmoquester/transformers-tf-finetune","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/cosmoquester%2Ftransformers-tf-finetune","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/cosmoquester%2Ftransformers-tf-finetune/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/cosmoquester%2Ftransformers-tf-finetune/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/cosmoquester%2Ftransformers-tf-finetune/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/cosmoquester","download_url":"https://codeload.github.com/cosmoquester/transformers-tf-finetune/tar.gz/refs/heads/master","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/cosmoquester%2Ftransformers-tf-finetune/sbom","scorecard":null,"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":286080680,"owners_count":28669392,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2026-01-22T19:36:09.361Z","status":"ssl_error","status_checked_at":"2026-01-22T19:36:05.567Z","response_time":144,"last_error":"SSL_read: unexpected eof while reading","robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":false,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["nlp","tensorflow","transformers"],"created_at":"2026-01-22T19:37:54.396Z","updated_at":"2026-01-22T19:37:54.466Z","avatar_url":"https://github.com/cosmoquester.png","language":"Python","funding_links":[],"categories":[],"sub_categories":[],"readme":"# Transformers tf finetune\n\n[![Code style: black](https://img.shields.io/badge/code%20style-black-000000.svg)](https://github.com/psf/black)\n[![Imports: isort](https://img.shields.io/badge/%20imports-isort-%231674b1?style=flat\u0026labelColor=ef8336)](https://pycqa.github.io/isort/)\n[![cosmoquester](https://circleci.com/gh/cosmoquester/transformers-tf-finetune.svg?style=svg)](https://app.circleci.com/pipelines/github/cosmoquester/transformers-tf-finetune)\n[![codecov](https://codecov.io/gh/cosmoquester/transformers-tf-finetune/branch/master/graph/badge.svg?token=GTsIlZy6oG)](https://codecov.io/gh/cosmoquester/transformers-tf-finetune)\n\n- Scripts and notebooks to train hugginface transformers models with Tensorflow 2.\n- You can train models with jupyter or python script using a separate machine, and even without it, you can learn with two clicks from the colab.\n- Select Task below, enter `[Open in Colab]`, and click `[Runtime]` - `[Run all]` to automatically load, learn, and evaluate data.\n- All code support GPU and TPU both.\n\n\u003cbr/\u003e\n\n- Tensorflow 2를 이용해 Transformer 모델들을 파인튜닝합니다.\n- 별도의 머신을 이용해 노트북이나 스크립트로 학습할 수 있으며 그게 없더라도 colab 에서 클릭 두 번으로 학습할 수 있습니다.\n- 아래에서 Task를 골라 `[Open in Colab]`으로 들어간 뒤에 `[Runtime]` - `[Run all]` 을 클릭하면 데이터로딩과 학습, 평가까지 자동으로 수행됩니다.\n- 모든 코드는 GPU, TPU 디바이스를 전부 지원합니다.\n\n## Tasks\n\n| TaskName | Supported Models | Script | Colab |\n| --- | --- | --- | --- |\n| [Chatbot](https://github.com/songys/Chatbot_data) | EncoderDecoder (e.g. BART, T5, ...) | [Link](https://github.com/cosmoquester/transformers-tf-finetune/blob/master/scripts/train_chatbot.py) | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/cosmoquester/transformers-tf-finetune/blob/master/notebooks/train_chatbot.ipynb) |\n| [HateSpeech](https://github.com/kocohub/korean-hate-speech) | BART | [Link](https://github.com/cosmoquester/transformers-tf-finetune/blob/master/scripts/train_hate_speech.py) | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/cosmoquester/transformers-tf-finetune/blob/master/notebooks/train_hate_speech.ipynb) |\n| [KLUE NLI](https://github.com/KLUE-benchmark/KLUE/tree/main/klue_benchmark/klue-nli-v1.1) | SequenceClassification (e.g. BERT, BART, GPT, ...) | [Link](https://github.com/cosmoquester/transformers-tf-finetune/blob/master/scripts/train_klue_nli.py) | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/cosmoquester/transformers-tf-finetune/blob/master/notebooks/train_klue_nli.ipynb) |\n| [KLUE STS (Bi-Encoder)](https://github.com/KLUE-benchmark/KLUE/tree/main/klue_benchmark/klue-sts-v1.1) | SequenceClassification (e.g. BERT, BART, ...) | [Link](https://github.com/cosmoquester/transformers-tf-finetune/blob/master/scripts/train_klue_sts.py) | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/cosmoquester/transformers-tf-finetune/blob/master/notebooks/train_klue_sts.ipynb) |\n| [KLUE TC](https://github.com/KLUE-benchmark/KLUE/tree/main/klue_benchmark/ynat-v1.1) | SequenceClassification (e.g. BERT, BART, GPT, ...) | [Link](https://github.com/cosmoquester/transformers-tf-finetune/blob/master/scripts/train_klue_tc.py) | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/cosmoquester/transformers-tf-finetune/blob/master/notebooks/train_klue_tc.ipynb) |\n| [KorSTS (Bi-Encoder)](https://github.com/kakaobrain/KorNLUDatasets/tree/master/KorSTS) | SequenceClassification (e.g. BERT, BART, ...) | [Link](https://github.com/cosmoquester/transformers-tf-finetune/blob/master/scripts/train_korsts.py) | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/cosmoquester/transformers-tf-finetune/blob/master/notebooks/train_korsts.ipynb) |\n| [NSMC](https://github.com/e9t/nsmc) | SequenceClassification (e.g. BERT, BART, GPT, ...) | [Link](https://github.com/cosmoquester/transformers-tf-finetune/blob/master/scripts/train_nsmc.py) | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/cosmoquester/transformers-tf-finetune/blob/master/notebooks/train_nsmc.ipynb) |\n| [QuestionPair](https://github.com/aisolab/nlp_classification/tree/master/BERT_pairwise_text_classification/qpair) | SequenceClassification (e.g. BERT, BART, GPT, ...) | [Link](https://github.com/cosmoquester/transformers-tf-finetune/blob/master/scripts/train_question_pair.py) | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/cosmoquester/transformers-tf-finetune/blob/master/notebooks/train_question_pair.ipynb) |\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fcosmoquester%2Ftransformers-tf-finetune","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fcosmoquester%2Ftransformers-tf-finetune","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fcosmoquester%2Ftransformers-tf-finetune/lists"}