{"id":19672608,"url":"https://github.com/ttop32/kogpt2novel","last_synced_at":"2025-04-29T01:30:44.618Z","repository":{"id":49519938,"uuid":"407405460","full_name":"ttop32/KoGPT2novel","owner":"ttop32","description":"Generate novel text - novel finetuned from skt KoGPT2 base v2 - 한국어","archived":false,"fork":false,"pushed_at":"2022-09-16T11:57:55.000Z","size":141,"stargazers_count":12,"open_issues_count":1,"forks_count":2,"subscribers_count":1,"default_branch":"main","last_synced_at":"2025-04-05T12:23:14.830Z","etag":null,"topics":["bentoml","deployment","docker","fastai","fine-tuning","finetune","generate-text","gpt2","huggingface","kogpt2","korean","korean-nlp","korean-text-processing","kubernates","kubernaut","nlp","okteto","pytorch","transformer","web"],"latest_commit_sha":null,"homepage":"","language":"Jupyter Notebook","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"other","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/ttop32.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null}},"created_at":"2021-09-17T04:34:29.000Z","updated_at":"2024-06-28T08:50:52.000Z","dependencies_parsed_at":"2023-01-18T10:17:22.518Z","dependency_job_id":null,"html_url":"https://github.com/ttop32/KoGPT2novel","commit_stats":null,"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/ttop32%2FKoGPT2novel","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/ttop32%2FKoGPT2novel/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/ttop32%2FKoGPT2novel/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/ttop32%2FKoGPT2novel/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/ttop32","download_url":"https://codeload.github.com/ttop32/KoGPT2novel/tar.gz/refs/heads/main","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":251415608,"owners_count":21585865,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["bentoml","deployment","docker","fastai","fine-tuning","finetune","generate-text","gpt2","huggingface","kogpt2","korean","korean-nlp","korean-text-processing","kubernates","kubernaut","nlp","okteto","pytorch","transformer","web"],"created_at":"2024-11-11T17:12:45.337Z","updated_at":"2025-04-29T01:30:44.304Z","avatar_url":"https://github.com/ttop32.png","language":"Jupyter Notebook","funding_links":[],"categories":[],"sub_categories":[],"readme":"# KoGPT2novel\nGenerate novel text based on given input text   \nnovel finetuned from skt/kogpt2-base-v2   \ncolab: [colab](https://colab.research.google.com/drive/1QYRKu3RI5mmIJcMDOa9NRbq_ETzcYJ7z?usp=sharing)      \nweb demo:  [okteto](https://web-web1-ttop32.cloud.okteto.net) [kubernautic](http://kogpt2novel.ddnsfree.com/)     \n\njapan web novel finetuned colab: [kogpt2jnovel_colab](https://colab.research.google.com/drive/1Ee_HXXpPHQoKvpf2Y6LIjs0D6SP7vsWP?usp=sharing)      \n\n\n# Result   \n![result](doc/screenshot_1.png)    \n\n\n# Required environment to run    \npip install torch==1.7.1+cu110   \npip install fastai==2.4   \npip install transformers==4.10.2    \npip install BentoML==0.13.1    \n\n# Use in transformers\n```python\nfrom transformers import AutoTokenizer, AutoModelWithLMHead\ntokenizer = AutoTokenizer.from_pretrained(\"ttop324/kogpt2novel\")\nmodel = AutoModelWithLMHead.from_pretrained(\"ttop324/kogpt2novel\")\n\ninputs = tokenizer.encode(\"위치추적 전자장치(전자발찌) 훼손 전후로 여성 2명을 잇달아 살해한 \", return_tensors=\"pt\")\noutput = model.generate(inputs, \n                        repetition_penalty=2.0, \n                        max_length=128,\n                        use_cache=True)\noutput = tokenizer.decode(output[0])\nprint(output)\n```\n\n# Run train  \ntrain.ipynb  \n\n# Run deploy    \ndeploy.ipynb  \n\n# Acknowledgement and References      \n- [KoGPT2](https://github.com/SKT-AI/KoGPT2)       \n- [huggingface_sharing](https://huggingface.co/transformers/model_sharing.html)        \n- [fastai_transformers](https://docs.fast.ai/tutorial.transformers)\n- [fastai_examples](https://github.com/fastai/fastai2/blob/master/nbs/examples/ulmfit.ipynb)\n- [BentoML](https://github.com/bentoml/BentoML)       \n- [BentoML_transformers](https://docs.bentoml.org/en/latest/frameworks.html#transformers)       \n- [BentoML_versailles](https://github.com/getlegist/versailles)   \n- [BentoML_iris-classifier](https://github.com/bentoml/gallery/tree/master/scikit-learn/iris-classifier)                 \n- [kubernetes](https://kubernetes.io/)       \n- [kubernautic](https://login.kubernautic.com/login) \n- [okteto](https://okteto.com/)    \n- [deployment_docker_kubernetes](https://course19.fast.ai/deployment_docker_kubernetes.html)   \n- [kubernetes_2](https://bcho.tistory.com/1256)   \n- [Kubernetes_Pod](https://honggg0801.tistory.com/44)    \n- [typewriter-effect](https://codepen.io/amanmakesart/pen/VwbZbqm)  \n    \n\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fttop32%2Fkogpt2novel","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fttop32%2Fkogpt2novel","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fttop32%2Fkogpt2novel/lists"}