Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

Awesome Lists | Featured Topics | Projects

https://github.com/ttop32/kogpt2novel

Generate novel text - novel finetuned from skt KoGPT2 base v2 - 한국어
https://github.com/ttop32/kogpt2novel

bentoml deployment docker fastai fine-tuning finetune generate-text gpt2 huggingface kogpt2 korean korean-nlp korean-text-processing kubernates kubernaut nlp okteto pytorch transformer web

Last synced: 3 days ago
JSON representation

Generate novel text - novel finetuned from skt KoGPT2 base v2 - 한국어

Host: GitHub
URL: https://github.com/ttop32/kogpt2novel
Owner: ttop32
License: other
Created: 2021-09-17T04:34:29.000Z (about 3 years ago)
Default Branch: main
Last Pushed: 2022-09-16T11:57:55.000Z (about 2 years ago)
Last Synced: 2023-03-10T11:07:20.180Z (over 1 year ago)
Topics: bentoml, deployment, docker, fastai, fine-tuning, finetune, generate-text, gpt2, huggingface, kogpt2, korean, korean-nlp, korean-text-processing, kubernates, kubernaut, nlp, okteto, pytorch, transformer, web
Language: Jupyter Notebook
Homepage:
Size: 138 KB
Stars: 8
Watchers: 1
Forks: 2
Open Issues: 1
Metadata Files:
- Readme: README.md
- License: LICENSE

Awesome Lists containing this project

README

        # KoGPT2novel

Generate novel text based on given input text   

novel finetuned from skt/kogpt2-base-v2   

colab: [colab](https://colab.research.google.com/drive/1QYRKu3RI5mmIJcMDOa9NRbq_ETzcYJ7z?usp=sharing)      

web demo:  [okteto](https://web-web1-ttop32.cloud.okteto.net) [kubernautic](http://kogpt2novel.ddnsfree.com/)     

japan web novel finetuned colab: [kogpt2jnovel_colab](https://colab.research.google.com/drive/1Ee_HXXpPHQoKvpf2Y6LIjs0D6SP7vsWP?usp=sharing)      

# Result   

![result](doc/screenshot_1.png)    

# Required environment to run    

pip install torch==1.7.1+cu110   

pip install fastai==2.4   

pip install transformers==4.10.2    

pip install BentoML==0.13.1    

# Use in transformers

```python

from transformers import AutoTokenizer, AutoModelWithLMHead

tokenizer = AutoTokenizer.from_pretrained("ttop324/kogpt2novel")

model = AutoModelWithLMHead.from_pretrained("ttop324/kogpt2novel")

inputs = tokenizer.encode("위치추적 전자장치(전자발찌) 훼손 전후로 여성 2명을 잇달아 살해한 ", return_tensors="pt")

output = model.generate(inputs, 

                        repetition_penalty=2.0, 

                        max_length=128,

                        use_cache=True)

output = tokenizer.decode(output[0])

print(output)

```

# Run train  

train.ipynb  

# Run deploy    

deploy.ipynb  

# Acknowledgement and References      

- [KoGPT2](https://github.com/SKT-AI/KoGPT2)       

- [huggingface_sharing](https://huggingface.co/transformers/model_sharing.html)        

- [fastai_transformers](https://docs.fast.ai/tutorial.transformers)

- [fastai_examples](https://github.com/fastai/fastai2/blob/master/nbs/examples/ulmfit.ipynb)

- [BentoML](https://github.com/bentoml/BentoML)       

- [BentoML_transformers](https://docs.bentoml.org/en/latest/frameworks.html#transformers)       

- [BentoML_versailles](https://github.com/getlegist/versailles)   

- [BentoML_iris-classifier](https://github.com/bentoml/gallery/tree/master/scikit-learn/iris-classifier)                 

- [kubernetes](https://kubernetes.io/)       

- [kubernautic](https://login.kubernautic.com/login) 

- [okteto](https://okteto.com/)    

- [deployment_docker_kubernetes](https://course19.fast.ai/deployment_docker_kubernetes.html)   

- [kubernetes_2](https://bcho.tistory.com/1256)   

- [Kubernetes_Pod](https://honggg0801.tistory.com/44)    

- [typewriter-effect](https://codepen.io/amanmakesart/pen/VwbZbqm)