https://github.com/minsithu/thai-opt350m

a generative language model for thai language based on opt350m
https://github.com/minsithu/thai-opt350m

Last synced: 3 days ago
JSON representation

a generative language model for thai language based on opt350m

• Host: GitHub
• URL: https://github.com/minsithu/thai-opt350m
• Owner: MinSiThu
• License: mit
• Created: 2024-03-21T18:40:08.000Z (8 months ago)
• Default Branch: main
• Last Pushed: 2024-03-21T19:01:58.000Z (8 months ago)
• Last Synced: 2024-04-24T07:24:45.509Z (7 months ago)
• Language: Python
• Size: 21.5 KB
• Stars: 7
• Watchers: 1
• Forks: 1
• Open Issues: 0
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

README

        
---

library_name: transformers

tags:

- thai

- opt

- generative ai

- SEA

- southeast-asian

license: mit

language:

- th

---

![thai-opt350m-instruct-logo](thai-opt350m.png)

# thai-opt350m-instruct

 a generative language model for thai language based on opt350m

**Thai-OPT350M-Instruct** is a fine-tuned pretrained transformer for **thai language** based on facebook/opt-350m.

Dataset for thai-opt350m-instruct

- yadapruk/thai-instructions-rallio

## Base Model

- Facebook Open Pretrained Transformer

## Languages 

- mainly support Thai Language

- a few English, Chinese, Arabic

## Training

- epochs - 12

- training loss - 0.809200

# Model Page

[https://huggingface.co/jojo-ai-mst/thai-opt350m-instruct](https://huggingface.co/jojo-ai-mst/thai-opt350m-instruct)

## Prompt Format

```

User: อะไรคือวิธีที่ดีที่สุดในการทําความสะอาดพรม Assistant:

```

# How to use

```python

# pip install transformers

from transformers import AutoModelForCausalLM,AutoTokenizer

model = AutoModelForCausalLM.from_pretrained("jojo-ai-mst/thai-opt350m-instruct")

tokenizer = AutoTokenizer.from_pretrained("jojo-ai-mst/thai-opt350m-instruct")

def generate_text(prompt, max_length=200, temperature=0.8, top_k=50):

    input_ids = tokenizer.encode(prompt, return_tensors="pt").cuda() # remove .cuda() if only cpu

    output = model.generate(

        input_ids,

        max_length=max_length,

        temperature=temperature,

        top_k=top_k,

        pad_token_id=tokenizer.eos_token_id,

        do_sample=True

    )

    for result in output:

      generated_text = tokenizer.decode(result, skip_special_tokens=True)

      print(generated_text)

generate_text("User: อะไรคือวิธีที่ดีที่สุดในการทําความสะอาดพรม Assistant:")

```

# Date of Release 

22/03/2024

# License

MIT

# Author

[Min Si Thu](https://www.linkedin.com/in/min-si-thu/)

# Notes

This ai model is a movement of [MyanmarGPT-Movement](https://github.com/MyanmarGPT-Movement).