https://github.com/eususu/dataset-translator

translate huggingface dataset with translate api or llm
https://github.com/eususu/dataset-translator

Last synced: 3 days ago
JSON representation

translate huggingface dataset with translate api or llm

• Host: GitHub
• URL: https://github.com/eususu/dataset-translator
• Owner: eususu
• License: mit
• Created: 2024-07-23T15:35:15.000Z (6 months ago)
• Default Branch: main
• Last Pushed: 2024-08-22T15:16:57.000Z (5 months ago)
• Last Synced: 2024-11-07T01:29:40.771Z (2 months ago)
• Language: Python
• Size: 104 KB
• Stars: 0
• Watchers: 1
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

• awesome_ai_agents - Dataset-Translator - translate huggingface dataset with translate api or llm (Building / Datasets)
• awesome_ai_agents - Dataset-Translator - translate huggingface dataset with translate api or llm (Building / Datasets)

README

        
# dataset-translator

The console app that translate huggingface dataset with translate api or llm

## Usage

```bash

$ transdata --engine [ENGINE] {ENGINE OPTIONS} [HF DATASET PATH] --jq [TARGET to TRANSLATE]

```

## RoadMap

- [x] `2024-07-24` start 

- [x] `2024-07-25` support DeepL API (free)

- [x] `2024-07-28` support LLM translate(use my lite-llm-client)

- [x] add interface for translate engine(deepl, llm, etc)

- [ ] support DeepL API (pro)

- [ ] support Google Translate

- [ ] implement CLI

- [ ] replace datasets