https://github.com/hankcs/bolt_splits

Split Broad Operational Language Translation corpus into train/dev/test set
https://github.com/hankcs/bolt_splits

Last synced: 10 months ago
JSON representation

Split Broad Operational Language Translation corpus into train/dev/test set

• Host: GitHub
• URL: https://github.com/hankcs/bolt_splits
• Owner: hankcs
• Created: 2020-07-27T20:49:50.000Z (over 5 years ago)
• Default Branch: master
• Last Pushed: 2020-07-27T20:56:09.000Z (over 5 years ago)
• Last Synced: 2025-01-24T10:48:02.474Z (12 months ago)
• Language: Python
• Size: 3.91 KB
• Stars: 1
• Watchers: 3
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

README

          
# bolt_splits

Split Broad Operational Language Translation corpus into train/dev/test set.

The pseudo-code for splitting goes as follows:

```

For files in each genre:

  For files in each ext:

    For files in each length of filename:

      Sort files by filename

      Split files to trn, dev, tst with 8:1:1 ratio

```