{"id":18541845,"url":"https://github.com/cltk/greek_training_set_sentence_cltk","last_synced_at":"2025-04-09T18:31:16.858Z","repository":{"id":19087094,"uuid":"22314839","full_name":"cltk/greek_training_set_sentence_cltk","owner":"cltk","description":"Training sets and tokenizer for the Classical Greek language, for use with CLTK","archived":false,"fork":false,"pushed_at":"2015-03-29T21:00:43.000Z","size":2540,"stargazers_count":5,"open_issues_count":0,"forks_count":3,"subscribers_count":5,"default_branch":"master","last_synced_at":"2025-03-24T10:21:17.368Z","etag":null,"topics":[],"latest_commit_sha":null,"homepage":null,"language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/cltk.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null}},"created_at":"2014-07-27T15:56:20.000Z","updated_at":"2023-11-19T22:37:49.000Z","dependencies_parsed_at":"2022-09-23T04:44:13.417Z","dependency_job_id":null,"html_url":"https://github.com/cltk/greek_training_set_sentence_cltk","commit_stats":null,"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/cltk%2Fgreek_training_set_sentence_cltk","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/cltk%2Fgreek_training_set_sentence_cltk/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/cltk%2Fgreek_training_set_sentence_cltk/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/cltk%2Fgreek_training_set_sentence_cltk/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/cltk","download_url":"https://codeload.github.com/cltk/greek_training_set_sentence_cltk/tar.gz/refs/heads/master","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":248087703,"owners_count":21045571,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":[],"created_at":"2024-11-06T20:06:30.373Z","updated_at":"2025-04-09T18:31:14.225Z","avatar_url":"https://github.com/cltk.png","language":"Python","funding_links":[],"categories":[],"sub_categories":[],"readme":"CLTK Greek sentence tokenizer\n=============================\n\nAbout\n-----\nThis repository contains a training set and rule set for tokenizing sentences for Classical Greek, for use with the [Classical Language Toolkit](https://github.com/kylepjohnson/cltk). Unless you want to create a new training set for Greek sentences, there is nothing you need from this repository.\n\nTo tokenize Greek sentences with the CLTK, first [import it and use according to the docs here](http://docs.cltk.org/en/latest/import_corpora.html#cltk-sentence-tokenizer-greek) and then see [instructions on tokenizing Greek sentences](http://docs.cltk.org/en/latest/classical_greek.html#sentence-tokenization).\n\n`training_sentences.txt` is comprised of the entirety of the Xenophon's *Anabasis* and is 57,173 words long.\n\nUse\n---\nTo create a new training set, manually add tokenized sentences (with each sentence starting a new line) to `training_sentences.txt` and run `train_sentence_tokenizer.py`. The script outputs `greek.pickle`. To use this new file, copy it to your local CLTK data directory at `~/cltk_data/compiled/sentence_tokens_greek/`.\n\n```shell\n$ python train_sentence_tokenizer.py \n  Abbreviation: [0.3233] ἐᾶν\n  Abbreviation: [0.3233] ἔζη\n  Abbreviation: [0.8787] ὄν\n  Sent Starter: [97.8234] 'ἐπειδὴ'\n  Sent Starter: [113.3762] 'οἱ'\n  Sent Starter: [65.2843] 'εἰ'\n  Sent Starter: [32.1611] 'τοιγαροῦν'\n  Sent Starter: [36.0471] 'ἀλλὰ'\n  Sent Starter: [186.0545] 'μετὰ'\n  Sent Starter: [45.6612] 'ταύτην'\n  Sent Starter: [335.0765] 'ἐνταῦθα'\n  Sent Starter: [220.8901] 'καὶ'\n  Sent Starter: [360.4958] 'ὁ'\n  Sent Starter: [646.4387] 'ἐπεὶ'\n  Sent Starter: [58.9281] 'ἀκούσας'\n  Sent Starter: [53.6916] 'οὐκοῦν'\n  Sent Starter: [58.7917] 'ταῦτα'\n  Sent Starter: [124.8905] 'ἐκ'\n  Sent Starter: [102.6241] 'ἔνθα'\n  Sent Starter: [32.1611] 'καίτοι'\n  Sent Starter: [47.4084] 'ἀκούσαντες'\n  Sent Starter: [429.5321] 'ἐντεῦθεν'\n```\n\nIf you think your training set and tokenizer is an improvement over the CLTK's current, please submit a pull request.\n\nLICENSE\n-------\nThis software is, like the rest of the CLTK, licensed under the MIT license (see LICENSE). The texts for the training sentences comes [from Perseus](http://www.perseus.tufts.edu/hopper/text?doc=Perseus%3atext%3a1999.01.0201) and are licensed under the [Creative Commons Attribution-ShareAlike 3.0 United States License](http://creativecommons.org/licenses/by-sa/3.0/us/).\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fcltk%2Fgreek_training_set_sentence_cltk","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fcltk%2Fgreek_training_set_sentence_cltk","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fcltk%2Fgreek_training_set_sentence_cltk/lists"}