{"id":15520090,"url":"https://github.com/diyclassics/la_dep_cltk_md","last_synced_at":"2025-05-15T08:12:14.229Z","repository":{"id":187354874,"uuid":"614031931","full_name":"diyclassics/la_dep_cltk_md","owner":"diyclassics","description":"spaCy-compatible md model for Latin ","archived":false,"fork":false,"pushed_at":"2023-03-16T14:44:59.000Z","size":1710,"stargazers_count":1,"open_issues_count":0,"forks_count":0,"subscribers_count":2,"default_branch":"main","last_synced_at":"2025-02-17T09:43:36.300Z","etag":null,"topics":[],"latest_commit_sha":null,"homepage":null,"language":"Jupyter Notebook","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/diyclassics.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2023-03-14T18:50:39.000Z","updated_at":"2023-03-14T22:59:03.000Z","dependencies_parsed_at":null,"dependency_job_id":"592fc6bd-1583-46c7-8cd7-110e9deb9588","html_url":"https://github.com/diyclassics/la_dep_cltk_md","commit_stats":{"total_commits":7,"total_committers":2,"mean_commits":3.5,"dds":0.2857142857142857,"last_synced_commit":"908e03986ee2ee18a69234cd83a6d584a8470b5d"},"previous_names":["diyclassics/la_dep_cltk_md"],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/diyclassics%2Fla_dep_cltk_md","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/diyclassics%2Fla_dep_cltk_md/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/diyclassics%2Fla_dep_cltk_md/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/diyclassics%2Fla_dep_cltk_md/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/diyclassics","download_url":"https://codeload.github.com/diyclassics/la_dep_cltk_md/tar.gz/refs/heads/main","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":254301612,"owners_count":22047905,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":[],"created_at":"2024-10-02T10:24:15.188Z","updated_at":"2025-05-15T08:12:14.205Z","avatar_url":"https://github.com/diyclassics.png","language":"Jupyter Notebook","funding_links":[],"categories":[],"sub_categories":[],"readme":"\u003c!-- SPACY PROJECT: AUTO-GENERATED DOCS START (do not remove) --\u003e\n\n# 🪐 spaCy Project: la_dep_cltk_md\n\nCode required to train spaCy-compatible md model for Latin. Latin pipeline with POS tagger, morphologizer,  lemmatizer, and dependency parser trained on all available Latin UD treebanks, i.e. Perseus, PROIEL, ITTB,  UDante, and LLCT (see below). The model contains floret vectors trained on Wikipedia, Oscar, and UD data. Note also that a sm model (i.e. without vectors) is trained in the same pipeline.\n\n\n## 📋 project.yml\n\nThe [`project.yml`](project.yml) defines the data assets required by the\nproject, as well as the available commands and workflows. For details, see the\n[spaCy projects documentation](https://spacy.io/usage/projects).\n\n### ⏯ Commands\n\nThe following commands are defined by the project. They\ncan be executed using [`spacy project run [name]`](https://spacy.io/api/cli#project-run).\nCommands are only re-run if their inputs have changed.\n\n| Command | Description |\n| --- | --- |\n| `assets` | Download assets |\n| `preprocess` | Convert different UD treebanks so that they use shared formatting, feature defs, etc. |\n| `convert` | Convert the data to spaCy's format |\n| `norm-corpus` | Convert norm attribute to u-v and i-j norm |\n| `extract-wikipedia` | Convert Wikipedia XML to JSONL with wikiextractor |\n| `tokenize-wikipedia` | Tokenize and sentencize Wikipedia |\n| `tokenize-oscar` | Tokenize and sentencize OSCAR dataset |\n| `tokenize-ud` | Tokenize and sentencize UD; following wikipedia/oscar pattern |\n| `create-input` | Concatenate tokenized input texts |\n| `train-floret-vectors` | Train floret vectors |\n| `load-vectors` | load floret vectors |\n| `init-labels` | Initial labels for components |\n| `train-sm` | Train sm tagger/parser on Latin UD treebanks |\n| `train` | Train tagger/pagger on Latin UD treebanks |\n| `evaluate-sm` | Evaluate on the test data and save the metrics |\n| `evaluate` | Evaluate on the test data and save the metrics |\n| `package-sm` | Package the trained sm model so it can be installed |\n| `package` | Package the trained model so it can be installed |\n| `document` | Document dep_cltk_md |\n| `clean` | Remove intermediate files |\n\n### ⏭ Workflows\n\nThe following workflows are defined by the project. They\ncan be executed using [`spacy project run [name]`](https://spacy.io/api/cli#project-run)\nand will run the specified commands in order. Commands are only re-run if their\ninputs have changed.\n\n| Workflow | Steps |\n| --- | --- |\n| `all` | `assets` \u0026rarr; `preprocess` \u0026rarr; `convert` \u0026rarr; `norm-corpus` \u0026rarr; `extract-wikipedia` \u0026rarr; `tokenize-wikipedia` \u0026rarr; `tokenize-oscar` \u0026rarr; `tokenize-ud` \u0026rarr; `create-input` \u0026rarr; `train-floret-vectors` \u0026rarr; `load-vectors` \u0026rarr; `init-labels` \u0026rarr; `train-sm` \u0026rarr; `train` \u0026rarr; `evaluate-sm` \u0026rarr; `evaluate` \u0026rarr; `package-sm` \u0026rarr; `package` \u0026rarr; `document` \u0026rarr; `clean` |\n\n### 🗂 Assets\n\nThe following assets are defined by the project. They can\nbe fetched by running [`spacy project assets`](https://spacy.io/api/cli#project-assets)\nin the project directory.\n\n| File | Source | Description |\n| --- | --- | --- |\n| `assets/original/UD_Latin-Perseus` | Git |  |\n| `assets/original/UD_Latin-PROIEL` | Git |  |\n| `assets/original/UD_Latin-ITTB` | Git |  |\n| `assets/original/UD_Latin-LLCT` | Git |  |\n| `assets/original/UD_Latin-UDante` | Git |  |\n| `vectors/downloaded/wikipedia/lawiki-latest-pages-articles.xml.bz2` | URL |  |\n\n\u003c!-- SPACY PROJECT: AUTO-GENERATED DOCS END (do not remove) --\u003e\n\n## Install\n\n- To install the current version...\n    - `pip install https://huggingface.co/diyclassics/la_dep_cltk_md/resolve/main/la_dep_cltk_md-0.3.1/dist/la_dep_cltk_md-0.3.1.tar.gz`\n\n## Model repository\n\n- The model itself can be found here:\n    - https://huggingface.co/diyclassics/la_dep_cltk_md\n\n## Current version\n\n| Feature | Description |\n| --- | --- |\n| **Name** | `la_dep_cltk_md` |\n| **Version** | `0.3.1` |\n| **spaCy** | `\u003e=3.5.1,\u003c3.6.0` |\n| **Default Pipeline** | `normer`, `tok2vec`, `tagger`, `morphologizer`, `trainable_lemmatizer`, `parser` |\n| **Components** | `senter`, `normer`, `tok2vec`, `tagger`, `morphologizer`, `trainable_lemmatizer`, `parser` |\n| **Vectors** | -1 keys, 50000 unique vectors (300 dimensions) |\n| **Sources** | UD_Latin-Perseus\u003cbr /\u003eUD_Latin-PROIEL\u003cbr /\u003eUD_Latin-ITTB\u003cbr /\u003eUD_Latin-LLCT\u003cbr /\u003eUD_Latin-UDante |\n| **License** | `MIT` |\n| **Author** | [Patrick J. Burns; with Tim Geelhaar](https://diyclassics.github.io/) |\n\n### Accuracy\n\n| Type | Score |\n| --- | --- |\n| `SENTS_F` | 92.75 |\n| `SENTS_P` | 93.09 |\n| `SENTS_R` | 92.41 |\n| `TAG_ACC` | 93.58 |\n| `POS_ACC` | 96.92 |\n| `MORPH_ACC` | 91.72 |\n| `LEMMA_ACC` | 94.25 |\n| `DEP_UAS` | 81.86 |\n| `DEP_LAS` | 75.84 |\n| `TOK2VEC_LOSS` | 8284457.01 |\n| `TAGGER_LOSS` | 913771.50 |\n| `MORPHOLOGIZER_LOSS` | 1997175.68 |\n| `TRAINABLE_LEMMATIZER_LOSS` | 761110.79 |\n| `PARSER_LOSS` | 6647260.73 |\n\nNB: For full details on tags etc., see the README.md in the model package.\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fdiyclassics%2Fla_dep_cltk_md","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fdiyclassics%2Fla_dep_cltk_md","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fdiyclassics%2Fla_dep_cltk_md/lists"}