https://github.com/ayushexel/spacy_tagger_parser_ud

spaCy projects integration test with W&B artifacts
https://github.com/ayushexel/spacy_tagger_parser_ud

Last synced: 27 days ago
JSON representation

spaCy projects integration test with W&B artifacts

• Host: GitHub
• URL: https://github.com/ayushexel/spacy_tagger_parser_ud
• Owner: AyushExel
• License: mit
• Created: 2021-03-13T07:25:01.000Z (almost 4 years ago)
• Default Branch: main
• Last Pushed: 2021-03-13T08:20:28.000Z (almost 4 years ago)
• Last Synced: 2024-10-28T07:22:54.037Z (2 months ago)
• Language: Python
• Size: 4.88 KB
• Stars: 1
• Watchers: 3
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

README

        


# 🪐 spaCy Project: Part-of-speech Tagging & Dependency Parsing (Universal Dependencies)

This project template lets you train a part-of-speech tagger, morphologizer and dependency parser from a [Universal Dependencies](https://universaldependencies.org/) corpus. It takes care of downloading the treebank, converting it to spaCy's format and training and evaluating the model. The template uses the [`UD_English-EWT`](https://github.com/UniversalDependencies/UD_English-EWT) treebank by default, but you can swap it out for any other available treebank. Just make sure to adjust the `lang` and treebank settings in the variables below. Use `xx` for multi-language if no language-specific tokenizer is available in spaCy. Note that multi-word tokens will be merged together when the corpus is converted since spaCy does not support multi-word token expansion.

## 📋 project.yml

The [`project.yml`](project.yml) defines the data assets required by the

project, as well as the available commands and workflows. For details, see the

[spaCy projects documentation](https://spacy.io/usage/projects).

### ⏯ Commands

The following commands are defined by the project. They

can be executed using [`spacy project run [name]`](https://spacy.io/api/cli#project-run).

Commands are only re-run if their inputs have changed.

| Command | Description |

| --- | --- |

| `preprocess` | Convert the data to spaCy's format |

| `train` | Train UD_English-EWT |

| `evaluate` | Evaluate on the test data and save the metrics |

| `package` | Package the trained model so it can be installed |

| `clean` | Remove intermediate files |

### ⏭ Workflows

The following workflows are defined by the project. They

can be executed using [`spacy project run [name]`](https://spacy.io/api/cli#project-run)

and will run the specified commands in order. Commands are only re-run if their

inputs have changed.

| Workflow | Steps |

| --- | --- |

| `all` | `preprocess` → `train` → `evaluate` → `package` |

### 🗂 Assets

The following assets are defined by the project. They can

be fetched by running [`spacy project assets`](https://spacy.io/api/cli#project-assets)

in the project directory.

| File | Source | Description |

| --- | --- | --- |

| `assets/UD_English-EWT` | Git |  |