Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/writer/replacy
spaCy match and replace, maintaining conjugation
https://github.com/writer/replacy
nlp spacy
Last synced: 4 days ago
JSON representation
spaCy match and replace, maintaining conjugation
- Host: GitHub
- URL: https://github.com/writer/replacy
- Owner: writer
- License: mit
- Created: 2019-12-17T22:11:33.000Z (almost 5 years ago)
- Default Branch: master
- Last Pushed: 2022-12-09T04:34:19.000Z (almost 2 years ago)
- Last Synced: 2024-06-12T10:50:44.638Z (5 months ago)
- Topics: nlp, spacy
- Language: Python
- Homepage: https://pypi.org/project/replacy/
- Size: 360 KB
- Stars: 33
- Watchers: 6
- Forks: 7
- Open Issues: 14
-
Metadata Files:
- Readme: README.md
- Changelog: CHANGELOG.md
- License: LICENSE.md
Awesome Lists containing this project
README
# replaCy: match & replace with spaCy
We found that in multiple projects we had duplicate code for using spaCy’s blazing fast matcher to do the same thing: Match-Replace-Grammaticalize. So we wrote replaCy!
- Match - spaCy’s matcher is great, and lets you match on text, shape, POS, dependency parse, and other features. We extended this with “match hooks”, predicates that get used in the callback function to further refine a match.
- Replace - Not built into spaCy’s matcher syntax, but easily added. You often want to replace a matched word with some other term.
- Grammaticalize - If you match on ”LEMMA”: “dance”, and replace with suggestions: ["sing"], but the actual match is danced, you need to conjugate “sing” appropriately. This is the “killer feature” of replaCy
[](https://spacy.io)
[](https://pypi.org/project/replacy/)
[](https://github.com/ambv/black)
## Requirements
- `spacy >= 2.0` (not installed by default, but replaCy needs to be instantiated with an `nlp` object)
## Installation
`pip install replacy`
## Quick start
```python
from replacy import ReplaceMatcher
from replacy.db import load_json
import spacy
match_dict = load_json('/path/to/your/match/dict.json')
# load nlp spacy model of your choice
nlp = spacy.load("en_core_web_sm")
rmatcher = ReplaceMatcher(nlp, match_dict=match_dict)
# get inflected suggestions
# look up the first suggestion
span = rmatcher("She extracts revenge.")[0]
span._.suggestions
# >>> ['exacts']
```
## Input
ReplaceMatcher accepts both text and spaCy doc.
```python
# text is ok
span = r_matcher("She extracts revenge.")[0]
# doc is ok too
doc = nlp("She extracts revenge.")
span = r_matcher(doc)[0]
```
## match_dict.json format
Here is a minimal `match_dict.json`:
```json
{
"extract-revenge": {
"patterns": [
{
"LEMMA": "extract",
"TEMPLATE_ID": 1
}
],
"suggestions": [
[
{
"TEXT": "exact",
"FROM_TEMPLATE_ID": 1
}
]
],
"match_hook": [
{
"name": "succeeded_by_phrase",
"args": "revenge",
"match_if_predicate_is": true
}
],
"test": {
"positive": [
"And at the same time extract revenge on those he so despises?",
"Watch as Tampa Bay extracts revenge against his former Los Angeles Rams team."
],
"negative": ["Mother flavours her custards with lemon extract."]
}
}
}
```
For more information how to compose `match_dict` see our [wiki](https://github.com/Qordobacode/replaCy/wiki/match_dict.json-format):
# Citing
If you use replaCy in your research, please cite with the following BibText
```bibtext
@misc{havens2019replacy,
title = {SpaCy match and replace, maintaining conjugation},
author = {Sam Havens, Aneta Stal, and Manhal Daaboul},
url = {https://github.com/Qordobacode/replaCy},
year = {2019}
}