{"id":17798002,"url":"https://github.com/yuvalpinter/unblend","last_synced_at":"2025-03-17T04:32:50.309Z","repository":{"id":93102407,"uuid":"296701768","full_name":"yuvalpinter/unblend","owner":"yuvalpinter","description":"Will it Unblend? (Findings of EMNLP 2020)","archived":false,"fork":false,"pushed_at":"2021-12-02T13:13:39.000Z","size":1301,"stargazers_count":6,"open_issues_count":0,"forks_count":0,"subscribers_count":6,"default_branch":"main","last_synced_at":"2025-02-27T18:03:18.239Z","etag":null,"topics":[],"latest_commit_sha":null,"homepage":null,"language":"Jupyter Notebook","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"gpl-3.0","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/yuvalpinter.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":"CITATION.cff","codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2020-09-18T18:35:30.000Z","updated_at":"2024-01-02T11:52:58.000Z","dependencies_parsed_at":"2023-03-05T01:00:34.308Z","dependency_job_id":null,"html_url":"https://github.com/yuvalpinter/unblend","commit_stats":null,"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/yuvalpinter%2Funblend","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/yuvalpinter%2Funblend/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/yuvalpinter%2Funblend/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/yuvalpinter%2Funblend/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/yuvalpinter","download_url":"https://codeload.github.com/yuvalpinter/unblend/tar.gz/refs/heads/main","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":243842005,"owners_count":20356588,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":[],"created_at":"2024-10-27T11:58:34.054Z","updated_at":"2025-03-17T04:32:50.302Z","avatar_url":"https://github.com/yuvalpinter.png","language":"Jupyter Notebook","funding_links":[],"categories":[],"sub_categories":[],"readme":"# Will it Unblend?\n\nThis is the home for code and data from the paper [**Will it Unblend?**](https://www.aclweb.org/anthology/2020.findings-emnlp.138/), Findings of EMNLP, November 2020.\n\n## Contents\n**November 13, 2021**: We released the [complex words dataset](https://github.com/yuvalpinter/unblend/blob/main/complex_words.tsv) of 312 novel blends and compounds.\nThe data is in the following schema:\n* **class**: whether the word is a blend or a compound.\n* **word**: a word first appearing in the New York Times between November 2017 and March 2019 (taken from [NYTWIT](https://github.com/yuvalpinter/nytwit), follow link for details).\n* **bases**: the words contributing to the complex word (space-delimited), manually annotated with help of originating NYT context.\n* **sequence**: character-level annotation of the word reflecting each character's origin: **P**refix, **A**/**B**/**C** one of the bases (labeled successively according to their order in the *bases* column), **X** more than one base, **O** additional material, **S**uffix. See section 2 of the paper for details.\n* **linearity**: whether the relation between the base-contributing parts of the word is linear: no **O**; no **A** preceded by a **B** or **X**; no **B** followed by an **A** or **X**; natural extension to words with a **C**. Compounds, by definition, contain no **X** or **O** and are always linear.\n* **semantic relation**: the relationship between the *bases*, annotated according to the schema from [Tratz and Hovy, 2010](https://www.aclweb.org/anthology/P10-1070/).\n\nStay tuned for the following releases:\n- [x] Code and data for reproducing the similarity experiments in section 3, including all BERT activations and lists of *smoothies*. (February 16, 2021)\n- [ ] Code and data for reproducing the segmentation experiments in section 4.1, including models for the character LM, ~~[the character tagger](data/paxobs_charmanteau-to-nyt.pkl) and~~ the news-trained BPE table.\n- [x] [Code](src/ranking) and data for reproducing the recovery experiments in section 4.2, including [candidate](data/recovery_candidates_fasttext.tsv) [lists](data/recovery_candidates_glove840b.tsv). (December 2, 2021)\n\n## Citing is Caring\nPlease use the following citation when you use our data or methods:\n```\n@inproceedings{pinter-etal-2020-will,\n    title = \"Will it Unblend?\",\n    author = \"Pinter, Yuval  and\n      Jacobs, Cassandra L.  and\n      Eisenstein, Jacob\",\n    booktitle = \"Findings of the Association for Computational Linguistics: EMNLP 2020\",\n    month = nov,\n    year = \"2020\",\n    address = \"Online\",\n    publisher = \"Association for Computational Linguistics\",\n    url = \"https://www.aclweb.org/anthology/2020.findings-emnlp.138\",\n    pages = \"1525--1535\",\n}\n```\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fyuvalpinter%2Funblend","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fyuvalpinter%2Funblend","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fyuvalpinter%2Funblend/lists"}