{"id":16269245,"url":"https://github.com/sheffieldnlp/deepQuest-py","last_synced_at":"2025-10-25T08:30:25.443Z","repository":{"id":47070587,"uuid":"331041626","full_name":"sheffieldnlp/deepQuest-py","owner":"sheffieldnlp","description":"Large and Distilled Models for Quality Estimation of Machine Translation","archived":false,"fork":false,"pushed_at":"2021-11-25T14:26:40.000Z","size":2798,"stargazers_count":7,"open_issues_count":1,"forks_count":1,"subscribers_count":13,"default_branch":"main","last_synced_at":"2024-10-11T18:07:52.835Z","etag":null,"topics":["deep-learning","machine-translation","natural-language-processing","quality-estimation"],"latest_commit_sha":null,"homepage":"","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"other","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/sheffieldnlp.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":"CITATION.bib","codeowners":null,"security":null,"support":null}},"created_at":"2021-01-19T16:29:15.000Z","updated_at":"2024-07-10T16:51:57.000Z","dependencies_parsed_at":"2022-08-31T00:40:50.141Z","dependency_job_id":null,"html_url":"https://github.com/sheffieldnlp/deepQuest-py","commit_stats":null,"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/sheffieldnlp%2FdeepQuest-py","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/sheffieldnlp%2FdeepQuest-py/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/sheffieldnlp%2FdeepQuest-py/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/sheffieldnlp%2FdeepQuest-py/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/sheffieldnlp","download_url":"https://codeload.github.com/sheffieldnlp/deepQuest-py/tar.gz/refs/heads/main","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":238104965,"owners_count":19417234,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["deep-learning","machine-translation","natural-language-processing","quality-estimation"],"created_at":"2024-10-10T18:07:42.433Z","updated_at":"2025-10-25T08:30:25.046Z","avatar_url":"https://github.com/sheffieldnlp.png","language":"Python","funding_links":[],"categories":["Uncategorized"],"sub_categories":["Uncategorized"],"readme":"# deepQuest-py\ndeepQuest-py is a framework for training and evaluation of models for Quality Estimation of Machine Translation. \nThis is a new version of [deepQuest](https://github.com/sheffieldnlp/deepQuest) - the first framework for neural Quality Estimation. \n\ndeepQuest-py provides:\n\n- **high performing** sentence-level and word-level models based on finetuning pre-trained Transformers;\n- **light-weight and efficient** sentence-level models implemented via **knowledge distillation**.\n\ndeepQuest-py includes implementations of several approaches for Quality Estimation proposed in recent research:\n\n- [Knowledge Distillation for Quality Estimation (Gajbhiye et al., 2021)](https://github.com/sheffieldnlp/deepQuest-py/tree/main/examples/knowledge_distillation)\n- [TransQuest at WMT2020: Sentence-Level Direct Assessment (Ranasinghe et al., 2020)](https://github.com/sheffieldnlp/deepQuest-py/tree/main/examples/monotransquest)\n- [Two-Phase Cross-Lingual Language Model Fine-Tuning for Machine Translation Quality Estimation (Lee, 2020)](https://github.com/sheffieldnlp/deepQuest-py/tree/main/examples/beringlab)\n- [deepQuest: A Framework for Neural-based Quality Estimation (Ive et al., 2018)](https://github.com/sheffieldnlp/deepQuest-py/tree/main/examples/birnn)\n\nSee our [examples](https://github.com/sheffieldnlp/deepQuest-py/tree/main/examples) for instructions on how to train and test specific models.\n\n## Online Demo\nCheck out our [web tool](https://dq.fredblain.org/) to try out most of our trained models on your own data!\n\n## Installation\ndeepQuest-py requires Python 3.6 or later. \n\n```\ngit clone https://github.com/sheffieldnlp/deepQuest-py.git\ncd deepQuest-py\npip install -e .\n```\n## Licence\ndeepQuest-py is licenced under a CC BY-NC-SA licence.\n\n## Citation\nIf you use deepQuest-py in your research, please cite our [EMNLP 2021 Demo paper](https://aclanthology.org/2021.emnlp-demo.42.pdf):\n\n```\n@inproceedings{alva-manchego-etal-2021-deepquest,\n    title = \"deep{Q}uest-py: {L}arge and Distilled Models for Quality Estimation\",\n    author = \"Alva-Manchego, Fernando  and\n      Obamuyide, Abiola  and\n      Gajbhiye, Amit  and\n      Blain, Fr{\\'e}d{\\'e}ric  and\n      Fomicheva, Marina  and\n      Specia, Lucia\",\n    booktitle = \"Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing: System Demonstrations\",\n    month = nov,\n    year = \"2021\",\n    address = \"Online and Punta Cana, Dominican Republic\",\n    publisher = \"Association for Computational Linguistics\",\n    url = \"https://aclanthology.org/2021.emnlp-demo.42\",\n    pages = \"382--389\",\n}\n```\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fsheffieldnlp%2FdeepQuest-py","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fsheffieldnlp%2FdeepQuest-py","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fsheffieldnlp%2FdeepQuest-py/lists"}