{"id":13444428,"url":"https://github.com/sebastianruder/NLP-progress","last_synced_at":"2025-03-20T18:32:45.064Z","repository":{"id":37270136,"uuid":"138331573","full_name":"sebastianruder/NLP-progress","owner":"sebastianruder","description":"Repository to track the progress in Natural Language Processing (NLP), including the datasets and the current state-of-the-art for the most common NLP tasks.","archived":false,"fork":false,"pushed_at":"2024-07-28T00:44:25.000Z","size":1399,"stargazers_count":22580,"open_issues_count":38,"forks_count":3615,"subscribers_count":1264,"default_branch":"master","last_synced_at":"2024-10-14T13:40:51.880Z","etag":null,"topics":["dialogue","machine-learning","machine-translation","named-entity-recognition","natural-language-processing","nlp-tasks"],"latest_commit_sha":null,"homepage":"https://nlpprogress.com/","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/sebastianruder.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":"CITATION.cff","codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2018-06-22T17:43:55.000Z","updated_at":"2024-10-14T13:38:35.000Z","dependencies_parsed_at":"2023-01-31T17:31:45.892Z","dependency_job_id":"aebe5146-4923-4d6c-bc89-1a21af575938","html_url":"https://github.com/sebastianruder/NLP-progress","commit_stats":null,"previous_names":[],"tags_count":3,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/sebastianruder%2FNLP-progress","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/sebastianruder%2FNLP-progress/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/sebastianruder%2FNLP-progress/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/sebastianruder%2FNLP-progress/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/sebastianruder","download_url":"https://codeload.github.com/sebastianruder/NLP-progress/tar.gz/refs/heads/master","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":221792892,"owners_count":16881289,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["dialogue","machine-learning","machine-translation","named-entity-recognition","natural-language-processing","nlp-tasks"],"created_at":"2024-07-31T04:00:22.615Z","updated_at":"2024-10-28T06:30:58.723Z","avatar_url":"https://github.com/sebastianruder.png","language":"Python","readme":"# Tracking Progress in Natural Language Processing\n\n## Table of contents\n\n### English\n\n- [Automatic speech recognition](english/automatic_speech_recognition.md)\n- [CCG](english/ccg.md)\n- [Common sense](english/common_sense.md)\n- [Constituency parsing](english/constituency_parsing.md)\n- [Coreference resolution](english/coreference_resolution.md)\n- [Data-to-Text Generation](english/data_to_text_generation.md)\n- [Dependency parsing](english/dependency_parsing.md)\n- [Dialogue](english/dialogue.md)\n- [Domain adaptation](english/domain_adaptation.md)\n- [Entity linking](english/entity_linking.md)\n- [Grammatical error correction](english/grammatical_error_correction.md)\n- [Information extraction](english/information_extraction.md)\n- [Intent Detection and Slot Filling](english/intent_detection_slot_filling.md) \n- [Keyphrase Extraction and Generation](english/keyphrase_extraction_generation.md)\n- [Language modeling](english/language_modeling.md)\n- [Lexical normalization](english/lexical_normalization.md)\n- [Machine translation](english/machine_translation.md)\n- [Missing elements](english/missing_elements.md)\n- [Multi-task learning](english/multi-task_learning.md)\n- [Multi-modal](english/multimodal.md)\n- [Named entity recognition](english/named_entity_recognition.md)\n- [Natural language inference](english/natural_language_inference.md)\n- [Part-of-speech tagging](english/part-of-speech_tagging.md)\n- [Paraphrase Generation](english/paraphrase-generation.md)\n- [Question answering](english/question_answering.md)\n- [Relation prediction](english/relation_prediction.md)\n- [Relationship extraction](english/relationship_extraction.md)\n- [Semantic textual similarity](english/semantic_textual_similarity.md)\n- [Semantic parsing](english/semantic_parsing.md)\n- [Semantic role labeling](english/semantic_role_labeling.md)\n- [Sentiment analysis](english/sentiment_analysis.md)\n- [Shallow syntax](english/shallow_syntax.md)\n- [Simplification](english/simplification.md)\n- [Stance detection](english/stance_detection.md)\n- [Summarization](english/summarization.md)\n- [Taxonomy learning](english/taxonomy_learning.md)\n- [Temporal processing](english/temporal_processing.md)\n- [Text classification](english/text_classification.md)\n- [Word sense disambiguation](english/word_sense_disambiguation.md)\n\n### Vietnamese\n\n- [Dependency parsing](vietnamese/vietnamese.md#dependency-parsing)\n- [Intent detection and Slot filling](vietnamese/vietnamese.md#intent-detection-and-slot-filling)\n- [Machine translation](vietnamese/vietnamese.md#machine-translation)\n- [Named entity recognition](vietnamese/vietnamese.md#named-entity-recognition)\n- [Part-of-speech tagging](vietnamese/vietnamese.md#part-of-speech-tagging)\n- [Semantic parsing](vietnamese/vietnamese.md#semantic-parsing)\n- [Word segmentation](vietnamese/vietnamese.md#word-segmentation)\n\n### Hindi\n\n- [Chunking](hindi/hindi.md#chunking)\n- [Part-of-speech tagging](hindi/hindi.md#part-of-speech-tagging)\n- [Machine Translation](hindi/hindi.md#machine-translation)\n\n### Chinese\n\n- [Entity linking](chinese/chinese.md#entity-linking)\n- [Chinese word segmentation](chinese/chinese_word_segmentation.md)\n- [Question answering](chinese/question_answering.md)\n\nFor more tasks, datasets and results in Chinese, check out the [Chinese NLP](https://chinesenlp.xyz/#/) website.\n\n### French\n\n- [Question answering](french/question_answering.md)\n- [Summarization](french/summarization.md)\n\n### Russian\n\n- [Question answering](russian/question_answering.md)\n- [Sentiment Analysis](russian/sentiment-analysis.md)\n- [Summarization](russian/summarization.md)\n\n### Spanish\n\n- [Named Entity Recognition](spanish/named_entity_recognition.md)\n- [Entity linking](spanish/entity_linking.md#entity-linking)\n- [Summarization](spanish/summarization.md)\n\n### Portuguese\n\n- [Question Answering](portuguese/question_answering.md)\n\n### Korean\n\n- [Question Answering](korean/question_answering.md)\n\n### Nepali\n\n- [Machine Translation](nepali/nepali.md#machine-translation)\n\n### Bengali\n- [Part-of-speech Tagging](bengali/part_of_speech_tagging.md)\n- [Emotion Detection](bengali/emotion_detection.md)\n- [Sentiment Analysis](bengali/sentiment_analysis.md)\n\n### Persian\n- [Named entity recognition](persian/named_entity_recognition.md)\n- [Natural language inference](persian/natural_language_inference.md)\n- [Summarization](persian/summarization.md)\n\n### Turkish\n\n- [Summarization](turkish/summarization.md)\n\n### German\n\n- [Question Answering](german/question_answering.md)\n- [Summarization](german/summarization.md)\n\n### Arabic\n- [Language modeling](arabic/language_modeling.md)\n\n\nThis document aims to track the progress in Natural Language Processing (NLP) and give an overview\nof the state-of-the-art (SOTA) across the most common NLP tasks and their corresponding datasets.\n\nIt aims to cover both traditional and core NLP tasks such as dependency parsing and part-of-speech tagging\nas well as more recent ones such as reading comprehension and natural language inference. The main objective\nis to provide the reader with a quick overview of benchmark datasets and the state-of-the-art for their\ntask of interest, which serves as a stepping stone for further research. To this end, if there is a \nplace where results for a task are already published and regularly maintained, such as a public leaderboard,\nthe reader will be pointed there.\n\nIf you want to find this document again in the future, just go to [`nlpprogress.com`](https://nlpprogress.com/)\nor [`nlpsota.com`](http://nlpsota.com/) in your browser.\n\n### Contributing\n\n#### Guidelines\n\n**Results** \u0026nbsp; Results reported in published papers are preferred; an exception may be made for influential preprints.\n\n**Datasets** \u0026nbsp; Datasets should have been used for evaluation in at least one published paper besides \nthe one that introduced the dataset.\n\n**Code** \u0026nbsp; We recommend to add a link to an implementation \nif available. You can add a `Code` column (see below) to the table if it does not exist.\nIn the `Code` column, indicate an official implementation with [Official](http://link_to_implementation).\nIf an unofficial implementation is available, use [Link](http://link_to_implementation) (see below).\nIf no implementation is available, you can leave the cell empty.\n\n#### Adding a new result\n\nIf you would like to add a new result, you can just click on the small edit button in the top-right\ncorner of the file for the respective task (see below).\n\n![Click on the edit button to add a file](img/edit_file.png)\n\nThis allows you to edit the file in Markdown. Simply add a row to the corresponding table in the\nsame format. Make sure that the table stays sorted (with the best result on top). \nAfter you've made your change, make sure that the table still looks ok by clicking on the\n\"Preview changes\" tab at the top of the page. If everything looks good, go to the bottom of the page,\nwhere you see the below form. \n\n![Fill out the file change information](img/propose_file_change.png)\n\nAdd a name for your proposed change, an optional description, indicate that you would like to\n\"Create a new branch for this commit and start a pull request\", and click on \"Propose file change\".\n\n#### Adding a new dataset or task\n\nFor adding a new dataset or task, you can also follow the steps above. Alternatively, you can fork the repository.\nIn both cases, follow the steps below:\n\n1. If your task is completely new, create a new file and link to it in the table of contents above.\n2. If not, add your task or dataset to the respective section of the corresponding file (in alphabetical order).\n3. Briefly describe the dataset/task and include relevant references. \n4. Describe the evaluation setting and evaluation metric.\n5. Show how an annotated example of the dataset/task looks like.\n6. Add a download link if available.\n7. Copy the below table and fill in at least two results (including the state-of-the-art)\n  for your dataset/task (change Score to the metric of your dataset). If your dataset/task\n  has multiple metrics, add them to the right of `Score`.\n1. Submit your change as a pull request.\n  \n| Model           | Score  |  Paper / Source | Code |\n| ------------- | :-----:| --- | --- |\n|  |  |  | |\n\n\n### Wish list\n\nThese are tasks and datasets that are still missing:\n\n- Bilingual dictionary induction\n- Discourse parsing\n- Keyphrase extraction\n- Knowledge base population (KBP)\n- More dialogue tasks\n- Semi-supervised learning\n- Frame-semantic parsing (FrameNet full-sentence analysis)\n\n### Exporting into a structured format\n\nYou can extract all the data into a structured, machine-readable JSON format with parsed tasks, descriptions and SOTA tables. \n\nThe instructions are in [structured/README.md](structured/README.md).\n\n### Instructions for building the site locally\n\nInstructions for building the website locally using Jekyll can be found [here](jekyll_instructions.md).\n\n\n","funding_links":[],"categories":["Uncategorized","Python","AI, ML, DL","Papers","Table of Contents","Machine Learning","其他_NLP自然语言处理","机器学习","Awesome lists","Natural Language Processing (NLP)","Tutorials and Notes from Talented People","📚 Project Purpose"],"sub_categories":["Uncategorized","SOTA \u0026 Latest Research List","JavaScript","其他_文本生成、文本对话","NLP","5. Others","Machine Learning (Interview-Level"],"project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fsebastianruder%2FNLP-progress","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fsebastianruder%2FNLP-progress","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fsebastianruder%2FNLP-progress/lists"}