{"id":20276952,"url":"https://github.com/phoenix-ji/pytorch-tfpner","last_synced_at":"2025-03-04T01:33:37.169Z","repository":{"id":256381927,"uuid":"455891587","full_name":"Phoenix-JI/pytorch-TFPNER","owner":"Phoenix-JI","description":"TFPNER: Exploration on the Named Entity Recognition of Token Fused with Part-of-Speech","archived":false,"fork":false,"pushed_at":"2022-03-07T05:43:06.000Z","size":8247,"stargazers_count":1,"open_issues_count":0,"forks_count":0,"subscribers_count":1,"default_branch":"main","last_synced_at":"2025-01-14T06:46:14.842Z","etag":null,"topics":["attention-mechanism","bert-fine-tuning","bert-model","cased-characters","embedding-layer","model-ensemble","named-entity-recognition","part-of-speech"],"latest_commit_sha":null,"homepage":"","language":"Jupyter Notebook","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/Phoenix-JI.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2022-02-05T14:26:58.000Z","updated_at":"2022-02-07T13:43:12.000Z","dependencies_parsed_at":"2024-09-10T12:32:09.703Z","dependency_job_id":"aadf1dda-9da5-402c-af79-3733f1e4c026","html_url":"https://github.com/Phoenix-JI/pytorch-TFPNER","commit_stats":null,"previous_names":["phoenix-ji/pytorch-tfpner"],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Phoenix-JI%2Fpytorch-TFPNER","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Phoenix-JI%2Fpytorch-TFPNER/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Phoenix-JI%2Fpytorch-TFPNER/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Phoenix-JI%2Fpytorch-TFPNER/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/Phoenix-JI","download_url":"https://codeload.github.com/Phoenix-JI/pytorch-TFPNER/tar.gz/refs/heads/main","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":241768407,"owners_count":20017117,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["attention-mechanism","bert-fine-tuning","bert-model","cased-characters","embedding-layer","model-ensemble","named-entity-recognition","part-of-speech"],"created_at":"2024-11-14T13:16:20.735Z","updated_at":"2025-03-04T01:33:37.143Z","avatar_url":"https://github.com/Phoenix-JI.png","language":"Jupyter Notebook","funding_links":[],"categories":[],"sub_categories":[],"readme":"# TFPNER\n## TFPNER: Exploration on the Named Entity Recognition of Token Fused with Part-of-Speech\nNamed entity recognition (NER), which aims at identifying real-world entity mentions from texts, is a fundamental task in natural language processing with a wide range of applications. \nPrevious approaches mainly focus on the original pure sentence but the Part of speech (POS) contains rich semantic information and contribute to the success of the Natural Language Processing task. \nThe baseline is the BERT model with the original token. To further improve the performance of the NER task, we proposed the five methods that employed POS tags fused with the original tokens based on the BERT model to achieve the NER task, including concatenating token and POS as one or two sentences, adding POS embedding as one of the embedding elements, model ensemble, and conduct the multi-attention between the token representations and POS representations. \nIn this work, we addressed the CoNLL-2003 and Groningen Meaning Bank (GMB) datasets which can provide both NER tags and POS tags. From our experiments on two datasets, part of the proposed methods can show performance improvement in comparison with the baseline methods.\n\u003c!-- ### This is the project I worked with Haoqing Tang, the extraordinary computer scientist in CV \u0026 NLP area, during the interesting and memorable Postgraduate study period. --\u003e\n## Model\nHere is the model we built to get the higher performance\n### Token + POS\n![This is an image](https://github.com/Phoenix-JI/TFPNER/blob/main/Token%2BPOS.png)\n### Token + [SEP] +POS\n![This is an image](https://github.com/Phoenix-JI/TFPNER/blob/main/Token%2B%5BSEP%5D%2BPOS.png)\n### POS Embedding Layer\n![This is an image](https://github.com/Phoenix-JI/TFPNER/blob/main/POS%20Embedding%20Layer.png)\n### Token POS Attention\n![This is an image](https://github.com/Phoenix-JI/TFPNER/blob/main/Token%20POS%20Attention.png)\n### Model Ensemble\n![This is an image](https://github.com/Phoenix-JI/TFPNER/blob/main/Model%20Ensemble.png)\n## Result\n### The experimental result on CoNLL-2003 dataset\n![This is an image](https://github.com/Phoenix-JI/TFPNER/blob/main/Experimental%20Results%E2%80%93CoNLL-2003.png)\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fphoenix-ji%2Fpytorch-tfpner","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fphoenix-ji%2Fpytorch-tfpner","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fphoenix-ji%2Fpytorch-tfpner/lists"}