{"id":15014148,"url":"https://github.com/anasaito/skillner","last_synced_at":"2025-04-05T13:01:52.408Z","repository":{"id":38473385,"uuid":"394828845","full_name":"AnasAito/SkillNER","owner":"AnasAito","description":"A (smart) rule based NLP module to extract job skills from text","archived":false,"fork":false,"pushed_at":"2024-01-28T20:41:40.000Z","size":15970,"stargazers_count":179,"open_issues_count":14,"forks_count":56,"subscribers_count":6,"default_branch":"master","last_synced_at":"2025-04-05T13:01:43.985Z","etag":null,"topics":["ner","nlp","python","rule-based","skillner","skills","spacy"],"latest_commit_sha":null,"homepage":"https://skillner.vercel.app/","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/AnasAito.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2021-08-11T01:47:27.000Z","updated_at":"2025-03-30T03:07:23.000Z","dependencies_parsed_at":"2024-10-30T21:01:14.679Z","dependency_job_id":"ceea2b99-0845-4bd9-8c61-10996111c212","html_url":"https://github.com/AnasAito/SkillNER","commit_stats":{"total_commits":150,"total_committers":9,"mean_commits":"16.666666666666668","dds":0.52,"last_synced_commit":"e8cdbb6f591211bf5d0fe2c8a61ddb95526a78b3"},"previous_names":[],"tags_count":4,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/AnasAito%2FSkillNER","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/AnasAito%2FSkillNER/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/AnasAito%2FSkillNER/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/AnasAito%2FSkillNER/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/AnasAito","download_url":"https://codeload.github.com/AnasAito/SkillNER/tar.gz/refs/heads/master","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":247339147,"owners_count":20923013,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["ner","nlp","python","rule-based","skillner","skills","spacy"],"created_at":"2024-09-24T19:45:15.504Z","updated_at":"2025-04-05T13:01:52.381Z","avatar_url":"https://github.com/AnasAito.png","language":"Python","funding_links":[],"categories":[],"sub_categories":[],"readme":"\u003cp align=\"center\"\u003e\u003cimg width=\"50%\" src=\"https://user-images.githubusercontent.com/56308112/128958594-79813e72-b688-4a9a-9267-324f098d4b0c.png\" /\u003e\u003c/p\u003e\n\n[**Live demo**](https://share.streamlit.io/anasaito/skillner_demo/index.py) | [**Documentation**](https://badr-moufad.github.io/SkillNER/get_started.html) | [**Website**](https://skillner.vercel.app/)\n\n----------------------\n\n\n[![Downloads](https://static.pepy.tech/personalized-badge/skillner?period=month\u0026units=international_system\u0026left_color=blue\u0026right_color=green\u0026left_text=Downloads%20/%20months)](https://pepy.tech/project/skillner)\n[![License: MIT](https://img.shields.io/badge/License-MIT-yellow.svg)](https://opensource.org/licenses/MIT)\n\n**Just looking to test out SkillNer? Check out our [demo](https://anasaito-skillner-demo-index-4fiwi3.streamlit.app/)**.\n\nSkillNer is an NLP module to automatically Extract skills and certifications from unstructured job postings, texts, and applicant's resumes.\n\nSkillner uses [EMSI](https://skills.emsidata.com/) databse (an open source skill database) as a knowldge base linker to prevent skill duplications.\n\n\n\n\u003cp align=\"center\"\u003e\u003cimg width=\"50%\" src=\"https://user-images.githubusercontent.com/56308112/138768792-a25d25e7-1e43-4a44-aa46-8de9895ffe88.png\" /\u003e\u003c/p\u003e\n\n\n## Installation\n\nIt is easy to get started with **SkillNer** and take advantage of its features.\n\n1. First, install **SkillNer** through the ``pip``\n\n```bash\npip install skillNer\n```\n\n2. Next, run the following command to install ``spacy en_core_web_lg ``\nwhich is one of the main plugins of SkillNer. Thanks to its modular nature, you can \ncustomize SkillNer behavior just by adjusting  | plugin | unplugin modules. Don't worry about these details, we will discuss them in detail in the **upcoming Tutorial section**.\n\n```bash\npython -m spacy download en_core_web_lg\n```\n\n**Note:** The later installation will take a few seconds before it gets done since ``spacy en_core_web_lg `` is a bit too large (800 MB). Yet, you need to wait only one time.\n\n\n## Example of usage\n\nWith these initial steps being accomplished, let’s dive a bit deeper into skillNer through a worked example.\n\nLet’s say you want to extract skills from the following job posting:\n\n    “You are a Python developer with a solid experience in web development and can manage projects. \n    You quickly adapt to new environments and speak fluently English and French”\n\n### Annotating skills\n\nWe start first by importing modules, particularly spacy and SkillExtractor. Note that if you are using skillNer for the first time, it might take a while to download SKILL_DB.\n\n**SKILL_DB** is SkillNer default skills database. It was built upon [EMSI skills database ](https://skills.emsidata.com/).\n\n\n\n```python\n# imports\nimport spacy\nfrom spacy.matcher import PhraseMatcher\n\n# load default skills data base\nfrom skillNer.general_params import SKILL_DB\n# import skill extractor\nfrom skillNer.skill_extractor_class import SkillExtractor\n\n# init params of skill extractor\nnlp = spacy.load(\"en_core_web_lg\")\n# init skill extractor\nskill_extractor = SkillExtractor(nlp, SKILL_DB, PhraseMatcher)\n\n# extract skills from job_description\njob_description = \"\"\"\nYou are a Python developer with a solid experience in web development\nand can manage projects. You quickly adapt to new environments\nand speak fluently English and French\n\"\"\"\n\nannotations = skill_extractor.annotate(job_description)\n\n```\n\n\n\n### Exploit annotations\n\nVoilà! Now you can inspect results by rendering the text with the annotated skills.\nYou can achieve that through the ``.describe`` method. Note that the output of this method is \nliterally an HTML document that gets rendered in your notebook.\n\n\n\u003cp align=\"center\"\u003e\n    \u003cimg src=\"./screenshots/output-describe.gif\" alt=\"example output skillNer\"/\u003e\n\u003c/p\u003e\n\n\nBesides, you can use the raw result of the annotations. \nBelow is the value of the ``annotations`` variable from the code above.\n\n\n```python\n# output\n{\n    'text': 'you are a python developer with a solid experience in web development and can manage projects you quickly adapt to new environments and speak fluently english and french',\n    'results': {\n        'full_matches': [\n            {\n                'skill_id': 'KS122Z36QK3N5097B5JH', \n                'doc_node_value': 'web development', \n                'score': 1, 'doc_node_id': [10, 11]\n            }\n        ], '\n        ngram_scored': [\n            {\n                'skill_id': 'KS125LS6N7WP4S6SFTCK', \n                'doc_node_id': [3], \n                'doc_node_value': 'python', \n                'type': 'fullUni', \n                'score': 1, \n                'len': 1\n            }, \n        # the other annotated skills\n        # ...\n        ]\n    }\n}\n```\n\n# Contribute\n\nSkillNer is the first **Open Source** skill extractor. \nHence it is a tool dedicated to the community and thereby relies on its contribution to evolve.\n\nWe did our best to adapt SkillNer for usage and fixed many of its bugs. Therefore, we believe its key features \nmake it ready for a diversity of use cases. However, it still has not reached 100% stability. SkillNer needs the assistance of the community to be adapted further\nand broaden its usage. \n\n\nYou can contribute to SkillNer either by\n\n1. Reporting issues. Indeed, you may encounter one while you are using SkillNer. So do not hesitate to mention them in the [issue section of our GitHub repository](https://github.com/AnasAito/SkillNER/issues). Also, you can use the issue as a way to suggest new features to be added.\n\n2. Pushing code to our repository through pull requests. In case you fixed an issue or wanted to extend SkillNer features.\n\n\n3. A third (friendly and not technical) option to contribute to SkillNer will be soon released. *So, stay tuned...*\n\n\n\nFinally, make sure to read carefully [our guidelines](https://badr-moufad.github.io/SkillNER/contribute.html) before contributing. It will specify standards to follow so that we can understand what you want to say.\n\n\nBesides, it will help you setup SkillNer on your local machine, in case you are willing to push code.\n\n\n## Useful links\n\n- [Visit our website](https://skillner.vercel.app/) to learn about SkillNer features, how it works, and particularly explore our roadmap\n- Get started with SkillNer and get to know its API by visiting the [Documentation](https://badr-moufad.github.io/SkillNER/get_started.html)\n- [Test our Demo](https://share.streamlit.io/anasaito/skillner_demo/index.py) to see some of SkillNer capabilities\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fanasaito%2Fskillner","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fanasaito%2Fskillner","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fanasaito%2Fskillner/lists"}