Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/zevio/pcu
Plateforme de Connaissances Unifiées (PCU) project (i.e Unified Knowledge Platform)
https://github.com/zevio/pcu
extraction json keyphrase-extraction kleis knowledge knowledge-extraction langdetect pcu pcu-io pcu-json pcu-keyphrase pcu-language pcu-nlp pcu-pdf pcu-relation pdf python spacy text workflow
Last synced: 20 days ago
JSON representation
Plateforme de Connaissances Unifiées (PCU) project (i.e Unified Knowledge Platform)
- Host: GitHub
- URL: https://github.com/zevio/pcu
- Owner: zevio
- License: gpl-3.0
- Created: 2018-09-10T12:11:01.000Z (over 6 years ago)
- Default Branch: master
- Last Pushed: 2018-11-28T21:53:19.000Z (about 6 years ago)
- Last Synced: 2024-11-10T10:37:13.391Z (3 months ago)
- Topics: extraction, json, keyphrase-extraction, kleis, knowledge, knowledge-extraction, langdetect, pcu, pcu-io, pcu-json, pcu-keyphrase, pcu-language, pcu-nlp, pcu-pdf, pcu-relation, pdf, python, spacy, text, workflow
- Language: Python
- Size: 55.7 KB
- Stars: 1
- Watchers: 2
- Forks: 1
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
# PCU
Plateforme de Connaissances Unifiées (PCU) project (*i.e* Unified Knowledge Platform).
Semantic platform for valuing data. Open-source, configurable, written in Python 3.
## Components
The platform is composed of several components :
* **[pcu_io][pcu_io]** : Parse a file to get its textual content.
* **[pcu_pdf][pcu_pdf]** : Parse PDF files (to an extent, files format supported by **[Apache Tika][tika]**).
* **[pcu_json][pcu_json]** : Parse JSON files.
* **[pcu_language][pcu_language]** : Detect the main language used or all the languages used within a text. Based on **[langdetect][langdetect]**.
* **[pcu_nlp][pcu_nlp]** : Get syntactic annotations of a text. Based on **[spacy.io][spacy]**.
* **[pcu_keyphrase][pcu_keyphrase]** : Get keyphrases of a text. Based on **[kleis][kleis]**.
* **[pcu_relation][pcu_relation]** : Get semantic relationships existing between keyphrases of a text. Based on **[Kata Gábor][gabor]**'s algorithm.
[tika]: https://tika.apache.org
[langdetect]:https://pypi.org/project/langdetect/
[spacy]: https://spacy.io
[kleis]: https://github.com/sdhdez/kleis-keyphrase-extraction
[gabor]: http://www.inalco.fr/enseignant-chercheur/kata-gabor
[pcu_io]: https://github.com/zevio/pcu_io
[pcu_pdf]: https://github.com/zevio/pcu_pdf
[pcu_json]: https://github.com/zevio/pcu_json
[pcu_language]: https://github.com/zevio/pcu_language
[pcu_nlp]: https://github.com/zevio/pcu_nlp
[pcu_keyphrase]: https://github.com/zevio/pcu_keyphrase
[pcu_relation]: https://github.com/zevio/pcu_relation
## Installation
To install requirements, execute the Makefile with the following command line :
`make install`
## Usage
The semantic platform is entirely configurable. To use it, download the sources, go to pcu/ directory and tune the configuration file as you wish.
```
[pipeline]
language=
; default language : if empty, language will be automatically detected
nlp=spacy
; name of the NLP pipeline to use
keyphrase=yes
; yes if keyphrase extraction is enabled, no otherwise
```
* **language** : default language (en for English, fr for French). If empty, language will be automatically detected
* **nlp** : name of the NLP pipeline to use (spacy)
* **keyphrase** : yes if keyphrase extraction algorithm is enabled, no otherwise
To execute the workflow on your data, use the following command line :
```
python3 core.py path/to/data/to/process
```
## Solutions for problems encountered
### For Windows users
Some Windows users might encounter linking problems installing spacy, if so, launch ```make install``` as an administrator.