https://github.com/chezou/spacyr-sparklyr

Example code of spacyr with sparklyr
https://github.com/chezou/spacyr-sparklyr

Last synced: 3 months ago
JSON representation

Example code of spacyr with sparklyr

• Host: GitHub
• URL: https://github.com/chezou/spacyr-sparklyr
• Owner: chezou
• License: apache-2.0
• Archived: true
• Created: 2017-09-10T08:00:20.000Z (about 7 years ago)
• Default Branch: master
• Last Pushed: 2017-09-11T00:51:05.000Z (about 7 years ago)
• Last Synced: 2024-05-01T23:58:46.472Z (6 months ago)
• Language: R
• Size: 7.81 KB
• Stars: 8
• Watchers: 1
• Forks: 1
• Open Issues: 0
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

• awesome-sparklyr - spacyr-sparklyr: Example code of spacyr with sparklyr

README

        
# spacyr example with sparklyr

 This example will extract named entity from text and extract with spark_apply() of sparklyr.

[spacyr](https://github.com/kbenoit/spacyr) is R binding of [SpaCy](https://spacy.io/), which is Python library for NLP.

spacyr requires Python with Spacy.

## How to use it

1. Run `install_spacy.sh` on CDSW terminal

2. Install following packages on R session:

   - `devtools::install_github("rstudio/sparklyr")`

   - `install.packages(c("janeaustenr"))`

3. Open sparcyr-sparklyr.R on CDSW session and run all

If you are not CDSW user, please run them on gateway node.