https://github.com/kevinroberts/urbanscraper

https://github.com/kevinroberts/urbanscraper

Last synced: 5 days ago
JSON representation

• Host: GitHub
• URL: https://github.com/kevinroberts/urbanscraper
• Owner: kevinroberts
• License: mit
• Created: 2020-08-19T17:53:38.000Z (over 4 years ago)
• Default Branch: master
• Last Pushed: 2024-01-01T19:47:19.000Z (11 months ago)
• Last Synced: 2024-04-09T15:28:25.684Z (7 months ago)
• Language: Java
• Size: 2.75 MB
• Stars: 0
• Watchers: 2
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

README

        
# Urban Dictionary Web Scraping exercise

- urban dictionary scraping via headless chrome

- scrape definitions to a pg sql database, via processing queue

Prerequisites:

- Java 11 jdk

- Chrome browser installed

- Chrome driver installed

To run project:

- create an app.properties file under src/main/resources and include the required system properties

- `./gradlew build run`

Build the binary:

- `./gradlew build`

- Change to the distribution folder and unzip and run the binary

- `./vinscraper`

Released under MIT License