https://github.com/ireneflorez/vocab-web-scraper
Web scraping tool to extract data (word list) from websites. Data is downloaded into an indexed sqlite3 list using frequency count and length.
https://github.com/ireneflorez/vocab-web-scraper
argparse beautifulsoup pycharm pytests python
Last synced: about 2 months ago
JSON representation
Web scraping tool to extract data (word list) from websites. Data is downloaded into an indexed sqlite3 list using frequency count and length.
- Host: GitHub
- URL: https://github.com/ireneflorez/vocab-web-scraper
- Owner: IreneFlorez
- Created: 2017-11-17T22:00:48.000Z (over 8 years ago)
- Default Branch: master
- Last Pushed: 2018-07-24T16:23:11.000Z (almost 8 years ago)
- Last Synced: 2025-08-31T13:41:42.543Z (10 months ago)
- Topics: argparse, beautifulsoup, pycharm, pytests, python
- Language: Python
- Homepage:
- Size: 4.88 KB
- Stars: 0
- Watchers: 0
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
# vocab-web-scraper
Page spider in python with PyCharm
Created a web scraping tool to extract data (word list) from websites using beautifulsoup4, argparse, urllib.request and pytests.
Data is downloaded into an indexed sqlite3 list using frequency count and length.
See part II of the scraper: https://github.com/IreneFlorez/vocab-tool