https://github.com/s3rgeym/wscrap

Command line web scraping tool.
https://github.com/s3rgeym/wscrap

crawler scraping

Last synced: 1 day ago
JSON representation

Command line web scraping tool.

• Host: GitHub
• URL: https://github.com/s3rgeym/wscrap
• Owner: s3rgeym
• Created: 2020-08-24T02:11:51.000Z (about 4 years ago)
• Default Branch: master
• Last Pushed: 2022-08-26T23:57:22.000Z (about 2 years ago)
• Last Synced: 2024-09-26T09:37:31.279Z (about 1 month ago)
• Topics: crawler, scraping
• Language: Python
• Homepage:
• Size: 18.6 KB
• Stars: 0
• Watchers: 2
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

README

        
# WScrap

Command line web scraping tool.

Usage:

```zsh

$ pip install wscrap

# The output format is JSONL. Use jq to parse it.

$ wscrap -i domain_list.txt -o resutls.json -vv 2> log.txt

# or without install

$ pipx run wscrap -h

```