Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/moj124/web_crawler
The web_crawler is a asynchoronous gevent link crawler that maps all the associated local links constrained by the input webpage url.
https://github.com/moj124/web_crawler
crawler crawler-python links-spider
Last synced: 5 days ago
JSON representation
The web_crawler is a asynchoronous gevent link crawler that maps all the associated local links constrained by the input webpage url.
- Host: GitHub
- URL: https://github.com/moj124/web_crawler
- Owner: moj124
- License: mit
- Created: 2021-10-14T11:15:41.000Z (over 3 years ago)
- Default Branch: main
- Last Pushed: 2021-10-22T10:01:36.000Z (over 3 years ago)
- Last Synced: 2024-11-19T08:15:48.420Z (2 months ago)
- Topics: crawler, crawler-python, links-spider
- Language: Python
- Homepage:
- Size: 758 KB
- Stars: 0
- Watchers: 2
- Forks: 0
- Open Issues: 0