Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/confact/spider.cr
Spider.cr is a spider crawler in Crystal. It handles collecting, scraping, and parsing. So you can spend your time collecting the data you want on a big scale.
https://github.com/confact/spider.cr
crawler spider
Last synced: 7 days ago
JSON representation
Spider.cr is a spider crawler in Crystal. It handles collecting, scraping, and parsing. So you can spend your time collecting the data you want on a big scale.
- Host: GitHub
- URL: https://github.com/confact/spider.cr
- Owner: confact
- License: mit
- Created: 2021-11-15T14:57:50.000Z (about 3 years ago)
- Default Branch: master
- Last Pushed: 2021-12-21T08:17:24.000Z (almost 3 years ago)
- Last Synced: 2024-05-06T00:04:57.133Z (6 months ago)
- Topics: crawler, spider
- Language: Crystal
- Homepage:
- Size: 20.5 KB
- Stars: 9
- Watchers: 2
- Forks: 0
- Open Issues: 1