Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/camara94/crawlers
Web scraping is the process of using bots to extract content and data from a website. Unlike screen scraping, which only copies pixels displayed onscreen, web scraping extracts underlying HTML code and, with it, data stored in a database. The scraper can then replicate entire website content elsewhere
https://github.com/camara94/crawlers
crawler python scraping scrapy spider
Last synced: 1 day ago
JSON representation
Web scraping is the process of using bots to extract content and data from a website. Unlike screen scraping, which only copies pixels displayed onscreen, web scraping extracts underlying HTML code and, with it, data stored in a database. The scraper can then replicate entire website content elsewhere
- Host: GitHub
- URL: https://github.com/camara94/crawlers
- Owner: camara94
- License: apache-2.0
- Created: 2021-07-22T20:15:58.000Z (over 3 years ago)
- Default Branch: main
- Last Pushed: 2021-07-24T19:04:22.000Z (over 3 years ago)
- Last Synced: 2023-03-03T06:28:02.570Z (over 1 year ago)
- Topics: crawler, python, scraping, scrapy, spider
- Language: Python
- Homepage:
- Size: 269 KB
- Stars: 1
- Watchers: 2
- Forks: 0
- Open Issues: 0