https://github.com/uliontse/crawl_requests
The module(based requests) can update user-agent and proxy automatically. Usually used by crawler and spider.
https://github.com/uliontse/crawl_requests
crawl proxy requests spider user-agent
Last synced: 8 months ago
JSON representation
The module(based requests) can update user-agent and proxy automatically. Usually used by crawler and spider.
- Host: GitHub
- URL: https://github.com/uliontse/crawl_requests
- Owner: UlionTse
- License: mit
- Created: 2017-10-19T08:58:24.000Z (almost 8 years ago)
- Default Branch: master
- Last Pushed: 2018-12-31T17:32:14.000Z (almost 7 years ago)
- Last Synced: 2024-09-13T10:53:30.257Z (about 1 year ago)
- Topics: crawl, proxy, requests, spider, user-agent
- Language: Python
- Homepage: https://pypi.python.org/pypi/crawl-requests/2.2.8
- Size: 26.4 KB
- Stars: 0
- Watchers: 3
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.rst
- License: LICENSE