Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/sujith3g/useragents.json
useragents.json for crawlers
https://github.com/sujith3g/useragents.json
Last synced: 16 days ago
JSON representation
useragents.json for crawlers
- Host: GitHub
- URL: https://github.com/sujith3g/useragents.json
- Owner: sujith3g
- Created: 2015-04-05T20:20:36.000Z (almost 10 years ago)
- Default Branch: master
- Last Pushed: 2015-04-05T20:22:43.000Z (almost 10 years ago)
- Last Synced: 2023-03-22T14:03:30.239Z (almost 2 years ago)
- Homepage: https://github.com/HedCET/useragents_updater
- Size: 137 KB
- Stars: 0
- Watchers: 2
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
#User Agent Based Web Crawling
It contains an array of all the dektop browser useragents, which can be used for effective web-crawling. The array format is such that it picks random user-agent for each web crawling.