https://github.com/foolishway/imagespider

超轻量级多协程百度图片爬虫
https://github.com/foolishway/imagespider

baidu crawler go goroutine image spider

Last synced: 3 months ago
JSON representation

超轻量级多协程百度图片爬虫

• Host: GitHub
• URL: https://github.com/foolishway/imagespider
• Owner: foolishway
• Created: 2019-12-10T02:59:16.000Z (over 6 years ago)
• Default Branch: master
• Last Pushed: 2020-06-14T10:45:45.000Z (almost 6 years ago)
• Last Synced: 2024-05-31T03:51:10.913Z (almost 2 years ago)
• Topics: baidu, crawler, go, goroutine, image, spider
• Language: Go
• Homepage:
• Size: 4.65 MB
• Stars: 8
• Watchers: 2
• Forks: 7
• Open Issues: 0
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

README

          
### 网络爬虫

通过goroutine并发爬取百度图片

支持多关键字爬取（关键字用英文","号分割）

用法：

./main -kw=科比,乔丹,艾弗森

会在当前目录分别生成三个目录（科比、乔丹、艾弗森），存放对应关键字爬取到的图片