https://github.com/fromsko/netspider
基于Go 1.19 的 站点模板爬虫
https://github.com/fromsko/netspider
Last synced: 11 months ago
JSON representation
基于Go 1.19 的 站点模板爬虫
- Host: GitHub
- URL: https://github.com/fromsko/netspider
- Owner: Fromsko
- License: gpl-3.0
- Created: 2023-02-02T14:47:22.000Z (over 3 years ago)
- Default Branch: main
- Last Pushed: 2023-11-29T16:20:50.000Z (over 2 years ago)
- Last Synced: 2025-07-02T01:36:15.171Z (12 months ago)
- Language: Go
- Size: 24.4 KB
- Stars: 0
- Watchers: 1
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
# NetSpider
基于Go 1.19 的 站点模板爬虫
## 拉取并构建 NetSpider
```shell
git clone https://github.com/Kongxiaoaaa/NetSpider.git
cd NetSpider
go mod init NetSpider
go mod tidy
go run main.go
```
## 更改设置
`main.go`
```go
func main() {
// 启动爬虫
downUrl := util.GetInput()
app.Fetch(downUrl, "./res") // Fetch(url, downloadDir)
}
```