https://github.com/cuerz/douban-top

Golang爬虫 爬取豆瓣榜单
https://github.com/cuerz/douban-top

crawler douban golang goquery

Last synced: 7 months ago
JSON representation

Golang爬虫 爬取豆瓣榜单

• Host: GitHub
• URL: https://github.com/cuerz/douban-top
• Owner: Cuerz
• Created: 2022-09-04T03:44:37.000Z (about 3 years ago)
• Default Branch: main
• Last Pushed: 2022-09-04T03:50:28.000Z (about 3 years ago)
• Last Synced: 2025-04-17T14:40:00.660Z (8 months ago)
• Topics: crawler, douban, golang, goquery
• Language: Go
• Homepage:
• Size: 114 KB
• Stars: 4
• Watchers: 1
• Forks: 0
• Open Issues: 1
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

README

          
# 爬取豆瓣电影 Top250

尝试写的一个go爬虫

## 目标

我们的目标站点是 [豆瓣电影 Top250](https://movie.douban.com/top250)

![img.png](img.png)

简单的分析一下目标源

- 一页共25条

- 含分页（共10页）且分页规则是正常的

- 每一项的数据字段排序都是规则且不变

## 开始

### 安装

```

$ go get -u github.com/PuerkitoBio/goquery

```

### 运行

```

$ go run main.go

```

### 数据

![image](https://i.loli.net/2018/03/21/5ab1309594741.png)

![image](https://i.loli.net/2018/03/21/5ab131ca582f8.png)

![image](https://i.loli.net/2018/03/21/5ab130d3a00d9.png)