https://github.com/wanghongfei/gamepark-craw

Steam商店游戏爬虫, 爬取全量游戏打折信息/图片链接
https://github.com/wanghongfei/gamepark-craw

spider steam steam-games

Last synced: 4 days ago
JSON representation

Steam商店游戏爬虫, 爬取全量游戏打折信息/图片链接

• Host: GitHub
• URL: https://github.com/wanghongfei/gamepark-craw
• Owner: wanghongfei
• Created: 2020-04-16T01:25:03.000Z (over 4 years ago)
• Default Branch: master
• Last Pushed: 2021-10-13T03:21:22.000Z (about 3 years ago)
• Last Synced: 2024-06-21T18:44:48.644Z (5 months ago)
• Topics: spider, steam, steam-games
• Language: Go
• Homepage:
• Size: 39.1 KB
• Stars: 4
• Watchers: 1
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

README

        
# Steam/杉果商店爬虫

爬取Steam商店搜索页面上的全部游戏数据。使用方法：

```shell

Usage of ./gamepark-craw:

  -concurrency int

        page crawl concurrency (default 1)

  -output string

        output file path (default "steam.tsv")

  -start int

        start page (default 1)

  -target string

        target website, steam/shanguo (default "steam")

```

其中`start`表示从第一页开始爬取, `concurrency`表示最多同时爬取2个页面, `output`用来指定输出文件，`target`表示爬取的平台。

游戏数据以`tsv`格式存储，一行有6个token, 每个token用`\t`分割，格式：

```shell

游戏名\t现价\t原价\t打折幅度\t图片\t商店

```

Demo:

```

Atom Zombie Smasher	36	36	0	https://store.steampowered.com/app/55040/Atom_Zombie_Smasher/?snr=1_7_7_230_150_2500	https://media.st.dl.eccdnx.com/steam/apps/55040/header.jpg?t=1586734113

```