https://github.com/wahengchang/node-dcard-scraper
it is an example of implementing cheerio scraper of extracting images in dcard
https://github.com/wahengchang/node-dcard-scraper
cheerio crawler dcard example javascript nodejs npm scraper tutorial
Last synced: 6 months ago
JSON representation
it is an example of implementing cheerio scraper of extracting images in dcard
- Host: GitHub
- URL: https://github.com/wahengchang/node-dcard-scraper
- Owner: wahengchang
- Created: 2017-02-17T03:07:53.000Z (over 8 years ago)
- Default Branch: master
- Last Pushed: 2017-02-23T02:28:17.000Z (over 8 years ago)
- Last Synced: 2025-03-22T01:38:16.665Z (7 months ago)
- Topics: cheerio, crawler, dcard, example, javascript, nodejs, npm, scraper, tutorial
- Language: JavaScript
- Homepage: https://medium.com/@peterchang_82818/dcard-%E6%95%99%E5%AD%B8-%E7%88%AC%E8%9F%B2-%E7%B6%B2%E7%B5%A1-%E5%AF%A6%E4%BE%8B-%E5%9C%96%E7%89%87-node-nodejs-%E4%B8%8B%E8%BC%89-81495c10fc1b#.qjyya85he
- Size: 3.91 KB
- Stars: 18
- Watchers: 2
- Forks: 5
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
# node-dcard-scraper
這個一個網站圖片爬蟲的範例, 在Node.js 的環境下, 使用 Cheerio Library 查找網頁中的圖片. 獲得圖片的 URL 後, 為了確保每一張圖片能成功下載, 所以通過 Promise 的形式連續地一張接一張下載, 利用 Node 原生的 request Library 以 streaming 的下載放到 local.
## Install
```
$ git clone https://github.com/wahengchang/node-dcard-scraper
$ npm install
```
Run
```js
$ npm start
```