https://github.com/windyakin/kosen-website-crawler

Taking screenshots of NIT’s websites
https://github.com/windyakin/kosen-website-crawler

docker nodejs puppeteer

Last synced: 2 months ago
JSON representation

Taking screenshots of NIT’s websites

• Host: GitHub
• URL: https://github.com/windyakin/kosen-website-crawler
• Owner: windyakin
• License: mit
• Created: 2017-08-24T10:14:18.000Z (over 7 years ago)
• Default Branch: master
• Last Pushed: 2024-10-23T22:33:58.000Z (2 months ago)
• Last Synced: 2024-10-24T11:41:01.224Z (2 months ago)
• Topics: docker, nodejs, puppeteer
• Language: JavaScript
• Homepage:
• Size: 640 KB
• Stars: 4
• Watchers: 3
• Forks: 1
• Open Issues: 3
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

README

        
# Kosen Website Crawler

高専のウェブサイトをクロールしてスクリーンショットを保存します。

## Getting started

### Now available on Docker Hub! 🐳

* [windyakin/kosen-website-crawler](https://hub.docker.com/r/windyakin/kosen-website-crawler/) 

#### Run

```shell

make

```

#### Build Docker image by yourself

```shell

make build

```

### Running on local machine

required node version >= 8

```shell

npm install

npm start

```

## Tips

### How to change crawling sites?

websites.json の内容を変更すると高専のサイト以外も取得することができます。

## Author

* windyakin [@MITLicense](https://twitter.com/MITLicense)

* raryosu [@raryosu](https://twitter.com/raryosu)