Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/windyakin/kosen-website-crawler
Taking screenshots of NIT’s websites
https://github.com/windyakin/kosen-website-crawler
docker nodejs puppeteer
Last synced: 18 days ago
JSON representation
Taking screenshots of NIT’s websites
- Host: GitHub
- URL: https://github.com/windyakin/kosen-website-crawler
- Owner: windyakin
- License: mit
- Created: 2017-08-24T10:14:18.000Z (about 7 years ago)
- Default Branch: master
- Last Pushed: 2024-10-23T22:33:58.000Z (22 days ago)
- Last Synced: 2024-10-24T11:41:01.224Z (21 days ago)
- Topics: docker, nodejs, puppeteer
- Language: JavaScript
- Homepage:
- Size: 640 KB
- Stars: 4
- Watchers: 3
- Forks: 1
- Open Issues: 3
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
# Kosen Website Crawler
高専のウェブサイトをクロールしてスクリーンショットを保存します。
## Getting started
### Now available on Docker Hub! 🐳
* [windyakin/kosen-website-crawler](https://hub.docker.com/r/windyakin/kosen-website-crawler/)
#### Run
```shell
make
```
#### Build Docker image by yourself
```shell
make build
```
### Running on local machine
required node version >= 8
```shell
npm install
npm start
```
## Tips
### How to change crawling sites?
websites.json の内容を変更すると高専のサイト以外も取得することができます。
## Author
* windyakin [@MITLicense](https://twitter.com/MITLicense)
* raryosu [@raryosu](https://twitter.com/raryosu)