https://github.com/blahah/dreamcatcher

use nightmare.js to automate tricky download / scraping scenarios
https://github.com/blahah/dreamcatcher

Last synced: 4 months ago
JSON representation

use nightmare.js to automate tricky download / scraping scenarios

• Host: GitHub
• URL: https://github.com/blahah/dreamcatcher
• Owner: blahah
• Created: 2016-05-19T11:17:07.000Z (about 9 years ago)
• Default Branch: master
• Last Pushed: 2016-07-05T12:11:43.000Z (almost 9 years ago)
• Last Synced: 2024-12-27T19:13:31.706Z (5 months ago)
• Language: JavaScript
• Size: 2.93 KB
• Stars: 1
• Watchers: 3
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

README

        
## dreamcatcher

Use nightmare.js to automate tricky download / scraping scenarios.

Currently just a collection of rough demo scripts.

### install

```

git clone https://github.com/blahah/dreamcatcher.git

cd dreamcatcher

npm install

```

### usage

Download from a site that tries to prevent automated downloads with lazy-loading javascript

```

./withclick.js URL button-selector

```

Download content that requires a login

```

./withlogin.js URL user pass

```