https://github.com/ykon550/puppenomist

Puppenomist = Scraper for the Economist with Puppeteer
https://github.com/ykon550/puppenomist

economist puppeteer puppeteer-demo webscraping

Last synced: 2 days ago
JSON representation

Puppenomist = Scraper for the Economist with Puppeteer

• Host: GitHub
• URL: https://github.com/ykon550/puppenomist
• Owner: ykon550
• License: mit
• Created: 2018-08-09T06:20:04.000Z (over 6 years ago)
• Default Branch: master
• Last Pushed: 2018-08-21T05:43:54.000Z (over 6 years ago)
• Last Synced: 2025-01-20T07:40:57.236Z (11 days ago)
• Topics: economist, puppeteer, puppeteer-demo, webscraping
• Language: JavaScript
• Size: 53.7 KB
• Stars: 1
• Watchers: 0
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

README

        
# Puppenomist = Tha Scraper for The Ecnomist with Puppeteer.

## How to Use

1. Install 

```

$ npm install puppenomist

```

2. Move to the Installed directory and Run the command

```

$ cd ./node_modules/puppenomist

$ node index.js -v

```

-v option is for NON Headless mode, it might be useful for first trial.

## Example

```

$ node index.js -v

prompt: Email:  [email protected]

prompt: Password:  ********

trying to login...

succeeded to login!

trying to extract issue links...

Issue links extracted!

started https://www.economist.com/printedition/2018-08-11

-->1/77: 2018_08_11_politics-this-week.json saved!

-->2/77: 2018_08_11_business-this-week.json saved!

-->3/77: 2018_08_11_kals-cartoon.json saved!

-->4/77: 2018_08_09_overhaul-tax-for-the-21st-century.json saved!

-->5/77: 2018_08_11_many-american-states-are-making-voting-harder.json saved!

-->6/77: 2018_08_11_the-danger-posed-by-jair-bolsonaro.json saved!

...

```

## Notes

It requires subscription account for The Ecnomist.