https://github.com/bitliner/scrapy-chan

Scraping made easy.
https://github.com/bitliner/scrapy-chan

crawling data-analytics nodejs npm scraping

Last synced: about 20 hours ago
JSON representation

Scraping made easy.

• Host: GitHub
• URL: https://github.com/bitliner/scrapy-chan
• Owner: bitliner
• License: apache-2.0
• Created: 2017-04-08T17:55:02.000Z (almost 8 years ago)
• Default Branch: master
• Last Pushed: 2017-04-18T07:15:41.000Z (almost 8 years ago)
• Last Synced: 2025-01-15T14:43:33.447Z (9 days ago)
• Topics: crawling, data-analytics, nodejs, npm, scraping
• Language: JavaScript
• Homepage:
• Size: 46.9 KB
• Stars: 1
• Watchers: 2
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

README

        
# scrapy-chan

Scraping made easy.

`scrapy-chan` offers multiple modular utilities for scraping. 

They can be combined together to easily build and execute effective scraping.

# Installation

`npm i --save scrapy-chan`

# Usage

```

let SC = require('scrapy-chan');

SC.Url('news.ycombinator.com')

  .pipe( SC.ScrapeSinglePageWithoutAjax() )

  .pipe( SC.Parse() )

  .pipe( SC.Print() )

  .on('end', ()=>{

    // end  

  })

  .on('error', (err)=>{

    // err

  });

```

# Utilities

TBD