https://github.com/medialab/sandcrawler

sandcrawler.js - the server-side scraping companion.
https://github.com/medialab/sandcrawler

Last synced: 5 days ago
JSON representation

sandcrawler.js - the server-side scraping companion.

• Host: GitHub
• URL: https://github.com/medialab/sandcrawler
• Owner: medialab
• License: lgpl-3.0
• Created: 2014-07-04T15:11:31.000Z (over 10 years ago)
• Default Branch: master
• Last Pushed: 2016-01-14T16:55:41.000Z (almost 9 years ago)
• Last Synced: 2024-10-21T15:39:52.141Z (18 days ago)
• Language: JavaScript
• Homepage: http://medialab.github.io/sandcrawler/
• Size: 416 KB
• Stars: 107
• Watchers: 17
• Forks: 12
• Open Issues: 43
• Metadata Files:
  • Readme: README.md
  • License: LICENSE.txt

Awesome Lists containing this project

• awesome-starred - medialab/sandcrawler - sandcrawler.js - the server-side scraping companion. (others)

README

        


  

    

  



**sandcrawler.js** is a node library aiming at providing developers with concise but exhaustive tools to scrape the web.

**Disclaimer**: this library is an unreleased work in progress.

The library's full documentation is available on [github pages](https://medialab.github.io/sandcrawler).

## Contribution

[![Build Status](https://travis-ci.org/medialab/sandcrawler.svg)](https://travis-ci.org/medialab/sandcrawler)

Contributions are more than welcome. Feel free to submit any pull request as long as you added unit tests if relevant and passed them all.

To install the development environment, clone your fork and use the following commands:

```bash

# Install dependencies

npm install

# Testing

npm test

```

## Authors

**sandcrawler.js** is being developed by [Guillaume Plique](https://github.com/Yomguithereal) @ SciencesPo - [médialab](http://www.medialab.sciences-po.fr/fr/).

Logo by [Daniele Guido](https://github.com/danieleguido).