https://github.com/andremiras/lbcscraper

Scraper for Leboncoin.fr
https://github.com/andremiras/lbcscraper

Last synced: about 2 months ago
JSON representation

Scraper for Leboncoin.fr

• Host: GitHub
• URL: https://github.com/andremiras/lbcscraper
• Owner: AndreMiras
• License: mit
• Created: 2015-03-19T20:07:35.000Z (almost 10 years ago)
• Default Branch: master
• Last Pushed: 2024-05-14T22:15:40.000Z (7 months ago)
• Last Synced: 2024-10-27T07:31:57.082Z (about 2 months ago)
• Language: Python
• Size: 18.6 KB
• Stars: 4
• Watchers: 2
• Forks: 2
• Open Issues: 3
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

README

        
# lbcscraper

Scraper for Leboncoin.fr

## How to use

### Generic spider & items

Run the generic spider from command line e.g. for dumping items to a json file:

```shell

$ scrapy crawl leboncoin -a start_urls="http://www.leboncoin.fr/vetements/offres/languedoc_roussillon/herault/" -o items.json

  ```

Then load your items from Python:

```python

>>> import json

>>> items = json.load(open('items.json'))

>>> len(items)

726

>>> items[0]

{u'city': u'Saint-G\xe9ly-du-Fesc',

 u'link': u'http://www.leboncoin.fr/vetements/783985675.htm?ca=13_s',

 u'photo': u'http://img7.leboncoin.fr/thumbs/bf7/bf7ddfd4ad343271f95f4793add35ec5b417e354.jpg',

 u'postcode': u'34980',

 u'price': 12.0,

 u'title': u'Robe 2 en 1 taille 5 ans'}

```

### Property spider

Run the property spider:

```shell

$ scrapy crawl leboncoin_property -a start_urls="http://www.leboncoin.fr/ventes_immobilieres/offres/languedoc_roussillon/herault/" -o properties.json

```

Then from load json objects from Python:

```python

>>> import json

>>> properties = json.load(open('properties.json'))

>>> len(properties)

702

>>> properties[0]

{u'city': u'Montpellier',

 u'link': u'http://www.leboncoin.fr/ventes_immobilieres/756064558.htm?ca=13_s',

 u'photo': u'http://img3.leboncoin.fr/thumbs/a65/a65b909ca0512502149f810bbdfe1152a4e21e0c.jpg',

 u'postcode': u'34000',

 u'price': 140000.0,

 u'surface_area': 65.0,

 u'title': u'Appartement F4 65m2 proche FAC Pharmacie'}

 ```

## Installing

```shell

$ pip install -e git://github.com/AndreMiras/lbcscraper.git#egg=lbcscraper

```