https://github.com/malteriesch/product-scraper

https://github.com/malteriesch/product-scraper

Last synced: about 1 month ago
JSON representation

• Host: GitHub
• URL: https://github.com/malteriesch/product-scraper
• Owner: malteriesch
• Created: 2015-06-22T00:34:20.000Z (over 9 years ago)
• Default Branch: master
• Last Pushed: 2015-06-22T00:35:42.000Z (over 9 years ago)
• Last Synced: 2024-10-13T08:43:46.787Z (3 months ago)
• Language: HTML
• Size: 125 KB
• Stars: 0
• Watchers: 1
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

README

        
Scraper

============

A simple Console Application to scrape data from a listing on a web page

Installation

-------------------

* note that this is tested on Linux only.

* make sure that you have composer installed.

* in root of project, run composer install

Running the application

-----------------------------

from root folder, run

`php app/scrape.php scrape:url  "http://www.sainsburys.co.uk/shop/gb/groceries/fruit-veg/new-in-season#langId=44&storeId=10151&catalogId=10122&categoryId=12524&parent_category_rn=12518&top_category=12518&pageSize=30&orderBy=FAVOURITES_FIRST&searchTerm=&beginIndex=0" > out.json`

Note that this application is designed for Linux as it supports pipes

Tests

--------------

To run tests, go to the tests folder and run `phpunit`