https://github.com/george-swift/scraper

Web scraper designed to fetch retail prices from an online luxury store.
https://github.com/george-swift/scraper

nokogiri procs rspec ruby scraper

Last synced: 28 days ago
JSON representation

Web scraper designed to fetch retail prices from an online luxury store.

• Host: GitHub
• URL: https://github.com/george-swift/scraper
• Owner: george-swift
• Created: 2021-02-25T21:07:18.000Z (almost 4 years ago)
• Default Branch: development
• Last Pushed: 2021-02-27T13:10:53.000Z (almost 4 years ago)
• Last Synced: 2024-10-18T16:21:33.011Z (4 months ago)
• Topics: nokogiri, procs, rspec, ruby, scraper
• Language: Ruby
• Homepage:
• Size: 717 KB
• Stars: 7
• Watchers: 1
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

README

        
![](https://img.shields.io/badge/Microverse-blueviolet)

# Ruby Capstone Project: Build a Scraper

> The scraper is developed in Ruby and uses the Nokogiri gem to collect men's designer sneakers, details, and/or season information, and prices from my favorite online retail platform - [Farfetch](https://www.farfetch.com/ng/shopping/men/trainers-2/items.aspx)

![screenshot](./screenshots/search.png)

## Built With

- Ruby

## Getting Started 

- Open your terminal - Windows: `Win + R`, then type `cmd` | Mac: `Command + space`, then type `Terminal`

- Navigate to a directory of your choosing using the `cd` command

- Run this command in your OS terminal: `git clone https://github.com/george-swift/scraper.git` to get a copy of the project.

- Navigate to the project's directory using the `cd` command.

- Execute `./bin/search.rb` or `cd bin` from the project's root folder and `ruby search.rb`

### Prerequisites

* Internet connection

* Ruby installed in your OS

* The Nokogiri ruby gem installed in your OS. To install, simply type `gem install nokogiri` in the terminal or `bundle install` from the project directory.

* The HTTParty ruby library installed in your OS. To install this gem type `bundle install` in the terminal from the project directory.

## Testing

- Open the terminal on the project root folder

- Execute `rspec --format doc` to run all the test cases  OR

- Run `bundle install` to install the required gems

- Execute `bundle exec rspec` to run all the test cases

![screenshot](./screenshots/tests.png)

👤 **Author**

- GitHub: [@george-swift](https://github.com/george-swift)

- Twitter: [@\_\_pragmaticdev](https://twitter.com/__pragmaticdev)

## 🤝 Contributing

Contributions, issues, and feature requests are welcome!

## Show your support

Kindly give a ⭐️ if you like this project!

## Acknowledgments

Hat tip to the following:

  - Farfetch for catalog of products

  - Nokogiri documentation for guidelines on installation

  - `Rubygems.org` documentation for guidelines on gems installation

  - Medium for additional think pieces

## 📝 License

This project is [MIT](https://www.mit.edu/~amini/LICENSE.md) licensed.