https://github.com/codesalley/web-scraper-ruby
CLI Web Scraper allows you to scrap data from different types of selectors. This system makes it possible to tailor data extraction to different site structures.
https://github.com/codesalley/web-scraper-ruby
rails ruby ruby-on-rails salley
Last synced: 2 months ago
JSON representation
CLI Web Scraper allows you to scrap data from different types of selectors. This system makes it possible to tailor data extraction to different site structures.
- Host: GitHub
- URL: https://github.com/codesalley/web-scraper-ruby
- Owner: codesalley
- License: mit
- Created: 2021-02-18T11:21:58.000Z (over 5 years ago)
- Default Branch: main
- Last Pushed: 2021-04-29T06:58:15.000Z (about 5 years ago)
- Last Synced: 2025-04-07T03:25:36.788Z (over 1 year ago)
- Topics: rails, ruby, ruby-on-rails, salley
- Language: Ruby
- Homepage:
- Size: 9.63 MB
- Stars: 0
- Watchers: 1
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
# web-scraper-ruby
CLI web scraper, fetch pdf and course details from ``https://www.computer-pdf.com/`` and ``https://www.classcentral.com/``
## Screenshot
## Built With
- Ruby
## Getting Started
First, ensure that you have ruby installed on your local machine. and follow steps to run the program
## Prerequisites
Ruby installed on your local machine. Terminal or similar to execute the program.
### Gem libraries used
- nokogiri
- tty-prompt
- HTTParty
- open-uri
- ruby_figlet
- byebug
To install those libraries, simply run ```gem install [gem-name]```
## Install
- clone project by running ``git clone https://github.com/juxsalley/web-scraper-ruby.git``
- ``cd web-scraper-ruby``
- install required gems ```bundle install```
## Usage
- cd into the project by ``cd web-scraper-ruby``
- ``cd bin``
- Execute in terminal like so ```ruby scraper```
## To Test
- After cloning the project run ``bundle install`` to install all required gems as instructed above
- Then ``bundle exec rspec `` to run the test
## Author
👤 Iddrisu salley
- GitHub: [iddrisu salley](https://github.com/juxsalley)
- Twitter: [__salley](https://twitter.com/__salley)
## 🤝 Contributing
Contributions, issues, and feature requests are welcome!
Feel free to check the [issues page](https://github.com/juxsalley/web-scraper-ruby/pull/1).
## Show your support
Give a ⭐️ if you like this project!
## 📝 License
This project is [MIT](LICENSE) licensed.