Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

Awesome Lists | Featured Topics | Projects

https://github.com/laguna1/web-scraper

Web scraper for scraping data from the web pages of the city portal with saving information in the csv-format file.
https://github.com/laguna1/web-scraper

Last synced: 27 days ago
JSON representation

Web scraper for scraping data from the web pages of the city portal with saving information in the csv-format file.

Host: GitHub
URL: https://github.com/laguna1/web-scraper
Owner: Laguna1
License: mit
Created: 2020-06-18T14:58:29.000Z (over 4 years ago)
Default Branch: master
Last Pushed: 2023-03-09T17:16:42.000Z (over 1 year ago)
Last Synced: 2024-10-07T22:38:03.800Z (about 1 month ago)
Language: Ruby
Homepage:
Size: 131 KB
Stars: 3
Watchers: 2
Forks: 0
Open Issues: 2
Metadata Files:
- Readme: README.md
- License: LICENSE

Awesome Lists containing this project

README

        # Web Scraper in Ruby

## Web Scraper (Ruby Capstone Project)

I created this project as a requirement to complete the Ruby section in the main Microverse technical program.

To check the scraper, web site [Mykharkov.info](https://mykharkov.info/catalog/dostoprimechatelnosti)  was used to collect data on the sights of the city, for each 

scraped the name, address, short description.

## In this project

- [ ] The following gems were used: Noko

- [ ] The Pry debugger was used to check the values of scraped-off data from the page.

- [ ] Scraper results saved in a csv format file

- [ ] Set up the code linter in the repository

- [ ] Github flow used

- [ ] Used RSpec to create test cases for methods of class public

- [ ] Implemented the basic principles of OOP

- [ ] Had an organized project structure

- [ ] Common Ruby Patterns Used

![CSV.file](./code_example.png)

##  Built With

- Ruby 

- Rubygems 

- Nokogiri

- Open-Uri 

- Pry

- Rspec 

- VSCode 

## Getting Started 

Clone this repository.

In the terminal of your OS, find the storage address and run the batch installation

It  necessary to install the gems to run the program:

- nokogiri

- pry

- csv

- RSpec

## 💻 Use

To run the program, run 'ruby bin/main.rb'.

Follow the instructions.

![CSV.file](./result_csv.png)

## 📝 Run tests

Used RSpec as a testing tool.

In the root folder, run the 'rspec' or 'rspec --format documentation' to run the tests.

![Tests](./testscreen.png)

👤 **Oksana Petrova**

- GitHub:[@github/Laguna1](https://github.com/Laguna1)

- Linkedin:[linkedin/OksanaPetrova](https://www.linkedin.com/in/oksana-petrova-005bb0145/)

## 🤝 Contributing

Contributions, issues, and feature requests are welcome!

Feel free to check the [issues page]().

## Show your support

Give a ⭐️ if you like this project!

## 📝 License

This project is [MIT](lic.url) licensed.