https://github.com/davidesantangelo/scrappet-rest-api

rails app for web scraping purposes. It scrapes a given page (by the URL), and returns you all informations about that page.
https://github.com/davidesantangelo/scrappet-rest-api

api rails ruby scraper

Last synced: about 1 year ago
JSON representation

rails app for web scraping purposes. It scrapes a given page (by the URL), and returns you all informations about that page.

• Host: GitHub
• URL: https://github.com/davidesantangelo/scrappet-rest-api
• Owner: davidesantangelo
• License: gpl-2.0
• Created: 2015-04-03T14:37:43.000Z (about 11 years ago)
• Default Branch: master
• Last Pushed: 2015-06-09T13:30:20.000Z (almost 11 years ago)
• Last Synced: 2025-04-05T19:03:38.058Z (about 1 year ago)
• Topics: api, rails, ruby, scraper
• Language: Ruby
• Homepage: https://scrappet.herokuapp.com
• Size: 277 KB
• Stars: 6
• Watchers: 4
• Forks: 1
• Open Issues: 0
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

README

          
# scrappet-rest-api

rails app for web scraping purposes. It scrapes a given page (by the URL), and returns you all informations about that page. This API use my own gem https://github.com/davidesantangelo/webinspector

# see in action

You can use scrappet-rest-api live at this url: https://scrappet.herokuapp.com

# getting started

 git clone https://github.com/davidesantangelo/scrappet-rest-api.git


 cd scrappet-rest-api & bundle install


 rails s 

# try it

curl -X GET http://127.0.0.1:3000/api/scrape?url=http://www.github.com


return a json hash with title, description, keywords, links, images etc..