https://github.com/circa10a/href-scraper

ruby CLI to scrape hrefs from single webpages
https://github.com/circa10a/href-scraper

cli cli-app gem links scraping scraping-websites

Last synced: 9 months ago
JSON representation

ruby CLI to scrape hrefs from single webpages

• Host: GitHub
• URL: https://github.com/circa10a/href-scraper
• Owner: circa10a
• License: mit
• Archived: true
• Created: 2018-08-17T23:34:52.000Z (almost 8 years ago)
• Default Branch: main
• Last Pushed: 2020-12-12T15:07:49.000Z (over 5 years ago)
• Last Synced: 2025-01-17T06:21:23.378Z (over 1 year ago)
• Topics: cli, cli-app, gem, links, scraping, scraping-websites
• Language: Ruby
• Size: 19.5 KB
• Stars: 1
• Watchers: 1
• Forks: 1
• Open Issues: 0
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

README

          
# href-scraper

[![Gem Version](https://badge.fury.io/rb/href_scraper.svg)](https://badge.fury.io/rb/href_scraper)

![Gem](https://img.shields.io/gem/dt/href_scraper.svg)

A ruby gem to get all the hrefs from a single URL(export as json)

## Installation

Add this line to your application's Gemfile:

```ruby

gem 'href_scraper'

```

And then execute:

    $ bundle

Or install it yourself as:

    $ gem install href_scraper

## Usage

```bash

❯ href_scraper --url https://github.com

[

    "https://github.com/",

    "https://help.github.com/terms",

    "https://help.github.com/privacy",

    "https://enterprise.github.com/trial",

    "https://enterprise.github.com/contact",

    "https://help.github.com/terms",

    "https://help.github.com/privacy",

    "https://atom.io",

    "http://electron.atom.io/",

    "https://desktop.github.com/",

    "https://developer.github.com",

    "https://education.github.com/",

    "https://partner.github.com/",

    "https://community.github.com/",

    "https://github.com/about",

    "https://blog.github.com",

    "https://shop.github.com",

    "https://github.com/contact",

    "https://github.community",

    "https://help.github.com",

    "https://status.github.com/",

    "https://help.github.com/articles/github-security/",

    "https://services.github.com/"

]

```