https://github.com/zauberware/url_checker

Quick lookup for HTTP Status codes of a Sitemap!
https://github.com/zauberware/url_checker

404-errors http-status-codes nokogiri ruby ruby-scraper ruby-script seo seo-analysis seo-monitor seotools sitemap sitemap-parser url-scraper

Last synced: about 2 months ago
JSON representation

Quick lookup for HTTP Status codes of a Sitemap!

• Host: GitHub
• URL: https://github.com/zauberware/url_checker
• Owner: zauberware
• License: mit
• Created: 2019-06-07T16:51:32.000Z (over 5 years ago)
• Default Branch: master
• Last Pushed: 2023-04-11T22:50:06.000Z (almost 2 years ago)
• Last Synced: 2024-02-23T14:35:19.431Z (11 months ago)
• Topics: 404-errors, http-status-codes, nokogiri, ruby, ruby-scraper, ruby-script, seo, seo-analysis, seo-monitor, seotools, sitemap, sitemap-parser, url-scraper
• Language: Ruby
• Homepage:
• Size: 5.86 KB
• Stars: 3
• Watchers: 2
• Forks: 0
• Open Issues: 1
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

README

        
# Quick lookup for HTTP Status codes

**Main goal: Lookup HTTP Status codes from a given sitemap.xml!**

This basic script scrapes all links from a sitemap URL and just prints out the given status. We use this script to detect 302 redirects and 404 status codes for websites.

## Installation

```

git clone [email protected]:zauberware/url_checker.git && cd url_checker

bundle install

```

## Usage

```

ruby url_checker.rb https://www.your-domain.com/sitemap.xml

```

Replace `https://www.your-domain.com/sitemap.xml` with your link.

## Does it work with subsets of sitemaps?

The answer is YES! (But only one level...)