https://github.com/vallieres/crawl-n-indexnow
Crawl a Shopify website to extract all URLs and submit them to IndexNow
https://github.com/vallieres/crawl-n-indexnow
bing indexnow shopify yandex
Last synced: 2 months ago
JSON representation
Crawl a Shopify website to extract all URLs and submit them to IndexNow
- Host: GitHub
- URL: https://github.com/vallieres/crawl-n-indexnow
- Owner: vallieres
- Created: 2023-10-15T21:13:52.000Z (over 1 year ago)
- Default Branch: main
- Last Pushed: 2024-04-19T12:47:02.000Z (about 1 year ago)
- Last Synced: 2025-02-01T14:26:02.483Z (4 months ago)
- Topics: bing, indexnow, shopify, yandex
- Language: Go
- Homepage: https://legacygoods.co
- Size: 6.72 MB
- Stars: 0
- Watchers: 1
- Forks: 0
- Open Issues: 2
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
Crawl n' IndexNow!
Get the goods and ship 'em to the indexes!
Crawl n' IndexNow is a simple CLI that pulls your Shopify or regular website sitemap,
and submits the URLs to IndexNow to speed up the indexing process.
## ⚡️ Quickstart
Install the CLI:
```bash
go install github.com/vallieres/crawl-n-indexnow@latest
```
## 🎯 Commands
### Submit All Shopify URLs to Index
```bash
crawl-n-indexnow shopify --domain legacygoods.co --key a1b3c34d
```
This will crawl the [Legacy Goods Co.](https://legacygoods.co) domain, list the found URLs from its sitemaps and submit
them all to IndexNow.
### Submit All Sitemap URLs to Index
```bash
crawl-n-indexnow sitemap --domain hipsterpixel.co --key a1b3c34d
```
This will crawl the [Hipster Pixel](https://hipsterpixel.co) domain, list the found URLs from its sitemap and submit
them all to IndexNow.