Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/reineimi/va2crawl
Website crawler, validator and SEO optimizer
https://github.com/reineimi/va2crawl
crawler seo-optimization seotools validator website-crawler
Last synced: 5 days ago
JSON representation
Website crawler, validator and SEO optimizer
- Host: GitHub
- URL: https://github.com/reineimi/va2crawl
- Owner: reineimi
- Created: 2024-10-31T16:52:39.000Z (17 days ago)
- Default Branch: main
- Last Pushed: 2024-11-08T11:12:27.000Z (9 days ago)
- Last Synced: 2024-11-08T12:21:13.395Z (9 days ago)
- Topics: crawler, seo-optimization, seotools, validator, website-crawler
- Language: Shell
- Homepage:
- Size: 16.6 KB
- Stars: 0
- Watchers: 1
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
> [va2/lib/va2crawl.lua](https://github.com/reineimi/va2/blob/main/lib/va2crawl.lua)
# Va2: Crawl
Website crawler, validator and SEO optimizer.
# Installation & Usage
1. Download `install.sh`
```bash
curl -LO https://raw.githubusercontent.com/reineimi/va2crawl/refs/heads/main/install.sh
```
2. Put it in your preferred directory (for example, `~/Documents/lua/crawl`)
3. Run `sh install.sh` to download the script and requirements
4. Call the script from the directory using:
```
lua crawl.lua
```
You can also set alias in your `~/.bashrc`, for example:
```
alias crawl='cd ~/Documents/lua/crawl; clear; lua crawl.lua'
```
# Preview from 2024/11/07
