https://github.com/ging-dev/sitemap-crawler

Collect links through the sitemap.xml or robots.txt
https://github.com/ging-dev/sitemap-crawler

crawler php php8 sitemap sitemap-crawler

Last synced: 3 months ago
JSON representation

Collect links through the sitemap.xml or robots.txt

• Host: GitHub
• URL: https://github.com/ging-dev/sitemap-crawler
• Owner: ging-dev
• Created: 2024-09-13T16:37:07.000Z (5 months ago)
• Default Branch: main
• Last Pushed: 2024-09-16T09:01:07.000Z (5 months ago)
• Last Synced: 2024-11-16T16:38:59.486Z (3 months ago)
• Topics: crawler, php, php8, sitemap, sitemap-crawler
• Language: PHP
• Homepage: https://packagist.org/packages/gingdev/sitemap-crawler
• Size: 5.86 KB
• Stars: 2
• Watchers: 1
• Forks: 0
• Open Issues: 0
• Metadata Files:

Awesome Lists containing this project