https://github.com/whoiskatrin/broken-urls-finder
Python script that runs in k8s on a cronjob to find all broken links after deployment. (example: 404, 500, 503 and etc.)
https://github.com/whoiskatrin/broken-urls-finder
broken-links cronjob dead-links error-reporting k8s python-script slack-alerts
Last synced: 19 days ago
JSON representation
Python script that runs in k8s on a cronjob to find all broken links after deployment. (example: 404, 500, 503 and etc.)
- Host: GitHub
- URL: https://github.com/whoiskatrin/broken-urls-finder
- Owner: whoiskatrin
- Created: 2020-04-28T13:14:19.000Z (almost 5 years ago)
- Default Branch: master
- Last Pushed: 2020-11-30T19:43:19.000Z (over 4 years ago)
- Last Synced: 2025-02-14T21:27:13.224Z (2 months ago)
- Topics: broken-links, cronjob, dead-links, error-reporting, k8s, python-script, slack-alerts
- Language: Python
- Homepage:
- Size: 6.84 KB
- Stars: 1
- Watchers: 3
- Forks: 1
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
# broken-urls-finder
Python script that runs in k8s on a cronjob to find all broken links after deployment. (example: 404, 500, 503 and etc.)
Results are being posted in the slack channel. (template is included)
Slack channel with alerts: TBD (up to you)
## Why use this tool?
This tools is ideal for checking the error list (404, 500, 503 and etc.) whenever these kind of errors arise for a website.
For SEO purposes, it is very bad to have lots of 404 erros exist in your site, and it also could irritate users.
These errors may arrise as a result of a desing change of a website, website migration, or a small change in an htaccess file.
When the script finishes, it shows you a summary of how many urls were broken and what environment was affected (DEV/PROD).
## Future plans
- In the future, refactor this script to make it multithreaded, so a large list of urls can get checked faster
- Link depth limit