{"id":15567839,"url":"https://github.com/circa10a/web-link-tester","last_synced_at":"2025-10-12T21:30:53.626Z","repository":{"id":55804538,"uuid":"109506382","full_name":"circa10a/web-link-tester","owner":"circa10a","description":"Flask App to scrape hrefs from websites and validate links","archived":true,"fork":false,"pushed_at":"2021-05-22T01:34:34.000Z","size":217,"stargazers_count":13,"open_issues_count":0,"forks_count":4,"subscribers_count":1,"default_branch":"main","last_synced_at":"2024-10-09T17:45:14.629Z","etag":null,"topics":["beautifulsoup","docker-image","flask","flask-application","flask-restful","python3","uwsgi-nginx"],"latest_commit_sha":null,"homepage":"","language":"HTML","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/circa10a.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null}},"created_at":"2017-11-04T15:27:13.000Z","updated_at":"2024-09-30T18:35:51.000Z","dependencies_parsed_at":"2022-08-15T07:20:12.491Z","dependency_job_id":null,"html_url":"https://github.com/circa10a/web-link-tester","commit_stats":null,"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/circa10a%2Fweb-link-tester","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/circa10a%2Fweb-link-tester/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/circa10a%2Fweb-link-tester/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/circa10a%2Fweb-link-tester/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/circa10a","download_url":"https://codeload.github.com/circa10a/web-link-tester/tar.gz/refs/heads/main","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":236274592,"owners_count":19122692,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["beautifulsoup","docker-image","flask","flask-application","flask-restful","python3","uwsgi-nginx"],"created_at":"2024-10-02T17:13:35.558Z","updated_at":"2025-10-12T21:30:48.153Z","avatar_url":"https://github.com/circa10a.png","language":"HTML","funding_links":[],"categories":[],"sub_categories":[],"readme":"# web-link-tester\n\n![Docker Automated build](https://img.shields.io/docker/automated/jrottenberg/ffmpeg.svg)\n[![](https://images.microbadger.com/badges/image/circa10a/web-link-tester.svg)](https://microbadger.com/images/circa10a/web-link-tester \"Get your own image badge on microbadger.com\")\n[![](https://images.microbadger.com/badges/version/circa10a/web-link-tester.svg)](https://microbadger.com/images/circa10a/web-link-tester \"Get your own version badge on microbadger.com\")\n\nAsynchronous Flask App to scrape and validate links via GUI or REST API\n\n## Usage\nWhy use the web-link-tester?\n\n1) Test your production site via GUI or programmatically to ensure no bad page routes or forgotten references.\n2) It's free.\n\n## To deploy the Web App/API\n---\n\n### Docker\n\n```bash\ndocker run -d --name link-tester -p 8080:8080 circa10a/web-link-tester\n```\n\nAccess via http://localhost:8080\n\n### Python\n\n```bash\npython main.py\n```\n\nAccess via http://localhost:8080\n\n\u003e Set environment variable `PORT` locally to change listening port from `8080`\n\n### API Usage\n\n```bash\ncurl -X POST -H \"content-type: application/json\" --data '{\"url\": \"https://www.github.com\"}' http://localhost:8080/api\n```\n\n### Example JSON Output\n\n```bash\n$ curl -s -X POST -H \"content-type: application/json\" --data '{\"url\": \"https://caleblemoine.dev\"}' http://localhost:8080/api\n\n{\n  \"links\": [\n    {\n      \"code\": 999,\n      \"url\": \"https://www.linkedin.com/in/caleblemoine/\"\n    },\n    {\n      \"code\": 200,\n      \"url\": \"https://github.com/circa10a\"\n    },\n    {\n      \"code\": 200,\n      \"url\": \"https://github.com/circa10a/express-jwt\"\n    },\n    {\n      \"code\": 200,\n      \"url\": \"https://github.com/pyouroboros/ouroboros\"\n    },\n    {\n      \"code\": 200,\n      \"url\": \"https://github.com/circa10a/filter-object-array\"\n    },\n    {\n      \"code\": 200,\n      \"url\": \"https://github.com/circa10a/easy-soap-request\"\n    },\n    {\n      \"code\": 200,\n      \"url\": \"https://medium.com/better-programming/how-to-perform-soap-requests-with-node-js-4a9627070eb6\"\n    },\n    {\n      \"code\": 200,\n      \"url\": \"https://github.com/circa10a/web-link-tester\"\n    },\n    {\n      \"code\": 200,\n      \"url\": \"https://github.com/circa10a/Device-Monitor-Dashboard\"\n    },\n    {\n      \"code\": 200,\n      \"url\": \"https://caleblemoine.dev/monitor/\"\n    },\n    {\n      \"code\": 200,\n      \"url\": \"https://hub.docker.com/u/circa10a\"\n    },\n    {\n      \"code\": 200,\n      \"url\": \"https://caleblemoine.dev/gitfolio/\"\n    },\n    {\n      \"code\": 999,\n      \"url\": \"https://www.linkedin.com/in/caleblemoine/\"\n    },\n  ]\n}\n```\n\n### Stack\n- Utilizes gunicorn for multiple workers/threading.\n- Python 3\n- BeautifulSoup4\n- Jquery\n\n## Screenshots\n\n![alt text](https://i.imgur.com/cwC8HcK.png)\n![alt text](https://i.imgur.com/9l6OHDX.png)\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fcirca10a%2Fweb-link-tester","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fcirca10a%2Fweb-link-tester","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fcirca10a%2Fweb-link-tester/lists"}