{"id":27204271,"url":"https://github.com/ehmeed/dead-link-finder","last_synced_at":"2025-04-09T22:57:58.198Z","repository":{"id":51308428,"uuid":"317029719","full_name":"Ehmeed/dead-link-finder","owner":"Ehmeed","description":"Find broken links on server-side rendered sites.","archived":false,"fork":false,"pushed_at":"2022-09-02T09:52:43.000Z","size":134,"stargazers_count":3,"open_issues_count":0,"forks_count":0,"subscribers_count":1,"default_branch":"master","last_synced_at":"2025-04-09T22:57:54.694Z","etag":null,"topics":["kotlin","test-automation","testing-tool","website-development"],"latest_commit_sha":null,"homepage":"","language":"Kotlin","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/Ehmeed.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null}},"created_at":"2020-11-29T19:45:04.000Z","updated_at":"2022-09-02T09:52:48.000Z","dependencies_parsed_at":"2022-08-27T19:22:01.983Z","dependency_job_id":null,"html_url":"https://github.com/Ehmeed/dead-link-finder","commit_stats":null,"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Ehmeed%2Fdead-link-finder","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Ehmeed%2Fdead-link-finder/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Ehmeed%2Fdead-link-finder/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Ehmeed%2Fdead-link-finder/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/Ehmeed","download_url":"https://codeload.github.com/Ehmeed/dead-link-finder/tar.gz/refs/heads/master","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":248125582,"owners_count":21051767,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["kotlin","test-automation","testing-tool","website-development"],"created_at":"2025-04-09T22:57:57.730Z","updated_at":"2025-04-09T22:57:58.182Z","avatar_url":"https://github.com/Ehmeed.png","language":"Kotlin","funding_links":[],"categories":[],"sub_categories":[],"readme":"# Dead link finder\n\nFind links that don't work on server-side rendered sites.\n\n## Usage\nThere are two packages:\n - `dlf` - native - smaller docker image (80 MB)\n - `dlfj`- running on JVM - much faster, larger docker image (300 MB)\n\nFor now, only dockerized versions are avaiable, but you can build binaries yourself, see guide at the bottom of the file.\n\nAll examples will use `dlfj` but in any of them you can replace it with `dlf`.\n```shell\n# basic usage - crawl all links recursively with no limit\n# and exit with success status if no broken links are found\ndlfj -v 'https://json.org/example.html'\n```\n```shell\n# using docker\ndocker run --rm docker.pkg.github.com/ehmeed/dead-link-finder/dlfj:latest \\\n  -v 'https://json.org/example.html'\n```\n```shell\n# without -v or --verbose, only broken links will be printed\ndlfj 'https://json.org/example.html'\n```\n```shell\n# on big sites it is a good idea to set maximum recursion level using -d or --depth\n# this will still run for a long time because there is too many links\ndlfj -v -d 2 'https://en.wikipedia.org/wiki/Hyperlink'\n```\n```shell\n# or ignore other domains\ndlfj -v -d 2 --cross-domain dont-recurse 'https://en.wikipedia.org/wiki/Hyperlink'\n```\n```shell\n# adding --show-text will try to display text shown on the html anchor element\ndlfj -v -d 2 --cross-domain dont-recurse --show-text 'https://en.wikipedia.org/wiki/Hyperlink'\n```\n```shell\n# to add request headers, use the -H parameter\ndlfj -v -H 'authorization:  Basic BbCdefgSishGmop=' \\\n -H 'User-Agent:Mozilla:4.0' 'https://en.wikipedia.org/wiki/Hyperlink'\n```\n```shell\n# for more options see\ndlfj --help\n```\n\n## Build\nCompile executables:\n```shell\n./gradlew build\n```\nNative located in `./build/bin/native/debugExecutable/dead-link-finder.kexe`\n\nJVM located in `./build/libs/dead-link-finder-jvm-{version}-SNAPSHOT.jar`\n\nTo builder docker images, use:\n```shell\n./scripts/install_docker.sh\n```\nTo build and install locally, use:\n```shell\n./scripts/install.sh --rebuild /my/directory/bin\n```\n## Testing\nTo run all tests:\n```shell\n./gradlew allTests\n./scripts/run_tests.sh\n```\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fehmeed%2Fdead-link-finder","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fehmeed%2Fdead-link-finder","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fehmeed%2Fdead-link-finder/lists"}