{"id":16162369,"url":"https://github.com/jarelllama/blocklist-checker","last_synced_at":"2025-03-18T22:31:05.656Z","repository":{"id":235085303,"uuid":"790022749","full_name":"jarelllama/Blocklist-Checker","owner":"jarelllama","description":"Generate a simple static report for DNS blocklists or see previous reports of requested blocklists.","archived":false,"fork":false,"pushed_at":"2025-01-25T11:17:00.000Z","size":1781,"stargazers_count":14,"open_issues_count":0,"forks_count":1,"subscribers_count":1,"default_branch":"main","last_synced_at":"2025-03-10T15:54:48.740Z","etag":null,"topics":["blacklist","blacklists","blocklist","blocklist-data","blocklists","filterlist","filterlists"],"latest_commit_sha":null,"homepage":"","language":"Shell","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"gpl-3.0","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/jarelllama.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2024-04-22T05:58:48.000Z","updated_at":"2025-01-25T11:17:04.000Z","dependencies_parsed_at":"2024-10-27T19:17:11.230Z","dependency_job_id":"a73f60ea-46a1-4860-8dc4-9401d00d84c0","html_url":"https://github.com/jarelllama/Blocklist-Checker","commit_stats":null,"previous_names":["jarelllama/blocklist-checker"],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/jarelllama%2FBlocklist-Checker","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/jarelllama%2FBlocklist-Checker/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/jarelllama%2FBlocklist-Checker/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/jarelllama%2FBlocklist-Checker/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/jarelllama","download_url":"https://codeload.github.com/jarelllama/Blocklist-Checker/tar.gz/refs/heads/main","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":243950927,"owners_count":20373664,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["blacklist","blacklists","blocklist","blocklist-data","blocklists","filterlist","filterlists"],"created_at":"2024-10-10T02:29:53.883Z","updated_at":"2025-03-18T22:31:05.649Z","avatar_url":"https://github.com/jarelllama.png","language":"Shell","funding_links":[],"categories":[],"sub_categories":[],"readme":"# Jarelllama's Blocklist Checker\n\nGenerate a simple static report for DNS blocklists or see previous reports of requested blocklists.\n\n**View all blocklist reports [here](https://github.com/jarelllama/Blocklist-Checker/issues?q=is%3Aissue+label%3A%22report+generated%22).**\n\nFeel free to request new features!\n\nTo check if a specific domain is present in a blocklist try:\n\n* [dnswarden's search function](https://dnswarden.com/search.html)\n* [AdGuard's urlfilter API](https://urlfilter.adtidy.org/#checkDomainInfo)\n\n## How to\n\n1. Open a new issue: [Check a blocklist](https://github.com/jarelllama/Blocklist-Checker/issues/new/choose)\n2. Enter the URL to the raw file of the blocklist\u003cbr\u003e\n   **Supported formats: Domains, Adblock Plus, Hosts**\n3. Make yourself a coffee or tea while the report generates\u003cbr\u003e\n   (may take exponential longer for larger blocklists)\n4. The GitHub Actions bot will reply with the report\n\nSee what is included in the report below.\n\n## Report\n\n### Number of raw entries\n\nThe number of entries in the blocklist calculated after removing comments and the `[Adblock Plus]` header.\n\n### Number of compressed entries\n\nThe number of entries after compression via [AdGuard's Hostlist Compiler](https://github.com/AdguardTeam/HostlistCompiler).\n\nThe following [transformations](https://github.com/AdguardTeam/HostlistCompiler?tab=readme-ov-file#-transformations) are applied:\n\n* RemoveComments\n* Compress\n* RemoveModifiers\n\nThese transformations remove redundant rules and strip modifiers to format the blocklist to domains.\n\nThe percentage next to the count is the entries compressed from the total raw entries (a higher percentage means higher compression done).\n\nNote that the compressed blocklist is used for all further processing.\n\n### Percentage of dead domains\n\nAn estimate of the percentage of domains found unresolving by [AdGuard's Dead Domains Linter](https://github.com/AdguardTeam/DeadDomainsLinter).\n\nFor blocklists with more than 1000 compressed entries, only 50% of the domains are selected for the dead check and used to calculate the percentage. This selection is done at random and capped at 10,000 domains.\n\nThe selected domains provide a reasonable representation of the percentage of dead domains in the blocklist with a deviation of about ±2 while reducing processing time.\n\n### Invalid entries\n\nThe number of entries deemed invalid and removed by the Hostlist Compiler. Expanding the dropdown reveals the entries removed (limited to 1000 entries).\n\nThe following transformations are applied:\n\n* RemoveComments\n* Deduplicate\n* Compress\n* Validate\n* TrimLines\n* InsertFinalNewLine\n\nThese transformations remove non-domain entries like IP addresses and Unicode. Unicode in blocklists should be converted to Punycode for compatibility.\n\nThe percentage next to the count is the entries removed from the total compressed entries.\n\n### Percentage of usable compressed domains\n\nAn estimate of the percentage of potential domains that can be used in a DNS blocklist.\n\n`domains usable = compressed entries - dead domains - invalid entries`\n\n### Domains found in Tranco\n\nThe number of domains found in the [Tranco Top Sites Ranking](https://tranco-list.eu/). Expanding the dropdown reveals the domains found (limited to 1000 entries).\n\n### Unique domains not found in other blocklists\n\nThe number of domains that were not found in the specified blocklist in column two. See the list of blocklists configured for comparison here: [blocklists_to_compare.txt](https://raw.githubusercontent.com/jarelllama/Blocklist-Checker/main/data/blocklists_to_compare.txt)\n\nThe percentage shows what percent of domains are unique to the blocklist being checked.\n\n### Top 15 TLDs\n\nThe number of occurrences for the top 15 top-level domains (TLDs) in the compressed entries.\n\n### Processing time\n\nTime taken in seconds to download the blocklist and generate the report.\n\nNote that the time taken to download dependencies/restore cache is excluded from this calculation.\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fjarelllama%2Fblocklist-checker","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fjarelllama%2Fblocklist-checker","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fjarelllama%2Fblocklist-checker/lists"}