{"id":15498855,"url":"https://github.com/damcraft/cf_percentage","last_synced_at":"2025-03-26T12:41:34.103Z","repository":{"id":224343309,"uuid":"763041393","full_name":"DAMcraft/cf_percentage","owner":"DAMcraft","description":"How many of the top 100k domains use cloudflare? (Spoiler: it's a lot more than you probably think) ","archived":false,"fork":false,"pushed_at":"2024-02-25T12:18:47.000Z","size":571,"stargazers_count":1,"open_issues_count":0,"forks_count":0,"subscribers_count":1,"default_branch":"main","last_synced_at":"2025-01-31T13:43:54.258Z","etag":null,"topics":[],"latest_commit_sha":null,"homepage":null,"language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"apache-2.0","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/DAMcraft.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null}},"created_at":"2024-02-25T12:04:14.000Z","updated_at":"2024-08-31T16:29:10.000Z","dependencies_parsed_at":"2024-02-25T13:25:46.877Z","dependency_job_id":"96123509-a24e-47ee-8c03-036eb202cafa","html_url":"https://github.com/DAMcraft/cf_percentage","commit_stats":null,"previous_names":["damcraft/cf_percentage"],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/DAMcraft%2Fcf_percentage","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/DAMcraft%2Fcf_percentage/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/DAMcraft%2Fcf_percentage/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/DAMcraft%2Fcf_percentage/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/DAMcraft","download_url":"https://codeload.github.com/DAMcraft/cf_percentage/tar.gz/refs/heads/main","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":245658981,"owners_count":20651519,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":[],"created_at":"2024-10-02T08:48:39.537Z","updated_at":"2025-03-26T12:41:34.084Z","avatar_url":"https://github.com/DAMcraft.png","language":"Python","funding_links":[],"categories":[],"sub_categories":[],"readme":"# How many of the top 100'000 websites use Cloudflare?\n\nThis program uses a dataset of the top 100'000 websites to determine how many of them use Cloudflare.  \nAttention: It is highly recommended to not run this program at home,\nas it will generate a lot of traffic and your Internet access might stop working for a while.\nIt is recommended to run this program on a server or a cloud instance.  \nThis program uses 100 threads to analyze the data.  \nThe dataset uses the top 100'000 requested domains on Cloudflare's DNS servers from `2024-01-22` until `2024-01-29`. \nUpdating this data is simply possible by replacing the `100k.csv` with newer data from Cloudflare Radar. \n\n## Requirements\n- Python 3.8 or higher\n- No additional packages\n\n## Usage\nJust run `python3 main.py`\n\n## Results\nAfter running the program on `2024-02-25` on my server, I got the following results:\n- Total Cloudflare domains: 48257\n- Total non-Cloudflare domains: 33842\n- Total unresolved domains: 17902\nSo 82'099 domains were able to be resolved, of which 48'257 used Cloudflare.  \nThis means that about **58,8%** of the top 100'000 domains use Cloudflare, **more than half**!\n\n## Data Attribution\n\nThe dataset used in this subproject, \"100k.csv\", was obtained from Cloudflare Radar and is licensed under a [Creative Commons Attribution 4.0 International License](https://creativecommons.org/licenses/by/4.0/).\n\n**Attribution:**\n- Original Data Source: [Cloudflare Radar](https://radar.cloudflare.com/charts/LargerTopDomainsTable/attachment?id=954\u0026top=100000\u0026startDate=2024-01-22\u0026endDate=2024-01-29)\n- Author: [Cloudflare](https://www.cloudflare.com/)\n\n\n## License\nCopyright 2024, DAMcraft\nThis project is licensed under the Apache License, Version 2.0. See [LICENSE](LICENSE) for the full license text.\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fdamcraft%2Fcf_percentage","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fdamcraft%2Fcf_percentage","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fdamcraft%2Fcf_percentage/lists"}