{"id":21196169,"url":"https://github.com/noclin/duplicate-scanner","last_synced_at":"2025-06-29T15:32:52.935Z","repository":{"id":119141888,"uuid":"242640199","full_name":"NoCLin/duplicate-scanner","owner":"NoCLin","description":"Ultra Fast Duplicate File Scanner Based on Everything (Windows and NTFS only)","archived":false,"fork":false,"pushed_at":"2020-03-03T14:12:43.000Z","size":106,"stargazers_count":5,"open_issues_count":0,"forks_count":2,"subscribers_count":2,"default_branch":"master","last_synced_at":"2025-04-05T10:51:10.275Z","etag":null,"topics":["cleaner","duplicate","duplicate-file-scanner","duplicate-files","everything"],"latest_commit_sha":null,"homepage":null,"language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/NoCLin.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2020-02-24T03:42:39.000Z","updated_at":"2024-11-03T07:22:59.000Z","dependencies_parsed_at":"2023-07-09T23:45:38.034Z","dependency_job_id":null,"html_url":"https://github.com/NoCLin/duplicate-scanner","commit_stats":null,"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"purl":"pkg:github/NoCLin/duplicate-scanner","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/NoCLin%2Fduplicate-scanner","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/NoCLin%2Fduplicate-scanner/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/NoCLin%2Fduplicate-scanner/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/NoCLin%2Fduplicate-scanner/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/NoCLin","download_url":"https://codeload.github.com/NoCLin/duplicate-scanner/tar.gz/refs/heads/master","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/NoCLin%2Fduplicate-scanner/sbom","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":262618409,"owners_count":23337987,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["cleaner","duplicate","duplicate-file-scanner","duplicate-files","everything"],"created_at":"2024-11-20T19:34:27.942Z","updated_at":"2025-06-29T15:32:52.929Z","avatar_url":"https://github.com/NoCLin.png","language":"Python","funding_links":[],"categories":[],"sub_categories":[],"readme":"# Duplicate File Scanner Based on Everything\n\n- Ultra Fast (Based on Everything (NTFS USN, indexes)\n- UI Based on Everything *.efu files.\n\n## Usage\n\n1. start everything\n2. `python duplicates.py \u003cfolder\u003e [\u003cfolder\u003e...]`\n3. manage files in everything window\n\n## strategy\n\n1. group by size OR size+filename (TODO)\n2. timestamp (TODO)\n3. group by hash of first chunk\n3. group by full hash\n\n## Thanks\n\n- [Everything](https://www.voidtools.com)\n- [Everything CLI](https://www.voidtools.com/zh-cn/support/everything/command_line_interface/)\n- \u003chttps://stackoverflow.com/a/36113168/300783\u003e\n- \u003chttps://gist.github.com/tfeldmann/fc875e6630d11f2256e746f67a09c1ae\u003e\n- human_bytes_converter.py By Giampaolo Rodola","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fnoclin%2Fduplicate-scanner","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fnoclin%2Fduplicate-scanner","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fnoclin%2Fduplicate-scanner/lists"}