{"id":30407692,"url":"https://github.com/datumbrain/dedup","last_synced_at":"2025-08-21T20:44:16.703Z","repository":{"id":302429592,"uuid":"1011767476","full_name":"datumbrain/dedup","owner":"datumbrain","description":"Duplicate files removal suggestion maker.","archived":false,"fork":false,"pushed_at":"2025-07-01T10:31:43.000Z","size":6,"stargazers_count":1,"open_issues_count":0,"forks_count":1,"subscribers_count":0,"default_branch":"main","last_synced_at":"2025-07-02T11:05:22.647Z","etag":null,"topics":[],"latest_commit_sha":null,"homepage":null,"language":"Go","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/datumbrain.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null,"zenodo":null}},"created_at":"2025-07-01T10:04:44.000Z","updated_at":"2025-07-01T11:10:43.000Z","dependencies_parsed_at":"2025-07-02T11:05:24.437Z","dependency_job_id":"4a337642-bca5-4285-a4de-9d7e4f8803b6","html_url":"https://github.com/datumbrain/dedup","commit_stats":null,"previous_names":["datumbrain/dedup"],"tags_count":1,"template":false,"template_full_name":null,"purl":"pkg:github/datumbrain/dedup","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/datumbrain%2Fdedup","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/datumbrain%2Fdedup/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/datumbrain%2Fdedup/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/datumbrain%2Fdedup/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/datumbrain","download_url":"https://codeload.github.com/datumbrain/dedup/tar.gz/refs/heads/main","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/datumbrain%2Fdedup/sbom","scorecard":null,"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":271538667,"owners_count":24777479,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","status":"online","status_checked_at":"2025-08-21T02:00:08.990Z","response_time":74,"last_error":null,"robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":true,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":[],"created_at":"2025-08-21T20:44:13.973Z","updated_at":"2025-08-21T20:44:16.668Z","avatar_url":"https://github.com/datumbrain.png","language":"Go","funding_links":[],"categories":[],"sub_categories":[],"readme":"# Dedup - Intelligent Duplicate File Finder\n\nA smart Go utility that finds duplicate files by checksum and intelligently recommends which files to delete based on common naming patterns.\n\n## Installation\n\n```bash\ngo install github.com/datumbrain/dedup@latest\n```\n\n## Usage\n\n```bash\n# Scan current directory\ndedup\n\n# Scan specific directory\ndedup /path/to/folder\ndedup \"C:\\Users\\Username\\Downloads\"\n```\n\n## Features\n\n- **Smart Detection**: Uses SHA-256 checksums for accurate duplicate detection\n- **Intelligent Recommendations**: Automatically identifies which files to keep vs delete\n- **Platform-Specific Commands**: Generates deletion commands for your OS (Windows/macOS/Linux)\n- **Safe by Default**: Only scans files, never deletes anything automatically\n- **Non-Recursive**: Only scans the specified folder (doesn't go into subdirectories)\n\n## How It Works\n\nThe tool prioritizes files based on common naming patterns:\n\n### ✅ **KEEP** (Priority 0 - Original files)\n\n- `document.pdf`\n- `image.jpg`\n- `report.xlsx`\n\n### ❌ **DELETE** (Higher priority numbers)\n\n- `document (1).pdf` - Downloaded copies\n- `image-2.jpg` - Numbered variants\n- `report_copy.xlsx` - Copy indicators\n- `file_backup.txt` - Backup files\n- `document_final.pdf` - Version suffixes\n\n## Example Output\n\n```raw\n============================================================\nDUPLICATE FILES REPORT\n============================================================\n\nDuplicate Group #1 (Checksum: a665a45920422f9d...)\nFile Size: 1024 bytes\nFiles:\n  ✓ KEEP:   /Users/john/Downloads/invoice.pdf (Priority: 0)\n  ✗ DELETE: /Users/john/Downloads/invoice (1).pdf (Priority: 1001)\n\n============================================================\nDELETION RECOMMENDATIONS\n============================================================\n\nFiles recommended for deletion:\n1. /Users/john/Downloads/invoice (1).pdf\n\nSummary:\n- Total duplicate groups: 1\n- Files recommended for deletion: 1\n- Disk space that can be freed: 1.00 MB (1048576 bytes)\n\n============================================================\nDELETION COMMANDS FOR DARWIN\n============================================================\n\n# Terminal (recommended):\nrm \"/Users/john/Downloads/invoice (1).pdf\"\n\n# Move to Trash (safer option):\nosascript -e \"tell application \\\"Finder\\\" to delete POSIX file \\\"/Users/john/Downloads/invoice (1).pdf\\\"\"\n```\n\n## Safety Features\n\n- **Read-Only**: Never modifies or deletes files automatically\n- **Platform-Aware**: Provides appropriate commands for your operating system\n- **Trash Options**: Includes safer \"move to trash\" alternatives when available\n- **Validation**: Checks file existence before generating deletion commands\n- **Clear Warnings**: Reminds you to review recommendations before executing\n\n## Supported Platforms\n\n- **Windows**: Command Prompt, PowerShell, and Batch file commands\n- **macOS**: Terminal commands and Finder trash integration\n- **Linux**: Terminal commands with trash-cli support\n\n## Build from Source\n\n```bash\ngit clone https://github.com/datumbrain/dedup.git\ncd dedup\ngo build -o dedup\n```\n\n## License\n\nMIT License - Feel free to use, modify, and distribute.\n\n## Contributing\n\nIssues and pull requests welcome! Please ensure any changes maintain the safety-first approach of the tool.\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fdatumbrain%2Fdedup","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fdatumbrain%2Fdedup","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fdatumbrain%2Fdedup/lists"}