https://github.com/9001/smf

size-match folders
https://github.com/9001/smf

file-deduplication

Last synced: about 2 months ago
JSON representation

size-match folders

• Host: GitHub
• URL: https://github.com/9001/smf
• Owner: 9001
• License: mit
• Created: 2019-09-25T23:35:19.000Z (over 5 years ago)
• Default Branch: master
• Last Pushed: 2022-09-04T13:41:17.000Z (over 2 years ago)
• Last Synced: 2025-01-09T17:16:10.550Z (4 months ago)
• Topics: file-deduplication
• Language: Python
• Homepage:
• Size: 101 KB
• Stars: 2
• Watchers: 3
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

README

        
# size-match folders

*aka `shotgun meets folder` aka `shit, my files` aka `simplema`--wait no not that*

![screenshot](ohno.png)

this compares folders based on the size of the files inside

* works on any filetype (buut does multimedia best)

* doesn't care about filenames

* and it never opens a single file

it sounds too naive to work but it actually does, really well even, so don't knock it until you lose all your files with it! and since it now DOES have a delete feature that's no longer a joke

## usage

run the script, preferably with pypy which does the initial scan 2.3x faster, then

* use A/D to navigate through the folders it thinks are dupes

* use W/S to scroll up/down in large folders

* press Q to toggle tree-view

* press H to hash the file contents for exact comparison

* press E to open an actual file explorer at those two folders

* press U to toss and rebuild the cache

* press V to invert the colors (can make it easier to spot non-dupes)

* press K to delete the dupes in the current folder (it'll ask which side)

* press M to transfer the last-modified timestamps to the other side

* press N to transfer the filenames likewise

there are colors,

* duplicate files are hilighted in white

* folders are blue

* symlinks are yellow

* anything else red

## details

the following filters are applied to remove most false positives:

* more than two files in each folder

* total of 1MB+ in each folder

* 20%+ of the files must have identical size across folders

* folders must be within 30% total size difference

* the files with matching sizes must must amount to 20%+ of the folder

it deals moderately well with moonrunes, using absolute cursor positioning to avoid having to consider glyph widths (nice)

also you might think that this is windows compatible due to all the msvcrt/mbcs/`hhhhHhhhhh` stuff, and that is absolutely correct:

* use python3 (unless you only have ascii filenames)

  * but amusingly pypy3 is having trouble with unicode filenames **on windows** so use pypy2 instead

* use the regular new win10 terminal, powershell is a meme

* optionally change font to `MS Gothic` to further enable moonrunes

* the ranger hotkey was substituted with two explorer windows, please change this if you have a better idea

![screenshot](win10do.png)