https://github.com/streanger/duplicate
files duplicate viewer
https://github.com/streanger/duplicate
duplicate-detection duplicates gui python tkinter-python
Last synced: 9 months ago
JSON representation
files duplicate viewer
- Host: GitHub
- URL: https://github.com/streanger/duplicate
- Owner: streanger
- Created: 2022-11-01T21:18:06.000Z (about 3 years ago)
- Default Branch: main
- Last Pushed: 2024-03-09T13:52:47.000Z (almost 2 years ago)
- Last Synced: 2024-03-09T14:55:45.705Z (almost 2 years ago)
- Topics: duplicate-detection, duplicates, gui, python, tkinter-python
- Language: Python
- Homepage:
- Size: 316 KB
- Stars: 0
- Watchers: 1
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
# duplicate
files duplicate viewer
## install
```
pip install git+https://github.com/streanger/duplicate.git
```
## usage
```bash
# from cli
duplicate # with no args will run gui
duplicate # will run cli search
duplicate . ".jpg, .png" # search in current directory, filter by .jpg, .png
# as module
python -m duplicate
```
```python
# gui
import duplicate
duplicate.gui()
# console search
from rich import print
from duplicate import search
directory = 'path/to/directory/with/duplicates'
results = search(directory)
print(results)
```
## screenshots
## changelog
- v. 0.1.5
- select file instead of opening directory
- reload extensions before search
- v. 0.1.4
- default block size equals system page size (usually 4kB)
- v. 0.1.3
- reading chunks of data using "with" statement. Only one file handle at the time is opened
- `keep searching...` while search lasts
- v. 0.1.2
- fix for `OSError` using `gc.collect()` due to locked file handles after many search
- `__slots__` in `FileHash` class
- version info in gui and cli
- v. 0.1.1
- initial filter and matching by files size
- files handle, which allows for reading files in chunks, what improves speed a lot
- entrypoint cli and gui support
- v. 0.1.0
- gui
- matching hashes of full file content
## develop & debug
```bash
# general setup & tests
python -m venv venv
venv/Scripts/Activate.ps1
python -m duplicate
python -m duplicate . ".py"
python -m duplicate --help
# max recursion depth half-auto tests
python .\scripts\create_files.py
python -m duplicate scripts
# duplicate.main
python -m duplicate.main
```
## ideas
- multithreaded file loading, to increase speed
- different hashing algorithm
- feature of breaking threads using `clear` button
- dynamically pack labels - show only visible ones
- faster search (+)
- faster window moving while many rows exists
- green progressbar for search
- sync between search and gui
- resizable filedialog (if possible)
- after method in tkinter if needed
- reset scrollbar for maximized windows should be fixed
- more information on the bottom info label
- better threads handling; maybe use of queue
- utils module for class staticmethods
- pylint & black todo
- screenshot(s) to upload (+)
- tests for maximum recursion depth