Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/sureshsundriyal/dff
A simple duplicate file finder
https://github.com/sureshsundriyal/dff
Last synced: 19 days ago
JSON representation
A simple duplicate file finder
- Host: GitHub
- URL: https://github.com/sureshsundriyal/dff
- Owner: sureshsundriyal
- License: bsd-2-clause
- Created: 2017-10-04T09:59:51.000Z (over 7 years ago)
- Default Branch: master
- Last Pushed: 2025-01-08T00:47:37.000Z (about 1 month ago)
- Last Synced: 2025-01-08T01:30:08.400Z (about 1 month ago)
- Language: Rust
- Size: 33.2 KB
- Stars: 0
- Watchers: 1
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: Readme.org
- License: LICENSE
Awesome Lists containing this project
README
#+TITLE: dff -- duplicate file finder
[[https://travis-ci.org/sureshsundriyal/dff.svg?branch=master]]
=dff= is a tool for locating duplicate files in a directory. The tool is
modelled after [[http://duff.dreda.org/][Duff]] without any advanced options.
* Building
#+BEGIN_EXAMPLE
cargo build --release
#+END_EXAMPLE
* Installing
#+BEGIN_EXAMPLE
cargo install
#+END_EXAMPLE
* Usage
In any mode of operation:
+ Symlinks are ignored
+ Zero-size files are ignored
+ The specified directories are searched recursively
+ Hard links are not reported as duplicates
** Normal Mode
#+BEGIN_EXAMPLE
dff [dir2 [dir3...]]
#+END_EXAMPLE
In normal mode of operation; =dff= searches through the specified directories
searching for duplicates using the following algorithm:
+ Only compare files if they are of equal sizes.
+ Compare the hashes of the beginning 1024 bytes to check whether
they are equal.
The two checks above quickly pin-point files which might be same.
** Thorough Mode
#+BEGIN_EXAMPLE
dff -t [dir2 [dir3...]]
#+END_EXAMPLE
In =thorough= mode, instead of comparing the hash of first 1024 bytes; hash of
the complete file contents are compared. This greatly reduces the probability
of false positives.
** Exhaustive Mode
#+BEGIN_EXAMPLE
dff -e [dir2 [dir3...]]
#+END_EXAMPLE
In =exhaustive= mode, the complete file contents are compared and should not
have any false positives.
** JSON output
#+BEGIN_EXAMPLE
dff -j [-t|-e] [dir2 [dir3...]]
#+END_EXAMPLE
In order to produce JSON output, use the =-j= flag. This is useful for
programatically parsing the data.