An open API service indexing awesome lists of open source software.

https://github.com/norm/duplicates

Yet another duplicated file finder
https://github.com/norm/duplicates

Last synced: over 1 year ago
JSON representation

Yet another duplicated file finder

Awesome Lists containing this project

README

          

duplicates
==========

Yet another duplicated file finder. You probably don't want to use it, as
it requires redis, various perl libraries, isn't documented, and isn't
particularly featureful.

Installation
------------

# On a mac with homebrew:
brew install redis cpanminus

# On debian/ubuntu
sudo apt-get install -y redis cpanminus

# Either, install the perl modules.
sudo cpanm Modern::Perl Digest::SHA1 File::Next Number::Bytes::Human Redis Try::Tiny

Usage
-----

* `duplicates scan [-v] [ ...]`

Looks for duplicate files in `dir`s. Defaults to current directory.

* `duplicates list [ ...]`

Lists files in `dir`s that have duplicates elsewhere. Defaults to
current directory.

* `duplicates list [-v] -a`

List all registered matches. Use "-v" to verbosely list the SHA1 and
group matches rather than just listing filenames.

* `duplicates matches [-v] [...]`

Lists the duplicates of `file`s. Use "-v" to verbosely list the SHA1
and group matches rather than just listing filenames.

* `duplicates delete [-v] [...]`

Deletes any files within `dir`s that have duplicates elsewhere. Will
re-read the content of duplicate files before deleting to confirm
they are still duplicates.

* `duplicates delete-others [-v] [...]`

Deletes any files that are duplicates of those within `dir`s. Will
re-read the content of duplicate files before deleting to confirm
they are still duplicates.

* `duplicates rescan [-v] [ ...]`

Re-reads all registered duplicate files (optionally only within
`dir`s) to confirm they are still duplicates. Defaults to re-reading
all registered files.

* `duplicates stats [-v]`

Print some information about the duplicate files. Use "-v" to list
the top 10 duplicates (in terms of file size).

* `duplicates wipe`

Removes all information stored in redis.