{"id":19031470,"url":"https://github.com/plandes/clj-filedup","last_synced_at":"2026-06-16T16:31:19.696Z","repository":{"id":80107477,"uuid":"80797525","full_name":"plandes/clj-filedup","owner":"plandes","description":"Find Duplicate Files by Content","archived":false,"fork":false,"pushed_at":"2019-01-18T02:02:29.000Z","size":61,"stargazers_count":2,"open_issues_count":0,"forks_count":0,"subscribers_count":1,"default_branch":"master","last_synced_at":"2025-10-28T08:40:01.820Z","etag":null,"topics":["clojure","duplicates","filesystem"],"latest_commit_sha":null,"homepage":null,"language":"Clojure","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/plandes.png","metadata":{"files":{"readme":"README.md","changelog":"CHANGELOG.md","contributing":"CONTRIBUTING.md","funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2017-02-03T04:40:00.000Z","updated_at":"2019-01-18T02:02:30.000Z","dependencies_parsed_at":null,"dependency_job_id":"55a0ac07-872d-4deb-8fc6-2cee2c88bc4b","html_url":"https://github.com/plandes/clj-filedup","commit_stats":null,"previous_names":[],"tags_count":2,"template":false,"template_full_name":null,"purl":"pkg:github/plandes/clj-filedup","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/plandes%2Fclj-filedup","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/plandes%2Fclj-filedup/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/plandes%2Fclj-filedup/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/plandes%2Fclj-filedup/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/plandes","download_url":"https://codeload.github.com/plandes/clj-filedup/tar.gz/refs/heads/master","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/plandes%2Fclj-filedup/sbom","scorecard":null,"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":286080680,"owners_count":34415240,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2026-05-26T15:22:16.424Z","status":"online","status_checked_at":"2026-06-16T02:00:06.860Z","response_time":126,"last_error":null,"robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":true,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["clojure","duplicates","filesystem"],"created_at":"2024-11-08T21:23:46.261Z","updated_at":"2026-06-16T16:31:19.676Z","avatar_url":"https://github.com/plandes.png","language":"Clojure","funding_links":[],"categories":[],"sub_categories":[],"readme":"# Find Duplicate Files by Content\n\n[![Travis CI Build Status][travis-badge]][travis-link]\n\nThis is a command line program that finds files that are duplicates in a\ndirectory tree.  It traverses a directory recursively and finds files that are\nthe same by content.  It does this by computing and reporting\nduplicate [md5sums](https://en.wikipedia.org/wiki/Md5sum).\n\n\u003c!-- markdown-toc start - Don't edit this section. Run M-x markdown-toc-refresh-toc --\u003e\n## Table of Contents\n\n- [Obtaining](#obtaining)\n- [Usage](#usage)\n- [Building](#building)\n- [Use as a Clojure Library](#use-as-a-clojure-library)\n    - [Documentation](#documentation)\n- [Changelog](#changelog)\n- [License](#license)\n\n\u003c!-- markdown-toc end --\u003e\n\n\n## Obtaining\n\nThe latest release binaries are\navailable [here](https://github.com/plandes/clj-filedup/releases/latest).\n\n\n## Usage\n\n[Java] is needed to run this program.\n\nThis is a command line application that has the following usage (given with `-h`):\n```sql\n$ filedup -h\nusage: filedup [options]\nfind duplicate files\n  -l, --level \u003clog level\u003e      INFO  Log level to set in the Log4J2 system.\n  -a, --absolute                     Print absolute path names if given\n  -d, --directory \u003cdirectory\u003e  .     The directory to find duplicate files.\n```\n\nTo find all the duplicates in directory `test-directory`:\n```bash\n$ filedup -d test-resources\ntest-resources/dupdir/file1 test-resources/dupdir/file3\n```\n\nTo get more output:\n```bash\n$ filedup -l info -d test-resources\nfiledup: find-dups: finding duplicate files in test-resources\nfiledup: find-dups: processing test-resources/dupdir/file1\nfiledup: find-dups: processing test-resources/dupdir/file2\nfiledup: find-dups: processing test-resources/dupdir/file3\nfiledup: find-dups: processing test-resources/log4j2.xml\ntest-resources/dupdir/file1 test-resources/dupdir/file3\n```\n\n\n## Building\n\nTo build from source, do the folling:\n\n- Install [Leiningen](http://leiningen.org) (this is just a script)\n- Install [GNU make](https://www.gnu.org/software/make/)\n- Install [Git](https://git-scm.com)\n- Download the source: `git clone --recurse-submodules https://github.com/plandes/clj-nlp-parse \u0026\u0026 cd clj-nlp-parse`\n- Build the software: `make jar`\n- Build the distribution binaries: `make dist`\n\nNote that you can also build a single jar file with all the dependencies with: `make uber`\n\n\n### Documentation\n\nAPI [documentation](https://plandes.github.io/clj-filedup/codox/index.html).\n\nThe command line documentation is given with the `--help` option.\n\n\n## Changelog\n\nAn extensive changelog is available [here](CHANGELOG.md).\n\n\n## License\n\nCopyright (c) 2016, 2017, 2018 Paul Landes\n\nPermission is hereby granted, free of charge, to any person obtaining a copy of\nthis software and associated documentation files (the \"Software\"), to deal in\nthe Software without restriction, including without limitation the rights to\nuse, copy, modify, merge, publish, distribute, sublicense, and/or sell copies\nof the Software, and to permit persons to whom the Software is furnished to do\nso, subject to the following conditions:\n\nThe above copyright notice and this permission notice shall be included in all\ncopies or substantial portions of the Software.\n\nTHE SOFTWARE IS PROVIDED \"AS IS\", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR\nIMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,\nFITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE\nAUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER\nLIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,\nOUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE\nSOFTWARE.\n\n\n\u003c!-- links --\u003e\n[Java]: https://java.com/en/download/\n[travis-link]: https://travis-ci.org/plandes/clj-filedup\n[travis-badge]: https://travis-ci.org/plandes/clj-filedup.svg?branch=master\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fplandes%2Fclj-filedup","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fplandes%2Fclj-filedup","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fplandes%2Fclj-filedup/lists"}