Data

Tools

Indexes

Applications

Experiments

Awesome

An open API service indexing awesome lists of open source software.

Projects in Awesome Lists tagged with duplicate

A curated list of projects in awesome lists tagged with duplicate .

https://github.com/elisemercury/Duplicate-Image-Finder

difPy - Python package for finding duplicate and similar images

difpy duplicate find images pictures python similarity

Last synced: 24 Apr 2025

https://github.com/MarkCiliaVincenti/AsyncKeyedLock

An asynchronous .NET library that allows you to lock based on a key (keyed semaphores), limiting concurrent threads sharing the same key to a specified number, with optional pooling for reducing memory allocations.

async duplicate key keyed lock pooling semaphore semaphores semaphoreslim synchronization

Last synced: 19 Jan 2026

https://github.com/RazgrizHsu/immich-mediakit

An extension toolkit for Immich enabling advanced management capabilities through AI-powered similarity detection

duplicate duplicate-detection immich similarity

Last synced: 14 Jul 2025

https://github.com/brentlintner/synt

Find similar functions and classes in your JavaScript/TypeScript code

duplicate javascript nodejs similarity static-analysis typescript

Last synced: 16 May 2025

https://github.com/jhildenbiddle/mergician

Uniquely flexible and light-weight utility for cloning and deep (recursive) merging of JavaScript objects. Supports descriptor values, accessor functions, and custom prototypes. Provides advanced options for customizing the clone/merge process.

accessor array clone copy deep deep-merge deepmerge descriptor duplicate extend filter getter immutable javascript merge merge-deep object recursive setter sort

Last synced: 09 Apr 2025

https://github.com/m4mallu/uniquify

Uniquify is a Telegram bot interface used to remove duplicate media files from a chat

duplicate media removing robot telegram

Last synced: 22 Jul 2025

https://github.com/PJDude/dude

Duplicates Detector is a cross-platform GUI utility for finding duplicate files, allowing you to delete or link them to save space. Duplicate files are displayed and processed on two synchronized panels for efficient and convenient operation.

cli deduplication duplicate duplicate-detection duplicate-files duplicates duplicates-removal easy easy-to-use easyui gui gui-application python python3 sha1 threads tkinter utility utility-application

Last synced: 06 Mar 2025

https://github.com/offirgolan/ember-data-copyable

Intelligently copy an Ember Data model and all of its relationships

copy duplicate ember ember-addon ember-data

Last synced: 12 May 2025

https://github.com/lyonsyonii/akin

Rust crate for writing repetitive code easier and faster.

code duplicate duplicates repeat repetition rust rust-crate similar similars simpler write

Last synced: 08 Aug 2025

https://github.com/wessberg/ts-clone-node

A library that helps you clone Nodes from a Typescript AST

ast clone copy duplicate node typescript

Last synced: 17 Apr 2025

https://github.com/shipmonk-rnd/name-collision-detector

Fast & simple tool to find class duplicates in your projects.

ambiguous classname collission duplicate php

Last synced: 12 Apr 2025

https://github.com/jianbingfang/vscode-dup-checker

vscode extension to check and dedup duplicate lines

dup-checker dupchecker duplicate duplicate-checker unique vscode-extension

Last synced: 12 Mar 2026

https://github.com/flydev-fr/duplicator

🧬 Duplicator for ProcessWire. Duplicate, backup and transfer an entire site from one location to another

backup clone cloud dropbox duplicate ftp google-drive processwire

Last synced: 15 Apr 2025

https://github.com/lizhangqu/android-gradle-plugin-transform-patch

android gradle plugin transform patch

agp class duplicate gradle transform

Last synced: 25 Apr 2025

https://github.com/semantic-release/issue-parser

Parser for Github, GitLab and Bitbucket issues actions, references and mentions

bitbucket close duplicate fix github gitlab issues mentions parser pr pull-request references resolve waffle waffle-io

Last synced: 05 Apr 2025

https://github.com/jonschlinkert/add-filename-increment

When copying or moving files, it's common for operating systems to automatically add an increment or 'copy' to duplicate file names. This does that for Node.js applications, with automatic platform detection and support for Linux, MacOs, and Windows conventions.

conflict conflicts dirent duplicate file filename filepath fs increment javascript jonschlinkert name node nodejs path rename

Last synced: 30 Apr 2025

https://github.com/jonschlinkert/strip-filename-increment

Operating systems commonly add a trailing increment, or the word 'copy', or something similar to duplicate files. This strips those increments. Tested on Windows, MacOS, and Linux.

conflicts dirent duplicate file filename filepath increment javascript jonschlinkert name node nodejs number path rename strip vinyl

Last synced: 07 May 2025

https://github.com/lemonyte/dff

A dead-simple command line tool to find duplicate files on your computer.

cli console csharp duplicate file files hash pyinstaller python rust windows

Last synced: 17 Jul 2025

https://github.com/macmade/stringsduplicates

This is a very simple command line program to find duplicate string labels in .strings files.

duplicate i18n l10n localization localized objective-c string

Last synced: 09 Aug 2025

https://github.com/wow-actions/duplicate-issue

🧬 Creates a full copy of issue with a single command

duplicate github-actions issue

Last synced: 13 May 2025

https://github.com/kusen-alpha/dupfilter

强大的去重方案实现，归纳整合常见的去重方案，快速集成到项目中。

dupfilter duplicate duplication filter filters

Last synced: 17 Mar 2026

https://github.com/unsafe-risk/deecpy

Deecpy, The DeepCopy Library

clone deepcopy duplicate go golang golang-deepcopy struct

Last synced: 07 May 2025

https://github.com/atc0005/bridge

A small CLI utility used to find duplicate files

duplicate file go

Last synced: 18 Sep 2025

https://github.com/noclin/duplicate-scanner

Ultra Fast Duplicate File Scanner Based on Everything (Windows and NTFS only)

cleaner duplicate duplicate-file-scanner duplicate-files everything

Last synced: 29 Jun 2025

https://github.com/fengzilong/duplicate-dependencies-webpack-plugin

A webpack plugin to check all duplicated dependencies in your bundle

analyzer bundle duplicate webpack webpack-plugin

Last synced: 14 Apr 2025

https://github.com/hichemtab-tech/namecrement

A smart JavaScript utility that generates unique incremental names, preventing naming collisions by automatically appending incremental suffixes.

auto-increment collision duplicate filename generator increment incremental javascript name names naming package unique utility

Last synced: 04 Mar 2026

https://github.com/0xccf4/backupdeduplicator

A tool to deduplicate backups. It builds a hash tree of all files and folders in the target directory. Optionally also traversing into archives like zip or tar files. The hash tree is then used to find duplicate files and folders.

analysis archival archival-management backup backup-deduplication deduplication duplicate files folder hash hash-tree hashtree housekeeping rust

Last synced: 14 Aug 2025

https://github.com/wedevsofficial/dokan-product-duplicator

Instantly copy a WooCommerce product from a vendor on Dokan powered multivendor marketplace

dokan dokan-product-duplicator duplicate frontend product woocommerce-product woocommerce-product-duplicator

Last synced: 14 May 2025

https://github.com/cps-it/cps_stopdc

Forces TYPO3 to use the latest url for any page. This helps to avoid duplicate content.

canonical content duplicate typo3 typo3-cms typo3-extension

Last synced: 25 May 2026

https://github.com/jjling2011/musicmanager

remove duplicate music files, rename music files base on tags 根据音乐文件的tag信息删除重复音乐文件及重命名音乐文件

duplicate mp3 music rename tag

Last synced: 24 Feb 2026

https://github.com/softonus-io/prettier-plugin-duplicate-remover

A Prettier plugin that removes duplicate class names in class and className attributes, ensuring cleaner, more efficient code in frontend projects like React, Vue.js, and Angular.

duplicate duplicate-detection duplicate-removal duplicates duplicates-removal prettier prettier-config prettier-eslint prettier-plugin prettier-plugin-tailwindcss prettierconfig prettierrc

Last synced: 25 Jun 2026

https://github.com/esotericpig/init_copy

:beginner::bug::gemini: Easily use the appropriate clone/dup method in initialize_copy of Ruby.

clone copy dup duplicate init initialize ruby ruby-gem rubygem

Last synced: 11 Apr 2025

https://github.com/tyler-tee/file-deduplicator

Python app built to scan a directory, check for duplicate files, and send them to the trash.

duplicate duplicate-detection duplicate-files pysimplegui python

Last synced: 21 Apr 2026

https://github.com/tadly/dups

Simple shell backup script

backup bash duplicate sh shell

Last synced: 18 May 2026

https://github.com/endurtech/carbon-copy

Copy your pages, posts and more quickly and conveniently.

copy duplicate pages plugin posts wordpress wordpress-plugin

Last synced: 18 May 2026

https://github.com/guipenedo/discourse-duplicate-category

This simple script uses Discourse's REST API to duplicate a category, which is not possible directly through discourse's frontend.

category copy discourse discourse-api discourse-forum duplicate

Last synced: 03 Oct 2025

https://github.com/stdlib-js/array-base-to-deduped

Copy elements to a new generic array after removing consecutive duplicated values.

array compress copy data dedupe deduplicate deduplication duplicate generic javascript node node-js nodejs stdlib structure types uniq unique

Last synced: 14 Jun 2025

https://github.com/emahtab/contains-duplicate

Check whether an array contains a duplicate value.

array duplicate hashset leetcode problem-solving

Last synced: 09 Feb 2026

https://github.com/therakeshpurohit/jsxtsxscanner

Scans your JS, JSx, TS, TSx files for duplication of code and helps you write non repetitive code

code duplicate javascript js jsx npm scanner ts tsx typescript

Last synced: 30 Apr 2026

https://github.com/ehsan18t/duplicate-line-finder

A small java based tool to find duplicate lines in text files.

duplicate finder line linux mac text win

Last synced: 06 May 2026

https://github.com/stdlib-js/iter-dedupe-by

Create an iterator which removes consecutive values that resolve to the same value according to a provided function.

compress dedupe deduplicate deduplication duplicate iterable iterate iteration iterator javascript node node-js nodejs stdlib uniq unique util utilities utility utils

Last synced: 16 Aug 2025

https://github.com/gautada/neovim

Code Editor Accessible via Terminal or Web

code container duplicate

Last synced: 14 Apr 2026

https://github.com/gautada/heimdall

A container for a configured heimdall dashboard.

container duplicate utility

Last synced: 14 Apr 2026

https://github.com/binbash23/fscan

python project for finding duplicate files in a filesystem and moving them to an archive folder. Stats and stuff are stored in an sqlite database

duplicate files filesystem-library find python sqlite

Last synced: 14 May 2026

https://github.com/cawfree/tfjs-clone

👬 Creates a deep clone of an existing @tensorflow/tfjs model.

clone copy duplicate learning machine networks neural tensorflow tfjs

Last synced: 15 Apr 2026

https://github.com/elisemercury/difpy-for-desktop

difPy as a simple to use desktop application.

deduplication desktop duplicate image similarity

Last synced: 04 Apr 2026

https://github.com/calcuis/duplicate-cleanser

PNG (or any file format) duplicate cleanser (just pull them all in the same directory)

cleanser delete duplicate png

Last synced: 24 Apr 2026

https://github.com/writetome51/get-indexes-of-all-duplicates

Function returns indexes of all duplicated array items

array duplicate elements index items javascript typescript

Last synced: 29 Apr 2026

https://github.com/s-babaeizadeh/remove-duplicate-values-from-js-array

The aim of the remove duplicate values from array is to create a new array that contains only unique values from the original array, effectively eliminating any repeated elements to ensure data integrity and optimize performance in JavaScript applications.

arrays duplicate javascript

Last synced: 01 May 2026

https://github.com/kaleidawave/duplicatejs

A Javascript plugin for duplicating HTML elements

duplicate html javascript javascript-plugin

Last synced: 27 Apr 2026

https://github.com/brentlintner/synt.rb

Calculates the similarity between two pieces of Ruby code.

duplicate ruby similarity static-analysis synt

Last synced: 03 Mar 2025

https://github.com/badasswp/redirect-duplicate-posts

Redirect duplicate post URLs to original URL.

duplicate plugin posts seo wordpress

Last synced: 04 Jan 2026

https://github.com/rpaladin/rp_delete_duplicate_images

Blender Add-On - Delete any duplicate images in a blend

add-on blender delete duplicate images

Last synced: 14 May 2026

https://github.com/sudeeshjohn/github-clone

To clone GitHub issues with labels , milestones etc from a source repository to empty target

clone duplicate github golang issues labels milestones replication

Last synced: 13 Jan 2026

https://github.com/devjiwonchoi/duplicheck

Retrieve duplicates from strings, numbers, arrays, or objects.

duplicate duplicates

Last synced: 31 Mar 2025

https://github.com/theohbrothers/get-duplicatefiles

A script to locate duplicate files between two sets of folders (e.g. source folders vs. other folders).

criteria duplicate duplicate-files export file-metadata files json powershell pwsh script search

Last synced: 19 May 2026

https://github.com/ericadamski/unique-elements

Strip an array of all duplicate entries, including complex objects

array duplicate remove set uniq unique

Last synced: 23 Oct 2025

https://github.com/afeiship/wsui-popular-list

Popular list for wsui.

avatar duplicate items list popular wsui

Last synced: 01 Apr 2025

https://github.com/lifailon/aduser-duplicate

Searching for duplicate accounts

aduser duplicate powershell

Last synced: 01 Apr 2025

https://github.com/brentlintner/synt.hs

Calculates the similarity between two pieces of Haskell code.

duplicate haskell similarity static-analysis synt

Last synced: 03 Mar 2025

https://github.com/tbarbette/refdup

Find and delete duplicate files in a folder using regex

duplicate duplicate-detection duplicate-files files regex

Last synced: 04 Oct 2025

https://github.com/calcuis/cleansor

duplicate file cleansor

cleansor delete detector duplicate file

Last synced: 07 Oct 2025