https://github.com/ioggstream/photo-unique

A simple photo deduplication archiver, using pHash
https://github.com/ioggstream/photo-unique

Last synced: about 1 month ago
JSON representation

A simple photo deduplication archiver, using pHash

• Host: GitHub
• URL: https://github.com/ioggstream/photo-unique
• Owner: ioggstream
• Created: 2011-11-26T19:27:22.000Z (about 13 years ago)
• Default Branch: master
• Last Pushed: 2011-11-26T23:35:15.000Z (about 13 years ago)
• Last Synced: 2024-10-15T03:43:01.203Z (3 months ago)
• Language: Python
• Homepage:
• Size: 89.8 KB
• Stars: 5
• Watchers: 4
• Forks: 1
• Open Issues: 0
• Metadata Files:
  • Readme: README

Awesome Lists containing this project

README

        
photo-unique

-----------------

A simple multithread script to create an unique photo library. The script is made up of three components:

 * Main thread

 * Indexing thread

 * Db thread

Main thread

--------------

Walk thru a filesystem to find images, then pass their path to one of the indexing threads

Indexing threads

-----------------

Every indexing thread creates an image perceptual hash and pass it to the Db thread. This job is quite slow, so it's parallelized.

Db thread

-----------

Write indexes to the db in the following form: 

{ hash : path}

It's in a separate thread to avoid locking issues. Only this thread plays with db.