https://github.com/algram/shingler
Duplicate text analyzer with help of the shingle algorithm. Insert the two texts you want to compare and you will get a matching score back.
https://github.com/algram/shingler
Last synced: 11 months ago
JSON representation
Duplicate text analyzer with help of the shingle algorithm. Insert the two texts you want to compare and you will get a matching score back.
- Host: GitHub
- URL: https://github.com/algram/shingler
- Owner: Algram
- Created: 2015-07-24T23:47:10.000Z (about 11 years ago)
- Default Branch: master
- Last Pushed: 2015-11-30T20:21:53.000Z (over 10 years ago)
- Last Synced: 2025-03-02T05:22:03.892Z (over 1 year ago)
- Language: CSS
- Homepage: http://algram.github.io/Shingler/
- Size: 331 KB
- Stars: 2
- Watchers: 4
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
# Shingler
Duplicate text analyzer with help of the shingle algorithm. Insert the two texts you want to compare and you will get a matching score back.
##How it works
This tool takes two texts and returns a number called the "Shingle Score". This metric is used by many SEO-Experts to measure the similarity between two texts.
The scoring is based on splitting the text into lots of smaller parts. These parts are then compared with each other and checked for matching pairs.
The more matches are found the higher will the score be.
Shingler makes various changes to the inserted text to garantuee a more reliable score value.
Removal of whitespaces
Removal of stop-words
Splitting into binominal-shingles
Performance orientated code
If you have specific questions about Shingler feel free to contact me:
Alias Gram
aliasgram@gmail.com