Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/DavidJacobson/SafeText
Script to remove homoglyphs and zero-width characters to allow for safe distribution of documents from anonymous sources.
https://github.com/DavidJacobson/SafeText
forensic-analysis
Last synced: 15 days ago
JSON representation
Script to remove homoglyphs and zero-width characters to allow for safe distribution of documents from anonymous sources.
- Host: GitHub
- URL: https://github.com/DavidJacobson/SafeText
- Owner: DavidJacobson
- License: mit
- Created: 2017-12-31T21:11:45.000Z (almost 7 years ago)
- Default Branch: master
- Last Pushed: 2019-07-04T16:40:54.000Z (over 5 years ago)
- Last Synced: 2024-08-01T15:12:12.400Z (3 months ago)
- Topics: forensic-analysis
- Language: Python
- Size: 27.3 KB
- Stars: 136
- Watchers: 8
- Forks: 11
- Open Issues: 3
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
# SafeText
Tool to sanitize text to allow for safe distribution of documents from anonymous sources by removing zero-width characters and homoglpyhs.Individuals attempting to leak an email or other text file face the risk of identification through fingerprinting.
Fingerprinting often occurs when the original distributor of the document has embedded some form of a canary.
For example, Elon Musk's [email](https://web.archive.org/web/20131020092330/http://gawker.com/5164035/tesla-ceo-in-digital-witch-hunt) in 2008 in response to leaks featured slightly different
wording for each employee. This tactic was realized by the employees, and failed. An easier
tactic that is also employed, is the presence of nearly invisible changes to the text.
SafeText is designed to identify and remove these changes.
Specifically this tool will remove homoglyphs, zero-width characters, and other subtle characters.
This tool will also attempt to identify unique spelling of words that could give away an individual's location.## Usage
To use SafeText, call:
```shell
python safetext.py inputfile
```
Example output is:
```shell
λ python safetext.py TestFile.txt
[*] Cleaning TestFile.txt to TestFile.txt.safe ...
[!] FOUND HOMOGLYPHIC CHARACTER CYRILLIC_large_H ON LINE 1
The message said: "(Н)ey, let's hang out!"
[!] FOUND a SPACE ON LINE # 2
Lorem*Ipsum*Dolor*Sit
[!] WARNING - Use of spelling (colour) that identifies country on line 3
[!] FOUND HOMOGLYPHIC CHARACTER GREEK_B ON LINE 5
[!] FOUND HOMOGLYPHIC CHARACTER GREEK_C ON LINE 5
Subject: (Β)udget (Ϲ)uts
[*] Output file closed```
Note: The relevant characters will be underlined - not enclosed by parentheses.
SafeText will output to infile.safe.