https://github.com/gagniuc/entropy-of-text
Entropy is a measure of the uncertainty in a random variable. This application calculates the entropy of text. The current example calculates the entropy of sequence "TTTAAGCC". In the context of information theory the term "Entropy" refers to the Shannon entropy.
https://github.com/gagniuc/entropy-of-text
algorithm alphabet detector entropy javascript js math measurement probability random shannon shannon-entropy statistics variable
Last synced: 7 days ago
JSON representation
Entropy is a measure of the uncertainty in a random variable. This application calculates the entropy of text. The current example calculates the entropy of sequence "TTTAAGCC". In the context of information theory the term "Entropy" refers to the Shannon entropy.
- Host: GitHub
- URL: https://github.com/gagniuc/entropy-of-text
- Owner: Gagniuc
- License: mit
- Created: 2021-11-15T15:10:20.000Z (almost 4 years ago)
- Default Branch: main
- Last Pushed: 2022-03-21T10:28:49.000Z (over 3 years ago)
- Last Synced: 2025-08-22T11:57:59.498Z (about 2 months ago)
- Topics: algorithm, alphabet, detector, entropy, javascript, js, math, measurement, probability, random, shannon, shannon-entropy, statistics, variable
- Language: HTML
- Homepage:
- Size: 79.1 KB
- Stars: 4
- Watchers: 1
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- Funding: .github/FUNDING.yml
- License: LICENSE.md
Awesome Lists containing this project
README
# Entropy of text
Entropy is a measure of the uncertainty in a random variable. This application calculates the entropy of text. The current example calculates the entropy of sequence "TTTAAGCC". In the context of information theory the term "Entropy" refers to the Shannon entropy:
Which can also be written as:
Where n represents the total number of symbols in the alphabet of a sequence and pi represents the probability of occurrence of a symbol i found in the alphabet. For more detailed information on entropy please see the specialized chapter from the book entitled Algorithms in Bioinformatics: Theory and Implementation.
**Live demo**: https://gagniuc.github.io/Entropy-of-Text/
# References
- Paul A. Gagniuc. Algorithms in Bioinformatics: Theory and Implementation. John Wiley & Sons, Hoboken, NJ, USA, 2021, ISBN: 9781119697961.