https://github.com/rajatm544/shannon-encoding
https://github.com/rajatm544/shannon-encoding
Last synced: 8 months ago
JSON representation
- Host: GitHub
- URL: https://github.com/rajatm544/shannon-encoding
- Owner: Rajatm544
- Created: 2020-12-06T11:53:54.000Z (almost 5 years ago)
- Default Branch: main
- Last Pushed: 2020-12-09T10:29:13.000Z (almost 5 years ago)
- Last Synced: 2025-01-07T05:44:37.479Z (9 months ago)
- Language: Python
- Size: 2.93 KB
- Stars: 1
- Watchers: 1
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
# Program to perform Shannon Encoding
- Meant for an assignment, this is a python program that takes a string to encode and returns the code for each symbol in that string
- The encoding is performed using Shannon Binary encoding. The algorithm for the process is as follows:
1. Input a string of characters
2. Compute the frequency of each character, and use that to compute its probability
3. Sort the list of unique characters, in decreasing order of their probabilties.
4. Create a list of αi values, which is the same as the cumulative sum of each probabilty.
5. Find the length of each encoded word, using the formula 2li ≥ 1/(pi).
6. The binary Shannon code for each symbol is the same as the binary representation of its αi value, upto li length.
7. Find the values for the entropy, efficiency, average length and redundancy of the calculated codes.