https://github.com/junlulocky/infopy

Python information theory computation
https://github.com/junlulocky/infopy

bic entropy etc information-theory kl-divergence mutual-info normalized-mutual-info

Last synced: 3 months ago
JSON representation

Python information theory computation

• Host: GitHub
• URL: https://github.com/junlulocky/infopy
• Owner: junlulocky
• Created: 2017-04-13T01:24:40.000Z (over 8 years ago)
• Default Branch: master
• Last Pushed: 2018-03-07T17:45:26.000Z (over 7 years ago)
• Last Synced: 2025-06-20T12:48:52.628Z (4 months ago)
• Topics: bic, entropy, etc, information-theory, kl-divergence, mutual-info, normalized-mutual-info
• Language: Python
• Size: 19.5 KB
• Stars: 1
• Watchers: 1
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

README

          
# infopy

Python information theory computation. In most the computation, we use the true label/predicted label setting, i.e. 

the input labels are the true label and predicted label from a clustering algorithm or other methods. 

## Releae Note

- entropy

- normalized mutual information

- mutual information

- variation of information

- a toy implementation of [Bayesian information criterion (BIC)](https://en.wikipedia.org/wiki/Bayesian_information_criterion).

## References

- Pedregosa, Fabian, et al. "Scikit-learn: Machine learning in Python." Journal of Machine Learning Research 12.Oct (2011): 2825-2830.