https://github.com/chardet/chardet
Python character encoding detector
https://github.com/chardet/chardet
Last synced: 6 months ago
JSON representation
Python character encoding detector
- Host: GitHub
- URL: https://github.com/chardet/chardet
- Owner: chardet
- License: lgpl-2.1
- Created: 2012-07-26T20:30:54.000Z (over 13 years ago)
- Default Branch: main
- Last Pushed: 2025-01-13T22:33:23.000Z (10 months ago)
- Last Synced: 2025-05-06T14:51:09.585Z (6 months ago)
- Language: Python
- Homepage:
- Size: 4.88 MB
- Stars: 2,251
- Watchers: 46
- Forks: 263
- Open Issues: 74
-
Metadata Files:
- Readme: README.rst
- License: LICENSE
- Support: docs/supported-encodings.rst
Awesome Lists containing this project
- awesome-list - Chardet - Python character encoding detector. (Data Format & I/O / For Python)
- starred-awesome - chardet - Python 2/3 compatible character encoding detector. (Python)
- best-of-python - GitHub - 46% open · ⏱️ 14.10.2025): (Text Data)
README
Chardet: The Universal Character Encoding Detector
--------------------------------------------------
.. image:: https://img.shields.io/travis/chardet/chardet/stable.svg
:alt: Build status
:target: https://travis-ci.org/chardet/chardet
.. image:: https://img.shields.io/coveralls/chardet/chardet/stable.svg
:target: https://coveralls.io/r/chardet/chardet
.. image:: https://img.shields.io/pypi/v/chardet.svg
:target: https://warehouse.python.org/project/chardet/
:alt: Latest version on PyPI
.. image:: https://img.shields.io/pypi/l/chardet.svg
:alt: License
Detects
- ASCII, UTF-8, UTF-16 (2 variants), UTF-32 (4 variants)
- Big5, GB2312, EUC-TW, HZ-GB-2312, ISO-2022-CN (Traditional and Simplified Chinese)
- EUC-JP, SHIFT_JIS, CP932, ISO-2022-JP (Japanese)
- EUC-KR, ISO-2022-KR, Johab (Korean)
- KOI8-R, MacCyrillic, IBM855, IBM866, ISO-8859-5, windows-1251 (Cyrillic)
- ISO-8859-5, windows-1251 (Bulgarian)
- ISO-8859-1, windows-1252, MacRoman (Western European languages)
- ISO-8859-7, windows-1253 (Greek)
- ISO-8859-8, windows-1255 (Visual and Logical Hebrew)
- TIS-620 (Thai)
.. note::
Our ISO-8859-2 and windows-1250 (Hungarian) probers have been temporarily
disabled until we can retrain the models.
Requires Python 3.8+.
Installation
------------
Install from `PyPI `_::
pip install chardet
Documentation
-------------
For users, docs are now available at https://chardet.readthedocs.io/.
Command-line Tool
-----------------
chardet comes with a command-line script which reports on the encodings of one
or more files::
% chardetect somefile someotherfile
somefile: windows-1252 with confidence 0.5
someotherfile: ascii with confidence 1.0
About
-----
This is a continuation of Mark Pilgrim's excellent original chardet port from C, and `Ian Cordasco `_'s
`charade `_ Python 3-compatible fork.
:maintainer: Dan Blanchard