https://github.com/chardet/chardet

Python character encoding detector
https://github.com/chardet/chardet

Last synced: 5 days ago
JSON representation

Python character encoding detector

• Host: GitHub
• URL: https://github.com/chardet/chardet
• Owner: chardet
• License: lgpl-2.1
• Created: 2012-07-26T20:30:54.000Z (over 12 years ago)
• Default Branch: main
• Last Pushed: 2025-01-13T22:33:23.000Z (12 days ago)
• Last Synced: 2025-01-15T08:21:05.389Z (11 days ago)
• Language: Python
• Homepage:
• Size: 4.88 MB
• Stars: 2,212
• Watchers: 47
• Forks: 260
• Open Issues: 68
• Metadata Files:
  • Readme: README.rst
  • License: LICENSE
  • Support: docs/supported-encodings.rst

Awesome Lists containing this project

• best-of-python - GitHub - 42% open · ⏱️ 01.08.2023): (Text Data)
• awesome-list - Chardet - Python character encoding detector. (Data Format & I/O / For Python)
• starred-awesome - chardet - Python 2/3 compatible character encoding detector. (Python)

README

        
Chardet: The Universal Character Encoding Detector

--------------------------------------------------

.. image:: https://img.shields.io/travis/chardet/chardet/stable.svg

   :alt: Build status

   :target: https://travis-ci.org/chardet/chardet

.. image:: https://img.shields.io/coveralls/chardet/chardet/stable.svg

   :target: https://coveralls.io/r/chardet/chardet

.. image:: https://img.shields.io/pypi/v/chardet.svg

   :target: https://warehouse.python.org/project/chardet/

   :alt: Latest version on PyPI

.. image:: https://img.shields.io/pypi/l/chardet.svg

   :alt: License

Detects

 - ASCII, UTF-8, UTF-16 (2 variants), UTF-32 (4 variants)

 - Big5, GB2312, EUC-TW, HZ-GB-2312, ISO-2022-CN (Traditional and Simplified Chinese)

 - EUC-JP, SHIFT_JIS, CP932, ISO-2022-JP (Japanese)

 - EUC-KR, ISO-2022-KR, Johab (Korean)

 - KOI8-R, MacCyrillic, IBM855, IBM866, ISO-8859-5, windows-1251 (Cyrillic)

 - ISO-8859-5, windows-1251 (Bulgarian)

 - ISO-8859-1, windows-1252, MacRoman (Western European languages)

 - ISO-8859-7, windows-1253 (Greek)

 - ISO-8859-8, windows-1255 (Visual and Logical Hebrew)

 - TIS-620 (Thai)

.. note::

   Our ISO-8859-2 and windows-1250 (Hungarian) probers have been temporarily

   disabled until we can retrain the models.

Requires Python 3.8+.

Installation

------------

Install from `PyPI `_::

    pip install chardet

Documentation

-------------

For users, docs are now available at https://chardet.readthedocs.io/.

Command-line Tool

-----------------

chardet comes with a command-line script which reports on the encodings of one

or more files::

    % chardetect somefile someotherfile

    somefile: windows-1252 with confidence 0.5

    someotherfile: ascii with confidence 1.0

About

-----

This is a continuation of Mark Pilgrim's excellent original chardet port from C, and `Ian Cordasco `_'s

`charade `_ Python 3-compatible fork.

:maintainer: Dan Blanchard