{"id":13814124,"url":"https://github.com/pudo/normality","last_synced_at":"2025-10-26T01:53:25.988Z","repository":{"id":26326563,"uuid":"29775021","full_name":"pudo/normality","owner":"pudo","description":"A tiny library for Python text normalisation. Useful for ad-hoc text processing.","archived":false,"fork":false,"pushed_at":"2024-01-04T11:00:21.000Z","size":109,"stargazers_count":136,"open_issues_count":1,"forks_count":18,"subscribers_count":6,"default_branch":"master","last_synced_at":"2024-04-14T02:21:41.947Z","etag":null,"topics":["normalization","normalizer","slugs","unicode","unicode-characters"],"latest_commit_sha":null,"homepage":null,"language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/pudo.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null}},"created_at":"2015-01-24T11:54:21.000Z","updated_at":"2024-04-09T00:35:26.000Z","dependencies_parsed_at":"2024-01-04T12:45:58.893Z","dependency_job_id":null,"html_url":"https://github.com/pudo/normality","commit_stats":{"total_commits":134,"total_committers":10,"mean_commits":13.4,"dds":0.09701492537313428,"last_synced_commit":"e23d4bd4b66254813adbc3b472919ab16a87e10b"},"previous_names":[],"tags_count":22,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/pudo%2Fnormality","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/pudo%2Fnormality/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/pudo%2Fnormality/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/pudo%2Fnormality/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/pudo","download_url":"https://codeload.github.com/pudo/normality/tar.gz/refs/heads/master","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":224917280,"owners_count":17391824,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["normalization","normalizer","slugs","unicode","unicode-characters"],"created_at":"2024-08-04T04:01:44.205Z","updated_at":"2025-10-26T01:53:25.984Z","avatar_url":"https://github.com/pudo.png","language":"Python","readme":"# normality\n\n[![build](https://github.com/pudo/normality/actions/workflows/build.yml/badge.svg)](https://github.com/pudo/normality/actions/workflows/build.yml)\n\nNormality is a Python micro-package that contains a small set of text normalization functions for easier re-use. These functions accept a snippet of unicode or utf-8 encoded text and remove various classes of characters, such as diacritics, punctuation etc. This is useful as a preparation to further text analysis.\n\n**WARNING**: As of version 3.0, `normality` requires `pyicu` as a mandatory dependency. If you cannot install `pyicu`, consider using `normality \u003c 3.0.0`.\n\n## Example\n\n```python\n# coding: utf-8\nfrom normality import normalize, slugify, collapse_spaces, ascii_text, latinize_text\n\ntext = normalize('Nie wieder \"Grüne Süppchen\" kochen!')\nassert text == 'nie wieder grune suppchen kochen'\n\nslug = slugify('My first blog post!')\nassert slug == 'my-first-blog-post'\n\ntext = 'this \\n\\n\\r\\nhas\\tlots of \\nodd spacing.'\nassert collapse_spaces(text) == 'this has lots of odd spacing.'\n```\n\n## License\n\n``normality`` is open source, licensed under a standard MIT license (included in this repository as ``LICENSE``).\n","funding_links":[],"categories":["Python"],"sub_categories":[],"project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fpudo%2Fnormality","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fpudo%2Fnormality","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fpudo%2Fnormality/lists"}