{"id":23408490,"url":"https://github.com/ocha-dap/hdx-python-utilities","last_synced_at":"2026-02-16T07:16:07.344Z","repository":{"id":41158192,"uuid":"106430665","full_name":"OCHA-DAP/hdx-python-utilities","owner":"OCHA-DAP","description":"A range of helpful utilities for Python developers including streaming tabular data, date parsing, JSON and YAML handling, dictionary and list utilities","archived":false,"fork":false,"pushed_at":"2026-01-15T04:48:43.000Z","size":2780,"stargazers_count":10,"open_issues_count":1,"forks_count":6,"subscribers_count":15,"default_branch":"main","last_synced_at":"2026-01-18T15:21:09.533Z","etag":null,"topics":["datetime","hdx","json","logging","stream-processing","tabular-data","utilities","yaml"],"latest_commit_sha":null,"homepage":"https://hdx-python-utilities.readthedocs.io/en/latest/","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/OCHA-DAP.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":"CONTRIBUTING.md","funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null,"zenodo":null,"notice":null,"maintainers":null,"copyright":null,"agents":null,"dco":null,"cla":null}},"created_at":"2017-10-10T14:47:02.000Z","updated_at":"2026-01-15T04:48:47.000Z","dependencies_parsed_at":"2023-12-13T23:25:45.834Z","dependency_job_id":"ffc30320-24e3-4f2e-be9a-09b6576b7e26","html_url":"https://github.com/OCHA-DAP/hdx-python-utilities","commit_stats":{"total_commits":532,"total_committers":3,"mean_commits":"177.33333333333334","dds":"0.40037593984962405","last_synced_commit":"19b89a88ad2a0e4080b016a07d3b334596c53f1f"},"previous_names":[],"tags_count":190,"template":false,"template_full_name":null,"purl":"pkg:github/OCHA-DAP/hdx-python-utilities","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/OCHA-DAP%2Fhdx-python-utilities","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/OCHA-DAP%2Fhdx-python-utilities/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/OCHA-DAP%2Fhdx-python-utilities/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/OCHA-DAP%2Fhdx-python-utilities/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/OCHA-DAP","download_url":"https://codeload.github.com/OCHA-DAP/hdx-python-utilities/tar.gz/refs/heads/main","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/OCHA-DAP%2Fhdx-python-utilities/sbom","scorecard":null,"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":286080680,"owners_count":28767014,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2026-01-26T03:54:34.369Z","status":"ssl_error","status_checked_at":"2026-01-26T03:54:33.031Z","response_time":59,"last_error":"SSL_connect returned=1 errno=0 peeraddr=140.82.121.5:443 state=error: unexpected eof while reading","robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":false,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["datetime","hdx","json","logging","stream-processing","tabular-data","utilities","yaml"],"created_at":"2024-12-22T15:15:09.951Z","updated_at":"2026-02-13T05:06:33.749Z","avatar_url":"https://github.com/OCHA-DAP.png","language":"Python","funding_links":[],"categories":[],"sub_categories":[],"readme":"[![Build Status](https://github.com/OCHA-DAP/hdx-python-utilities/actions/workflows/run-python-tests.yaml/badge.svg)](https://github.com/OCHA-DAP/hdx-python-utilities/actions/workflows/run-python-tests.yaml)\n[![Coverage Status](https://coveralls.io/repos/github/OCHA-DAP/hdx-python-utilities/badge.svg?branch=main\u0026ts=1)](https://coveralls.io/github/OCHA-DAP/hdx-python-utilities?branch=main)\n[![Ruff](https://img.shields.io/endpoint?url=https://raw.githubusercontent.com/astral-sh/ruff/main/assets/badge/v2.json)](https://github.com/astral-sh/ruff)\n[![Downloads](https://img.shields.io/pypi/dm/hdx-python-utilities.svg)](https://pypistats.org/packages/hdx-python-utilities)\n\nThe HDX Python Utilities Library provides a range of helpful utilities for Python developers.\nNote that these are not specific to HDX.\n\n1. Easy downloading of files with support for authentication, streaming and hashing\n1. Retrieval of data from url with saving to file or from data previously saved\n1. Date utilities\n1. Loading and saving JSON and YAML (maintaining order)\n1. Loading and saving HXLated csv and/or JSON\n1. Dictionary and list utilities\n1. HTML utilities (inc. BeautifulSoup helper)\n1. Compare files (eg. for testing)\n1. Simple emailing\n1. Easy logging setup and error logging\n1. State utility\n1. Path utilities\n1. URL utilities\n1. Text processing\n1. Stable file hashing\n1. Matching utilities\n1. Encoding utilities\n1. Check valid UUID\n1. Easy building and packaging\n\nFor more information, please read the [documentation](https://hdx-python-utilities.readthedocs.io/en/latest/).\n\nThis library is part of the [Humanitarian Data Exchange](https://data.humdata.org/) (HDX) project. If you have\nhumanitarian related data, please upload your datasets to HDX.\n\n# Development\n\n## Environment\n\nDevelopment is currently done using Python 3.13. The environment can be created with:\n\n```shell\n    uv sync\n```\n\nThis creates a .venv folder with the versions specified in the project's uv.lock file.\n\n### Pre-commit\n\npre-commit will be installed when syncing uv. It is run every time you make a git\ncommit if you call it like this:\n\n```shell\n    pre-commit install\n```\n\nWith pre-commit, all code is formatted according to\n[ruff](https://docs.astral.sh/ruff/) guidelines.\n\nTo check if your changes pass pre-commit without committing, run:\n\n```shell\n    pre-commit run --all-files\n```\n\n## Packages\n\n[uv](https://github.com/astral-sh/uv) is used for package management.  If\nyou’ve introduced a new package to the source code (i.e. anywhere in `src/`),\nplease add it to the `project.dependencies` section of `pyproject.toml` with\nany known version constraints.\n\nTo add packages required only for testing, add them to the\n`[dependency-groups]`.\n\nAny changes to the dependencies will be automatically reflected in\n`uv.lock` with `pre-commit`, but you can re-generate the files without committing by\nexecuting:\n\n```shell\n    uv lock --upgrade\n```\n\n## Project\n\n[uv](https://github.com/astral-sh/uv) is used for project management. The project can be\nbuilt using:\n\n```shell\n    uv build\n```\n\nLinting and syntax checking can be run with:\n\n```shell\n    uv run ruff check\n```\n\nTo run the tests and view coverage, execute:\n\n```shell\n    uv run pytest\n```\n\n## Documentation\n\nThe documentation, including API documentation, is generated using ReadtheDocs and\nMkDocs with Material. As you change the source code, remember to update the\ndocumentation at `documentation/index.md`.\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Focha-dap%2Fhdx-python-utilities","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Focha-dap%2Fhdx-python-utilities","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Focha-dap%2Fhdx-python-utilities/lists"}