{"id":15284706,"url":"https://github.com/mikeqfu/pydriosm","last_synced_at":"2026-04-19T14:09:35.638Z","repository":{"id":39007632,"uuid":"92493726","full_name":"mikeqfu/pydriosm","owner":"mikeqfu","description":"PyDriosm: An open-source tool for downloading, reading and PostgreSQL-based I/O of OpenStreetMap data","archived":false,"fork":false,"pushed_at":"2026-04-12T12:57:22.000Z","size":10704,"stargazers_count":48,"open_issues_count":5,"forks_count":13,"subscribers_count":1,"default_branch":"master","last_synced_at":"2026-04-12T14:26:37.453Z","etag":null,"topics":["bbbike","geofabrik","openstreetmap","openstreetmap-data","openstreetmap-protobuffer-format","osm","pbf","postgresql","protobuf-binary-format","protocol-buffer-binary-format","python","shapefile","shp"],"latest_commit_sha":null,"homepage":"https://pydriosm.readthedocs.io","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"gpl-3.0","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/mikeqfu.png","metadata":{"files":{"readme":"README.md","changelog":"CHANGELOG.md","contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null,"zenodo":null,"notice":null,"maintainers":null,"copyright":null,"agents":null,"dco":null,"cla":null}},"created_at":"2017-05-26T09:15:49.000Z","updated_at":"2026-03-05T23:02:54.000Z","dependencies_parsed_at":"2024-10-31T01:02:45.511Z","dependency_job_id":"23267430-bde3-4a88-8104-d1366339656c","html_url":"https://github.com/mikeqfu/pydriosm","commit_stats":{"total_commits":771,"total_committers":5,"mean_commits":154.2,"dds":"0.027237354085603127","last_synced_commit":"da106fe1cc67587fe8f9bc7649aab2d94929d191"},"previous_names":[],"tags_count":19,"template":false,"template_full_name":null,"purl":"pkg:github/mikeqfu/pydriosm","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/mikeqfu%2Fpydriosm","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/mikeqfu%2Fpydriosm/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/mikeqfu%2Fpydriosm/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/mikeqfu%2Fpydriosm/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/mikeqfu","download_url":"https://codeload.github.com/mikeqfu/pydriosm/tar.gz/refs/heads/master","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/mikeqfu%2Fpydriosm/sbom","scorecard":{"id":645871,"data":{"date":"2025-08-11","repo":{"name":"github.com/mikeqfu/pydriosm","commit":"da106fe1cc67587fe8f9bc7649aab2d94929d191"},"scorecard":{"version":"v5.2.1-40-gf6ed084d","commit":"f6ed084d17c9236477efd66e5b258b9d4cc7b389"},"score":2.8,"checks":[{"name":"Packaging","score":-1,"reason":"packaging workflow not detected","details":["Warn: no GitHub/GitLab publishing workflow detected."],"documentation":{"short":"Determines if the project is published as a package that others can easily download, install, easily update, and uninstall.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#packaging"}},{"name":"Maintained","score":0,"reason":"0 commit(s) and 0 issue activity found in the last 90 days -- score normalized to 0","details":null,"documentation":{"short":"Determines if the project is \"actively maintained\".","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#maintained"}},{"name":"Code-Review","score":0,"reason":"Found 0/30 approved changesets -- score normalized to 0","details":null,"documentation":{"short":"Determines if the project requires human code review before pull requests (aka merge requests) are merged.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#code-review"}},{"name":"Dangerous-Workflow","score":-1,"reason":"no workflows found","details":null,"documentation":{"short":"Determines if the project's GitHub Action workflows avoid dangerous patterns.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#dangerous-workflow"}},{"name":"Token-Permissions","score":-1,"reason":"No tokens found","details":null,"documentation":{"short":"Determines if the project's workflows follow the principle of least privilege.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#token-permissions"}},{"name":"Binary-Artifacts","score":10,"reason":"no binaries found in the repo","details":null,"documentation":{"short":"Determines if the project has generated executable (binary) artifacts in the source repository.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#binary-artifacts"}},{"name":"CII-Best-Practices","score":0,"reason":"no effort to earn an OpenSSF best practices badge detected","details":null,"documentation":{"short":"Determines if the project has an OpenSSF (formerly CII) Best Practices Badge.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#cii-best-practices"}},{"name":"Security-Policy","score":0,"reason":"security policy file not detected","details":["Warn: no security policy file detected","Warn: no security file to analyze","Warn: no security file to analyze","Warn: no security file to analyze"],"documentation":{"short":"Determines if the project has published a security policy.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#security-policy"}},{"name":"Fuzzing","score":0,"reason":"project is not fuzzed","details":["Warn: no fuzzer integrations found"],"documentation":{"short":"Determines if the project uses fuzzing.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#fuzzing"}},{"name":"License","score":10,"reason":"license file detected","details":["Info: project has a license file: LICENSE:0","Info: FSF or OSI recognized license: GNU General Public License v3.0: LICENSE:0"],"documentation":{"short":"Determines if the project has defined a license.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#license"}},{"name":"Signed-Releases","score":-1,"reason":"no releases found","details":null,"documentation":{"short":"Determines if the project cryptographically signs release artifacts.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#signed-releases"}},{"name":"Pinned-Dependencies","score":-1,"reason":"no dependencies found","details":null,"documentation":{"short":"Determines if the project has declared and pinned the dependencies of its build process.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#pinned-dependencies"}},{"name":"Branch-Protection","score":-1,"reason":"internal error: error during branchesHandler.setup: internal error: githubv4.Query: Resource not accessible by integration","details":null,"documentation":{"short":"Determines if the default and release branches are protected with GitHub's branch protection settings.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#branch-protection"}},{"name":"SAST","score":0,"reason":"SAST tool is not run on all commits -- score normalized to 0","details":["Warn: 0 commits out of 1 are checked with a SAST tool"],"documentation":{"short":"Determines if the project uses static code analysis.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#sast"}},{"name":"Vulnerabilities","score":5,"reason":"5 existing vulnerabilities detected","details":["Warn: Project is vulnerable to: GHSA-44cc-43rp-5947","Warn: Project is vulnerable to: GHSA-4m77-cmpx-vjc4","Warn: Project is vulnerable to: GHSA-9q39-rmj3-p4r2","Warn: Project is vulnerable to: PYSEC-2024-40 / GHSA-pwr2-4v36-6qpr","Warn: Project is vulnerable to: GHSA-g7vv-2v7x-gj9p"],"documentation":{"short":"Determines if the project has open, known unfixed vulnerabilities.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#vulnerabilities"}}]},"last_synced_at":"2025-08-21T12:07:22.505Z","repository_id":39007632,"created_at":"2025-08-21T12:07:22.505Z","updated_at":"2025-08-21T12:07:22.505Z"},"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":286080680,"owners_count":32009244,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2026-04-18T20:23:30.271Z","status":"online","status_checked_at":"2026-04-19T02:00:07.110Z","response_time":55,"last_error":null,"robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":true,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["bbbike","geofabrik","openstreetmap","openstreetmap-data","openstreetmap-protobuffer-format","osm","pbf","postgresql","protobuf-binary-format","protocol-buffer-binary-format","python","shapefile","shp"],"created_at":"2024-09-30T14:59:29.412Z","updated_at":"2026-04-19T14:09:35.627Z","avatar_url":"https://github.com/mikeqfu.png","language":"Python","funding_links":[],"categories":[],"sub_categories":[],"readme":"# PyDriosm\n\n*A Python package for downloading, reading and PostgreSQL-based I/O of OpenStreetMap data.*\n\n[![PyPI Release Version](https://img.shields.io/pypi/v/pydriosm)](https://pypi.org/project/pydriosm/) \n[![Python Version](https://img.shields.io/pypi/pyversions/pydriosm)](https://docs.python.org/3/)\n[![License](https://img.shields.io/github/license/mikeqfu/pydriosm)](https://github.com/mikeqfu/pydriosm/blob/master/LICENSE) \n[![ReadTheDocs Documentation](https://img.shields.io/readthedocs/pydriosm?logo=readthedocs)](https://pydriosm.readthedocs.io/en/latest/?badge=latest)\n[![GitHub Actions Workflow Status](https://img.shields.io/github/actions/workflow/status/mikeqfu/pydriosm/github-pages.yml?logo=github\u0026branch=master)](https://github.com/mikeqfu/pydriosm/actions)\n[![Codacy - Code Quality](https://app.codacy.com/project/badge/Grade/b411ce89cbc445f58377a5799646d4cb)](https://app.codacy.com/gh/mikeqfu/pydriosm/dashboard?utm_source=gh\u0026utm_medium=referral\u0026utm_content=\u0026utm_campaign=Badge_grade) \n[![DOI](https://img.shields.io/badge/10.5281%2Fzenodo.4281194-blue?label=doi)](https://doi.org/10.5281/zenodo.4281194)\n\n**PyDriosm** is an open-source Python package designed to simplify the acquisition and management of [OpenStreetMap](https://www.openstreetmap.org/) (OSM) data. It provides automated utilities for downloading and parsing data extracts from [Geofabrik](https://download.geofabrik.de/) and [BBBike](https://extract.bbbike.org/) in several popular formats, including [Protocolbuffer Binary Format](https://wiki.openstreetmap.org/wiki/PBF_Format) (PBF), [Shapefiles](https://wiki.openstreetmap.org/wiki/Shapefiles) and [GeoPackage](https://www.geopackage.org/) (GPKG).\n\nBeyond data retrieval, the package integrates a robust I/O interface for [PostgreSQL](https://www.postgresql.org/) databases. This allows users to import parsed OSM data directly into a relational database, facilitating complex spatial querying and efficient data manipulation. By handling the complexities of source scraping, file parsing and schema mapping, **pydriosm** provides a streamlined workflow for researchers and developers working with large-scale geographic datasets.\n\n### Core features:\n\n* **Automated downloads**: Direct access to Geofabrik and BBBike subregion extracts.\n* **Format support**: Parse regional data of PBF, Shapefiles and GeoPackage files into standard Pandas DataFrames or GeoDataFrames.\n* **PostgreSQL integration**: Streamlined geometry I/O for efficient database storage.\n* **Multi-region processing**: Tools for merging regional data layers into unified datasets.\n\n## Installation\n\nTo install the latest release of **pydriosm** from [PyPI](https://pypi.org/project/pydriosm/) via [pip](https://pip.pypa.io/en/stable/cli/pip/):\n\n```bash\n$ pip install --upgrade pydriosm\n```\n\nFor more information, see the [Installation](https://pydriosm.readthedocs.io/en/latest/installation.html). \n\n## Quick start\n\nFor a concise guide with practical examples, please check out the [Quick Start](https://pydriosm.readthedocs.io/en/latest/quick-start.html) tutorial, which demonstrates how to use **pydriosm** to download, parse and perform storage I/O operations on OSM data using a PostgreSQL database.\n\n## Documentation\n\nThe complete PyHelpers Documentation is available in [[HTML](https://pydriosm.readthedocs.io/en/latest/)\\] \\[[PDF](https://pydriosm.readthedocs.io/_/downloads/en/latest/pdf/)] formats. \n\nIt is hosted on [ReadTheDocs](https://readthedocs.org/projects/pydriosm/) and provides detailed examples, tutorials and comprehensive references to help users get the most out of **pydriosm**. \n\n## Cite as\n\nFu, Q. (2020). PyDriosm: An open-source tool for downloading, reading and PostgreSQL-based I/O of OpenStreetMap data. Zenodo. [doi:10.5281/zenodo.4281194](https://doi.org/10.5281/zenodo.4281194)\n\n```bibtex\n@software{qian_fu_pydriosm_4281194,\n  author    = {Fu, Qian},\n  title     = {{PyDriosm: An open-source tool for downloading, reading and PostgreSQL-based I/O of OpenStreetMap data}},\n  year      = {2020},\n  publisher = {Zenodo},\n  doi       = {10.5281/zenodo.4281194},\n  license   = {GPLv3},\n  url       = {https://github.com/mikeqfu/pydriosm}\n}\n```\n\n(Please also refer to the export options from [Zenodo](https://zenodo.org/search?q=parent.id%3A4281194\u0026f=allversions%3Atrue\u0026l=list\u0026p=1\u0026s=10\u0026sort=version) to reference the specific version of **pydriosm** as appropriate.)\n\n## License\n\n-   **PyDriosm** is licensed under [GNU General Public License v3.0](https://github.com/mikeqfu/pydriosm/blob/master/LICENSE) or later (GPLv3+). \n-   The free [OpenStreetMap](https://www.openstreetmap.org/) data, which is used for the development of **PyDriosm**, is licensed under the [Open Data Commons Open Database License](https://opendatacommons.org/licenses/odbl/) (ODbL) by the [OpenStreetMap Foundation](https://osmfoundation.org/) (OSMF).\n\n## Acknowledgement\n\nThe development of **pydriosm**, including the example code that demonstrates how to use the package, heavily relies on freely available [OpenStreetMap](https://www.openstreetmap.org/) data. The author would like to express sincere gratitude to all the [OpenStreetMap contributors](https://wiki.openstreetmap.org/wiki/Contributors) for their invaluable contributions in making this data accessible to the community.\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fmikeqfu%2Fpydriosm","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fmikeqfu%2Fpydriosm","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fmikeqfu%2Fpydriosm/lists"}