{"id":17356716,"url":"https://github.com/frett27/osmimport","last_synced_at":"2025-07-05T14:33:12.604Z","repository":{"id":22119672,"uuid":"25450282","full_name":"frett27/OSMImport","owner":"frett27","description":"Simple and efficient java Tools for importing OSM (OpenStreetMap) datas in ESRI File Geodatabases, Avro and CSV","archived":false,"fork":false,"pushed_at":"2019-03-08T19:50:59.000Z","size":2173,"stargazers_count":5,"open_issues_count":4,"forks_count":3,"subscribers_count":3,"default_branch":"master","last_synced_at":"2025-04-15T00:08:37.626Z","etag":null,"topics":["bigdata","csv","fgdb","gis","import","openstreetmap","pbf","tool"],"latest_commit_sha":null,"homepage":"","language":"Java","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/frett27.png","metadata":{"files":{"readme":"README.md","changelog":"ChangeLog.md","contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null}},"created_at":"2014-10-20T04:06:05.000Z","updated_at":"2019-03-09T07:23:25.000Z","dependencies_parsed_at":"2022-08-20T20:40:42.288Z","dependency_job_id":null,"html_url":"https://github.com/frett27/OSMImport","commit_stats":null,"previous_names":[],"tags_count":14,"template":false,"template_full_name":null,"purl":"pkg:github/frett27/OSMImport","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/frett27%2FOSMImport","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/frett27%2FOSMImport/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/frett27%2FOSMImport/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/frett27%2FOSMImport/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/frett27","download_url":"https://codeload.github.com/frett27/OSMImport/tar.gz/refs/heads/master","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/frett27%2FOSMImport/sbom","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":263755657,"owners_count":23506431,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["bigdata","csv","fgdb","gis","import","openstreetmap","pbf","tool"],"created_at":"2024-10-15T18:58:11.285Z","updated_at":"2025-07-05T14:33:12.564Z","avatar_url":"https://github.com/frett27.png","language":"Java","funding_links":[],"categories":[],"sub_categories":[],"readme":"\nOSMImport\n=========\n\n_Patrice Freydiere - 2015 - 2016 - 2017_\n\n---\n\n\n![](https://travis-ci.org/frett27/OSMImport.svg?branch=master)\n\n\nYet An Other OSM Import Tools for OSM data - [Change Log](ChangeLog.md)\n\nThis project aim to provide a simple **command line**  for ingesting OSM Data in a GIS.\n\nThe output result are tables or featureclasses inside one or multiple output FileGeodatabase (ready to use in GIS software). CSV output files are also supported since 0.6 version, allowing to have a smooth BigData shift.\n\nThis tools is currently used on Windows (x64) and Linux (x64). \n\nFor performances or filtering capability, see [architecture](doc/architecture/architecture.md) and [doc](doc) folder\n\n# Features\n\n- **PBF / XML / OSM / AVRO / CSV Big Data Folder Input** input file support\n- **FileGeodatabase Output**, that can be natively read by ArcGIS Desktop or QGIS\n- **Create CSV text files in a folder** for Hadoop/Big stacks\n- **Simple declarative groovy transformation script** \n- **Way reconstruction**, **Polygon reconstruction** for PBF / XML input file\n- **Scripts are Easy to share and maintain** (a single human readable .script file), see [scripts](scripts) folder\n- You can use any third party using **Groovy** or **Java ** language in scripts, for filtering and transformations.\n- **Multiple destinations output on one run** (ability to merge import scripts)\n- Automatic **RAM memory management** (manage the RAM consumption)\n\n\n\n\n**Windows** / **Linux** friendly \n\n\n\n# Usage context - known usage\n\n- A minimum of 5go of RAM is necessary for a first load\n- Nota : RAM is used for processing complete ways and polygons, if RAM is not available, subsequent input file read are going to be done and will lead to decrease performances.\n\n\n- A typical 32 Gb or RAM permit to handle France territory in a very nice timeframe. (please give us your benchmarks feedbacks and configurations). Special tuning could be done for an optimized process. (message regularisation limites, depending on the available memory).\n\n- The tool currenlty **only support WGS84 coordinate system** as the osm datas use this coordinate system and it is quite easy to reproject thoses in an other coordinate system afterward.\n\n- for huge integration (more than 1gb of PBF), or less that 2h country integration, consider using the `osm-flink-tools` to preprocess the input file, this is MUCH FASTER. This is done for avro prepared files\n\n  ​\n\n\n# Benchmarks\n\ntest it :-), we got lots of fast feedback for planet extract / transforms.\n\n\n\n# PBF / OSM - Data Files\n\nOpenstreet france provide OSM extracts at this location : http://download.openstreetmap.fr/extracts/\n\n\n\n# AVRO - Data Files\n\nPrepared avro data files are available at this url : https://s3-eu-west-1.amazonaws.com/avroosm/index.html\n\n\n\n# Download and install - Next actions\n\nTake a tour at [5 mins setup guide](doc/QuickStart.md) to launch your first command line.\n\n[Existing Scripts folder](scripts) contains a bunch of existing scripts for already configured OSM transformation and filtering\n\nIf you want to go further and customize the scripts, see [How to write Scripts](doc/WritingAScript.md). It explain how to customize or configure your scripts for your usage.\n\nother documentations can be found in the [doc](doc) folder\n\ndon't hesitate to send pull requests or comments.\n\n# Sample scripts :\n\n- [Buildings](scripts/buildings.groovy) - extract buildings\n- [Streets](scripts/streets.groovy) - extract streets\n\n\n# Contributions\n\nContributions are welcome on :\n\n- documentation\n- scripts\n- code\n- enhancements\n- ...\n\n\n# Version 1.0 roadmap plan\n\n- \u003cstrike\u003ehandling relationships\u003c/strike\u003e\n- \u003cstrike\u003ehandling polygons\u003c/strike\u003e\n- \u003cstrike\u003etables support\u003c/strike\u003e\n- \u003cstrike\u003ecsv text files support\u003c/strike\u003e\n- \u003cstrike\u003eWork on simplify the writing of scripts\u003c/strike\u003e\n- \u003cstrike\u003efix erroneous polygon reconstruction\u003c/strike\u003e\n- propose a sample script gallery for common operations\n- error logs, and feedbacks\n- clean logs\n- extend fields type to Date (supported fields: integer, string, long, floats)\n\n\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Ffrett27%2Fosmimport","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Ffrett27%2Fosmimport","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Ffrett27%2Fosmimport/lists"}