{"id":13505673,"url":"https://github.com/Esri/spatial-framework-for-hadoop","last_synced_at":"2025-03-30T00:31:21.024Z","repository":{"id":539354,"uuid":"7563814","full_name":"Esri/spatial-framework-for-hadoop","owner":"Esri","description":"The Spatial Framework for Hadoop allows developers and data scientists to use the Hadoop data processing system for spatial data analysis.","archived":false,"fork":false,"pushed_at":"2025-03-12T16:43:28.000Z","size":5678,"stargazers_count":370,"open_issues_count":23,"forks_count":159,"subscribers_count":74,"default_branch":"master","last_synced_at":"2025-03-12T17:36:42.152Z","etag":null,"topics":["data-management","spatial-analysis"],"latest_commit_sha":null,"homepage":"","language":"Java","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"apache-2.0","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/Esri.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":"CONTRIBUTING.md","funding":null,"license":"license.txt","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2013-01-11T17:25:28.000Z","updated_at":"2025-03-12T16:43:33.000Z","dependencies_parsed_at":"2024-06-21T17:30:04.121Z","dependency_job_id":"9c232dca-6101-4f35-ba66-98692f762f1c","html_url":"https://github.com/Esri/spatial-framework-for-hadoop","commit_stats":{"total_commits":328,"total_committers":15,"mean_commits":"21.866666666666667","dds":0.5731707317073171,"last_synced_commit":"7226df669cbfaaf1edbfac0461acd1af45e12b81"},"previous_names":[],"tags_count":8,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Esri%2Fspatial-framework-for-hadoop","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Esri%2Fspatial-framework-for-hadoop/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Esri%2Fspatial-framework-for-hadoop/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Esri%2Fspatial-framework-for-hadoop/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/Esri","download_url":"https://codeload.github.com/Esri/spatial-framework-for-hadoop/tar.gz/refs/heads/master","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":246262490,"owners_count":20749170,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["data-management","spatial-analysis"],"created_at":"2024-08-01T00:01:11.436Z","updated_at":"2025-03-30T00:31:16.008Z","avatar_url":"https://github.com/Esri.png","language":"Java","funding_links":[],"categories":["Spatial Analysis","Java","others","数据科学"],"sub_categories":[],"readme":"# spatial-framework-for-hadoop\n\nThe __Spatial Framework for Hadoop__ allows developers and data scientists to use the Hadoop data processing system \nfor spatial data analysis.\n\nFor tools, [samples](https://github.com/Esri/gis-tools-for-hadoop/tree/master/samples), and [tutorials](https://github.com/Esri/gis-tools-for-hadoop/wiki) that use this framework, head over \nto [GIS Tools for Hadoop](https://github.com/Esri/gis-tools-for-hadoop).\n\n## What's New\n\n* Hive v4 compatibility (as of Y2023).\n* ST_Centroid now returns the geometry centroid rather than the center of its envelope (as of v2.1).\n\n## Features\n\n* **[JSON Utilities](https://github.com/Esri/spatial-framework-for-hadoop/wiki/JSON-Utilities)** -\n  Utilities for interacting with JSON exported from ArcGIS\n  - [Javadoc](http://esri.github.io/spatial-framework-for-hadoop/json/)\n* **[Hive Spatial](https://github.com/Esri/spatial-framework-for-hadoop/wiki/Hive-Spatial)** -\n  User-Defined Functions and SerDes for spatial analysis in Hive and SparkSQL\n  - [UDF Documentation](https://github.com/Esri/spatial-framework-for-hadoop/wiki/UDF-Documentation)\n  - [JSON SerDe](https://github.com/Esri/spatial-framework-for-hadoop/wiki/Hive-JSON-SerDe)\n\n## Getting Started\n\n### Pre-Built\n\nUp-to-date releases may be available [on Github](https://github.com/Esri/spatial-framework-for-hadoop/releases) but\n[may not be on Maven Central](https://github.com/Esri/spatial-framework-for-hadoop/issues/123).\n\n### Maven\n\nBuild as you would any other Mavenized repository.  All dependencies are pulled automatically. \n\n### Ant\n\nAnt build files are also available,\nbut are considered legacy, and may likely be removed in a future release.\n\nAt the root level of this repository, you can build a single jar with everything in the framework \nusing [Apache Ant](http://ant.apache.org/).  Alternatively, you can build a jar at the root level of each \nframework component (i.e., `hive/build.xml`).\n\nThe build files use [Maven Ant Tasks](http://maven.apache.org/ant-tasks/download.html) for dependency \nmanagement. You will need the jar in a place Ant can find it (i.e., `~/.ant/lib/maven-ant-tasks-2.1.3.jar`).\n\n\n## Dependencies\n\n* [Esri Geometry API for Java](https://github.com/Esri/geometry-api-java) - Java geometry library for spatial data \nprocessing.\n\n## Requirements\n\n* Geometry v2.2\n* Hive v1 and above or SparkSQL ([compatibility details](https://github.com/Esri/spatial-framework-for-hadoop/wiki/ST_Geometry-for-Hive-Compatibility-with-Hive-Versions))\n* Hadoop v2 and above\n* Workflows calling MapReduce jobs require the location of the custom job to be run.\n* Custom MapReduce jobs that use the Esri Geometry API require that the developer has authored the job, \n  (referencing the com.esri.geometry.\\* classes), and deployed the job Jar file to the Hadoop system,\n  prior to the ArcGIS user submitting the workflow file. \n* System administrators should always deploy an appropriate version of dependencies into production,\n  that include important and especially security patches,\n  even if a JAR file has been built with a lower version.\n\n\n## Resources\n\n* [GeoData Blog on the ArcGIS Blogs](http://blogs.esri.com/esri/arcgis/author/jonmurphy/)\n* [Big Data Place on GeoNet](https://geonet.esri.com/groups/big-data)\n* [ArcGIS Geodata Resource Center](http://resources.arcgis.com/en/communities/geodata/)\n* [ArcGIS Blog](http://blogs.esri.com/esri/arcgis/)\n* [twitter@esri](http://twitter.com/esri)\n\n\n## Issues\n\nFind a bug or want to request a new feature?  Please let us know by submitting an [issue](https://github.com/Esri/spatial-framework-for-hadoop/issues).\n\n## Contributing\n\nEsri welcomes contributions from anyone and everyone. Please see our [guidelines for contributing](https://github.com/esri/contributing).\n\n## Licensing\nCopyright 2013-2024 Esri\n\nLicensed under the Apache License, Version 2.0 (the \"License\");\nyou may not use this file except in compliance with the License.\nYou may obtain a copy of the License at\n\n   http://www.apache.org/licenses/LICENSE-2.0\n\nUnless required by applicable law or agreed to in writing, software\ndistributed under the License is distributed on an \"AS IS\" BASIS,\nWITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.\nSee the License for the specific language governing permissions and\nlimitations under the License.\n\nA copy of the license is available in the \nrepository's [license.txt](https://raw.github.com/Esri/spatial-framework-for-hadoop/master/license.txt) file.\n\n\n## See Also\n\n* [Apache Sedona](https://github.com/apache/incubator-sedona/)\n* [ArcGIS GeoAnalytics Engine](https://developers.arcgis.com/geoanalytics/)\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2FEsri%2Fspatial-framework-for-hadoop","html_url":"https://awesome.ecosyste.ms/projects/github.com%2FEsri%2Fspatial-framework-for-hadoop","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2FEsri%2Fspatial-framework-for-hadoop/lists"}