https://github.com/Esri/gis-tools-for-hadoop

The GIS Tools for Hadoop are a collection of GIS tools for spatial analysis of big data.
https://github.com/Esri/gis-tools-for-hadoop

hadoop spatial-analysis

Last synced: 3 days ago
JSON representation

The GIS Tools for Hadoop are a collection of GIS tools for spatial analysis of big data.

• Host: GitHub
• URL: https://github.com/Esri/gis-tools-for-hadoop
• Owner: Esri
• License: apache-2.0
• Created: 2013-03-13T19:41:30.000Z (over 11 years ago)
• Default Branch: master
• Last Pushed: 2022-04-07T18:52:00.000Z (over 2 years ago)
• Last Synced: 2024-08-25T00:56:05.595Z (2 months ago)
• Topics: hadoop, spatial-analysis
• Homepage: http://esri.github.io/gis-tools-for-hadoop/
• Size: 18 MB
• Stars: 519
• Watchers: 105
• Forks: 255
• Open Issues: 21
• Metadata Files:
  • Readme: README.md
  • Contributing: CONTRIBUTING.md
  • License: license.txt

Awesome Lists containing this project

README

        
gis-tools-for-hadoop

====================

![2013 NYC Taxi data aggregated](https://github.com/Esri/gis-tools-for-hadoop/blob/master/header.PNG?raw=true)

The [__GIS Tools for Hadoop__](http://esri.github.io/gis-tools-for-hadoop/) are a collection of GIS tools that leverage 

the [Spatial Framework for Hadoop](https://github.com/Esri/spatial-framework-for-hadoop)

for spatial analysis of big data.  The tools make use of 

the [Geoprocessing Tools for Hadoop](https://github.com/Esri/geoprocessing-tools-for-hadoop) toolbox,

to provide access to the Hadoop system from the ArcGIS Geoprocessing environment. 

## What's New

* [Sample: direct use of Enclosed and Unenclosed Esri- and Geo- JSON InputFormats](samples/json-mr)

* Update: use updated non-deprecated names `EsriJsonSerDe` and `EnclosedEsriJsonInputFormat` in samples after having added support for GeoJSON

* [Tutorial: An Introduction for Beginners](https://github.com/Esri/gis-tools-for-hadoop/wiki/GIS-Tools-for-Hadoop-for-Beginners)

## Features

* Sample tools that demonstrate full stack implementations of all the resources provided to solve GIS problems 

using Hadoop

![GIS Tools Breakdown](http://esri.github.com/gis-tools-for-hadoop/images/gis-tools-breakdown.png)

**Resources for building custom tools**

* [Esri Geometry API Java](https://github.com/Esri/geometry-api-java) - Java geometry library for spatial data 

processing 

* [Spatial Framework for Hadoop](https://github.com/Esri/spatial-framework-for-hadoop) 

  * Java helper utilities for Hadoop developers

  * Hive spatial user-defined functions 

* [Geoprocessing Tools](https://github.com/Esri/geoprocessing-tools-for-hadoop) - ArcGIS Geoprocessing tools 

for Hadoop

## Instructions

Start out by navigating to [samples](https://github.com/Esri/gis-tools-for-hadoop/tree/master/samples) and 

following the instructions provided with each sample.[There are also tutorials](https://github.com/Esri/gis-tools-for-hadoop/wiki) for using the GP tools and aggregation methods.

## Requirements

Requirements will differ depending on the needs of each tool. At a minimum, you will need:

* Access to an [Apache Hadoop](http://hadoop.apache.org) cluster

* [ArcGIS for Desktop](http://www.esri.com/software/arcgis/arcgis-for-desktop) or 

[Server](http://www.esri.com/software/arcgis/arcgisserver) for geoprocessing and visualization

Other requirements may include:

* [Apache Hive](http://hive.apache.org/) in order to run Hive queries

* [Apache Oozie Workflow Scheduler](http://oozie.apache.org/) for workflow scheduling

Additional requirements will be spelled out by individual tools.

## Resources

* [GeoData Blog on the ArcGIS Blogs](http://blogs.esri.com/esri/arcgis/author/jonmurphy/)

* [Big Data Place on GeoNet](https://geonet.esri.com/groups/big-data)

* [ArcGIS Geodata Resource Center]( http://resources.arcgis.com/en/communities/geodata/)

* [ArcGIS Blog](http://blogs.esri.com/esri/arcgis/)

* [twitter@esri](http://twitter.com/esri)

## Issues

Find a bug or want to request a new feature?  Please let us know by submitting an issue.

## Contributing

Esri welcomes contributions from anyone and everyone. Please see our [guidelines for contributing](https://github.com/esri/contributing)

## Licensing

Copyright 2013-2019 Esri

Licensed under the Apache License, Version 2.0 (the "License");

you may not use this file except in compliance with the License.

You may obtain a copy of the License at:

   http://www.apache.org/licenses/LICENSE-2.0

Unless required by applicable law or agreed to in writing, software

distributed under the License is distributed on an "AS IS" BASIS,

WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.

See the License for the specific language governing permissions and

limitations under the License.

A copy of the license is available in the repository's 

[license.txt](https://raw.github.com/Esri/gis-tools-for-hadoop/master/license.txt) file.