https://github.com/atolcd/hop-gis-plugins
🗺 GIS plugins for Apache Hop Orchestration Platform
https://github.com/atolcd/hop-gis-plugins
data dxf etl geojson geopackage gis gpx hop java mif-mid shp spatialite
Last synced: 11 days ago
JSON representation
🗺 GIS plugins for Apache Hop Orchestration Platform
- Host: GitHub
- URL: https://github.com/atolcd/hop-gis-plugins
- Owner: atolcd
- License: lgpl-3.0
- Created: 2021-07-21T08:13:52.000Z (over 4 years ago)
- Default Branch: master
- Last Pushed: 2025-11-26T09:37:28.000Z (2 months ago)
- Last Synced: 2025-11-29T08:47:44.125Z (2 months ago)
- Topics: data, dxf, etl, geojson, geopackage, gis, gpx, hop, java, mif-mid, shp, spatialite
- Language: Java
- Homepage: https://www.atolcd.com/expertise/solutions-geographiques-open-source-sig
- Size: 5.76 MB
- Stars: 19
- Watchers: 8
- Forks: 11
- Open Issues: 10
-
Metadata Files:
- Readme: README.md
- Contributing: CONTRIBUTING.md
- License: LICENSE.txt
- Code of conduct: CODE_OF_CONDUCT.md
Awesome Lists containing this project
README
Apache Hop GIS Plugins
================================
This project allows you to manage GIS data in Apache Hop, [Hop Orchestration Platform](https://hop.apache.org/). It is a counterpart of [Pentaho Data Integrator GIS Plugins](https://github.com/atolcd/pentaho-gis-plugins).
Tested with Apache Hop `2.14.0`.
Building the plugins
-------------------
Check out the project if you have not already done so (with `git` installed):
```sh
git clone git://github.com/atolcd/hop-gis-plugins.git
cd hop-gis-plugins
```
Run the following commands from the base project directory (with `java 17` and `maven` installed):
```sh
mvn clean package
```
Or with Docker (you need `docker`) :
```sh
docker run --network="host" --rm \
--name hop-gis-plugins-builder \
-u $(id -u):$(id -g) \
-v "$(pwd)":/app -w /app \
-v ~/.m2:/var/maven/.m2 -v "${HOME}":/var/maven \
-e HOME=/var/maven -e MAVEN_CONFIG=/var/maven/.m2 -e MAVEN_OPTS="-Duser.home=/var/maven" \
\
maven:3-eclipse-temurin-17 \
\
mvn clean package
```
The built package is `assemblies/target/gis-plugin-assemblies-X.X.X.zip` (version comes from the main `pom.xml`).
Installing/upgrading the module
---------------------
***Method 1 : Manual installation***
Extract the content of `gis-plugin-assemblies-X.X.X.zip` in `${HOP_HOME}/plugins`.
Examples of extraction from the root directory of the project :
```sh
GIS_PLUGINS_VERSION="1.4.0"
# Use compiled version...
GIS_PLUGINS_ASSEMBLY="assemblies/target/gis-plugin-assemblies-${GIS_PLUGINS_VERSION}.zip"
# ... Or download a prepared one (must exist :)
wget https://github.com/atolcd/hop-gis-plugins/releases/download/v${GIS_PLUGINS_VERSION}/gis-plugin-assemblies-${GIS_PLUGINS_VERSION}.zip
GIS_PLUGINS_ASSEMBLY="gis-plugin-assemblies-${GIS_PLUGINS_VERSION}.zip"
# Unzip it ate the right place !
unzip ${GIS_PLUGINS_ASSEMBLY} -d ${HOP_HOME}/plugins/
```
To upgrade the plugins, delete files you added before and start a fresh installation.
***Oracle JDBC usage***
Note: This needs rechecking — the `Injection of a Shapefile to Oracle Spatial` test pipeline in [examples](examples/README.md#injection-of-a-shapefile-to-oracle-spatial) currently fails.
If you plan to connect to an Oracle database, add needed jars in `lib/jdbc` folder of Hop :
- `${HOP_HOME}/lib/jdbc/ojdbc11.jar`
- `${HOP_HOME}/lib/jdbc/orai18n.jar`
You can get them from [oracle](http://www.oracle.com/technetwork/apps-tech/jdbc-112010-090769.html
) or [maven repositories](https://repo1.maven.org/maven2/com/oracle/database/jdbc/).
Building a docker image
---------------------
See [dedicated page](docker/README.md)
Testing the plugins
---------------------
See [dedicated page](examples/README.md)
Using the plugins
---------------------
See [dedicated page](docs/README.md)
You will find new elements in *Geospatial*'s directory :
- Geospatial Group by
- GIS File output
- GIS File input
- Geoprocessing
- Geometry information
- Coordinate system operation
- Spatial relationship and proximity
With a french locale :
Code formatting
---------------------
The java code for this project conforms to [Google's code styleguide](https://google.github.io/styleguide/javaguide.html).
The `spotless` maven plugin deals with this aspect:
```sh
# Formatting check
mvn spotless:check
# Formatting (to be done before any commit)
mvn spotless:apply
```
Debugging
---------------------
You can debug plugins remotely in Hop GUI:
```sh
# Set debugging options (or uncomment appropriate line in hop-gui.sh to keep it active)
export HOP_OPTIONS="-Xmx2048m -Xdebug -Xnoagent -Djava.compiler=NONE -Xrunjdwp:transport=dt_socket,server=y,suspend=n,address=5005"
# Launch Hop Gui as usual
./hop-gui.sh
```
You will see a message like `Listening for transport dt_socket at address: 5005` in your terminal.
Next, attach the debugger in your favorite IDE. Example `launch.json` in Visual Studio Code with [Debugger for Java](https://marketplace.visualstudio.com/items?itemName=vscjava.vscode-java-debug) extension:
```sh
{
"version": "0.2.0",
"configurations": [
{
"type": "java",
"name": "Attach java debugger",
"projectName": "hop-gis-plugins",
"request": "attach",
"hostName": "localhost",
"port": 5005
}
]
}
```
You are now able to inspect variables values at breakpoints you have set, analyse call stack and so.
Contributing
---------------------
See [dedicated page](CONTRIBUTING.md)
LICENSE
---------------------
This extension is licensed under `GNU Library or "Lesser" General Public License (LGPL)`.
Contributors :
* [Bart Maertens](https://github.com/bamaer) compatibility/version upgrades and cleaning
* [Marc Lherbette](https://github.com/scali) examples and metadata
* [Matt Casters](https://github.com/mattcasters) review, cleanup, metadata
* [Jérémy Tridard](https://github.com/jtridard) rewrite [pentaho-gis-plugins](https://github.com/atolcd/pentaho-gis-plugins) for hop
* [Charles-Henry Vagner](https://github.com/cvagner) doc, init qa, dockerization and industrialization
* [Cédric Darbon](https://twitter.com/cedricdarbon) first dev of [pentaho-gis-plugins](https://github.com/atolcd/pentaho-gis-plugins)
Our company
---------------------
[Atol Conseils et Développements](http://www.atolcd.com)
Follow us on twitter [@atolcd](https://twitter.com/atolcd)