https://github.com/koopjs/koop-provider-hub-search
A Koop provider for querying against the ArcGIS Hub Search API.
https://github.com/koopjs/koop-provider-hub-search
Last synced: 8 days ago
JSON representation
A Koop provider for querying against the ArcGIS Hub Search API.
- Host: GitHub
- URL: https://github.com/koopjs/koop-provider-hub-search
- Owner: koopjs
- License: other
- Created: 2021-07-17T13:04:56.000Z (almost 4 years ago)
- Default Branch: main
- Last Pushed: 2025-03-28T22:46:27.000Z (25 days ago)
- Last Synced: 2025-04-15T00:51:56.564Z (8 days ago)
- Language: TypeScript
- Homepage:
- Size: 962 KB
- Stars: 1
- Watchers: 8
- Forks: 0
- Open Issues: 7
-
Metadata Files:
- Readme: README.md
- Changelog: CHANGELOG.md
- License: LICENSE
Awesome Lists containing this project
README
# ATTENTION: This plugin has been deprecated. Please use [Koop provider hub search ogc](https://github.com/koopjs/koop-provider-hub-search-ogc) instead.
# Koop Provider Hub Search
[![TypeScript version][ts-badge]][typescript-4-3]
[![Node.js version][nodejs-badge]][nodejs]
[![APLv2][license-badge]][license]
[![Build Status - GitHub Actions][gha-badge]][gha-ci]
This is a Koop provider that extracts datasets from the ArcGIS Hub Search API.
## Use - Streaming All Datasets
This provider plugin currently only supports [streaming](https://nodejs.org/api/stream.html#stream_readable_streams) ALL datasets matching a given search query. It performs searches using the [`searchContent`](https://esri.github.io/hub.js/api/search/searchContent/) function from [`@esri/hub.js`](https://esri.github.io/hub.js/) and requests all pages from the API in order.
### Define Search Parameters
To perform a search from an output plugin, attach an [`IContentSearchRequest`](https://esri.github.io/hub.js/api/search/IContentSearchRequest/) to the response.
```js
req.res.locals.searchRequest = {
options: {
site: 'my-site.hub.arcgis.com'
},
filter: {
term: 'some search terms'
}
};
```
#### Notes
A search request **must** be scoped to include at least one of the following:
- an "id" (`filter: { id: '' }`)
- at least one "group" (`filter: { group: [''] }`)
- an "orgid" (`filter: { orgid: '' }`)
- a "site" (`options: { site: '' }`)
If none of the above are provided, an error will be returned. **Importantly**, if only a site is provided, it is still possible for an error to be returned if the site does not have an organization or group specified as part of its catalog.
### Pull the Readable Stream
Then pass the request object to `this.model.pullStream`.
```js
const docStream = await this.model.pullStream(req);
```
### Full Example
What you have now is a Node.js `Readable` stream. You can pipe the datasets from the readable through a transform stream in order to format them into some other type of output before sending them back to the browser by piping them to the Express.js response. The following simple example also uses the [`through2`](https://www.npmjs.com/package/through2) library to conveniently define a transform stream.
```js
async handleRequest (req, res) {
req.res.locals.searchRequest = { /* some search params */ };
const docStream = await this.model.pullStream(req);
docStream
.pipe(through2.obj(function (dataset, enc, callback) {
const transformed = someTranformFunc(dataset);
// the Express.js "res" Writable only accepts strings or Buffers
this.push(JSON.stringify(transformed));
callback();
}))
.pipe(res);
}
```
## Develop
```sh
# clone and install dependencies
git clone https://github.com/koopjs/koop-output-dcat-ap-201
cd koop-output-dcat-ap-201
npm i
# starts the example Koop app found in ./example-app.
npm run dev
```
## Test
Run the `npm t` commmand to spin up the automated tests.
[ts-badge]: https://img.shields.io/badge/TypeScript-4.3-blue.svg
[nodejs-badge]: https://img.shields.io/badge/Node.js->=%2014.16-blue.svg
[nodejs]: https://nodejs.org/dist/latest-v14.x/docs/api/
[gha-badge]: https://github.com/koopjs/koop-provider-hub-search/actions/workflows/nodejs.yml/badge.svg
[gha-ci]: https://github.com/koopjs/koop-provider-hub-search/actions/workflows/nodejs.yml
[typescript]: https://www.typescriptlang.org/
[typescript-4-3]: https://www.typescriptlang.org/docs/handbook/release-notes/typescript-4-3.html
[license-badge]: https://img.shields.io/badge/license-APLv2-blue.svg
[license]: https://github.com/koopjs/koop-provider-hub-search/blob/main/LICENSE