https://github.com/plantnet/staplus-data-loader

Load Pl@ntNet observations data into FrostServer, using SensorThings format with STAplus extension
https://github.com/plantnet/staplus-data-loader

Last synced: 4 months ago
JSON representation

Load Pl@ntNet observations data into FrostServer, using SensorThings format with STAplus extension

• Host: GitHub
• URL: https://github.com/plantnet/staplus-data-loader
• Owner: plantnet
• License: gpl-3.0
• Created: 2022-03-18T14:48:00.000Z (about 3 years ago)
• Default Branch: main
• Last Pushed: 2022-04-06T14:07:33.000Z (about 3 years ago)
• Last Synced: 2024-12-29T05:42:20.608Z (5 months ago)
• Language: JavaScript
• Size: 113 KB
• Stars: 1
• Watchers: 5
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

README

        
# Pl@ntNet to FrostServer-STAPLUS data loader

Loads Pl@ntNet observations into FrostServer-STAPLUS for "Pl@ntNet data as a service"

Requires a running ArangoDB server having Pl@ntNet `observations` collection

## install

see [install FrostServer-STAPLUS](./install_FrostServer_STAPLUS.md)

## usage

copy `env.example.json` to `env.json`, adjust conf

### load PN obs into FrostServer

adjust `startKey`, `pageSize`, `limit` in file `load_obs.js`

then

```sh

nodejs load_obs.js

```

### admin script

```sh

nodejs admin.js

```

## test

```sh

npm test

```

## stats

2022-03-18 :

 * `load_obs.js` : **125k obs/h** writing to HTTP API

 * **1 Go per 200k obs** in PostgreSQL

 * **14 tuples per obs** in PostgreSQL