https://github.com/application-research/edge-vertex
https://github.com/application-research/edge-vertex
Last synced: 24 days ago
JSON representation
- Host: GitHub
- URL: https://github.com/application-research/edge-vertex
- Owner: application-research
- Created: 2023-06-28T01:56:32.000Z (almost 3 years ago)
- Default Branch: main
- Last Pushed: 2023-07-15T01:05:40.000Z (almost 3 years ago)
- Last Synced: 2025-03-19T08:49:21.579Z (about 1 year ago)
- Language: Go
- Size: 21.5 KB
- Stars: 0
- Watchers: 1
- Forks: 0
- Open Issues: 1
-
Metadata Files:
- Readme: readme.md
Awesome Lists containing this project
README
# Edge-Vertex
Edge-URID aggregator
It runs as a daemon, queries a list of `edge-urid` instances and pushes their contents into DDM for deal management
## Setup
1. specify an `edge.json` file containing a list of the edge URIs to be aggregated into ddm
ex)
```json
[
"https://dev-hivemapper.edge.estuary.tech",
"https://dev-site2.edge.estuary.tech"
]
```
> Note: This file can be edited at any time to add or remove edge URIs, a daemon restart is not required
2. run edge-vertex and provide env vars or flags so it can access DDM api
```bash
edge-vertex daemon \
--ddm-api https://delta-dm.estuary.tech \
--ddm-token \
--interval 60 \ # optional, defaults to 60 seconds
--edge-file edge.json \ # optional, defaults to edge.json
--debug # optional, more verbose logging
```
3. Check `log output` for log output if anything fails
## DDM Set-Up
- Tag that is present on `edge` must also exist as a `dataset name` in DDM, otherwise it will simply not add the content
- untagged content is not supported yet