https://github.com/benhid/benthos-iot

IoT Data Pipeline with Benthos
https://github.com/benhid/benthos-iot

benthos iot processing-pipeline

Last synced: 5 months ago
JSON representation

IoT Data Pipeline with Benthos

• Host: GitHub
• URL: https://github.com/benhid/benthos-iot
• Owner: benhid
• Created: 2024-02-08T12:46:19.000Z (over 2 years ago)
• Default Branch: main
• Last Pushed: 2024-02-08T12:50:27.000Z (over 2 years ago)
• Last Synced: 2025-09-09T14:48:00.755Z (9 months ago)
• Topics: benthos, iot, processing-pipeline
• Homepage:
• Size: 2.93 KB
• Stars: 0
• Watchers: 1
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

README

          
# IoT Data Pipeline with Benthos

A Benthos pipeline that reads IoT data from any source and writes it to a Clickhouse database.

## Setup

Run Clickhouse with Docker:

```console

docker run --rm -p 18123:8123 -p 19000:9000 -e CLICKHOUSE_DB=foodatabase --name some-clickhouse-server clickhouse/clickhouse-server

```

The `config.yaml` file contains the configuration for the pipeline. Run it with [Benthos](https://www.benthos.dev) using the following command:

```console

benthos -c config.yaml

```

## Testing

You can test the processing pipeline using Benthos itself:

```console

benthos test config_benthos_test.yaml

```