An open API service indexing awesome lists of open source software.

https://github.com/regadas/trino-pubsub-event-listener

Trino Google Pub/Sub event listener
https://github.com/regadas/trino-pubsub-event-listener

google-cloud-platform trino trinodb

Last synced: about 2 months ago
JSON representation

Trino Google Pub/Sub event listener

Awesome Lists containing this project

README

        

# trino-pubsub-event-listener

## Overview

Trino Pub/Sub event listener is a plugin for [Trino](https://trino.io/) that allows you to send query events to Google Cloud Pub/Sub.

``` mermaid
graph LR
A(Trino) -- Query events --> B((Pub/Sub))
B --> C(HTTP)
B --> D(BigQuery)
B --> E(Apache Avro / GCS)
```

## Usage

To use this plugin you need to copy the distribution package to the Trino plugin (`/plugin/pubsub-event-listener/`) directory and configure the plugin.

### Configuration

Create `/etc/pubsub-event-listener.properties` with the following required parameters, e.g.:

```properties
event-listener.name=pubsub
pubsub-event-listener.log-created=false
pubsub-event-listener.log-completed=true
pubsub-event-listener.log-split=false
pubsub-event-listener.project-id=
pubsub-event-listener.topic-id=
pubsub-event-listener.message-format=
pubsub-event-listener.credentials-file= # optional
```

## Development

### Prerequisites

- Java 17
- Gradle
- `protoc` (Protobuf compiler)

### Build

```bash
./gradlew build
```

### Distribution package

```bash
./gradlew distTar
```