Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/googlearchive/pubsubbeat
An Elastic Beat to ingest data from Google Pub/Sub
https://github.com/googlearchive/pubsubbeat
beats elastic elasticbeats elasticsearch google-cloud-platform pubsub
Last synced: 3 months ago
JSON representation
An Elastic Beat to ingest data from Google Pub/Sub
- Host: GitHub
- URL: https://github.com/googlearchive/pubsubbeat
- Owner: googlearchive
- License: other
- Archived: true
- Created: 2018-04-02T17:38:28.000Z (over 6 years ago)
- Default Branch: master
- Last Pushed: 2020-06-19T15:03:34.000Z (over 4 years ago)
- Last Synced: 2024-09-22T23:05:30.084Z (3 months ago)
- Topics: beats, elastic, elasticbeats, elasticsearch, google-cloud-platform, pubsub
- Language: Go
- Homepage:
- Size: 20.6 MB
- Stars: 41
- Watchers: 12
- Forks: 23
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- Contributing: CONTRIBUTING.md
- License: LICENSE
Awesome Lists containing this project
README
# Status: Archived
This project is no longer actively maintained by Google.
* GitLab hosts a fork at: https://gitlab.com/gitlab-org/pubsubbeat
* For other assistance, please reach out to the [Google Open Source Programs Office](mailto:[email protected]).
------------
# Pubsubbeat
Pubsubbeat is an elastic [Beat](https://www.elastic.co/products/beats) for [Google Cloud Pub/Sub](https://cloud.google.com/pubsub/).
This Beat subscribes to a topic and ingest messages.
The main motivation behind the development of this plugin is to ingest [Stackdriver Logs](https://cloud.google.com/stackdriver/)
via the [Exported Logs](https://cloud.google.com/logging/docs/export/using_exported_logs) feature and send them
directly to Elasticsearch ingest nodes.
This is not an officially supported Google product.
## Getting Started with Pubsubbeat
### Requirements
* [Golang](https://golang.org/dl/) 1.12
### Build
To build the binary for Pubsubbeat run the command below. This will generate a binary
in the same directory with the name pubsubbeat.
```
make
```
### Run
To run Pubsubbeat with debugging output enabled, run:
```
./pubsubbeat -c pubsubbeat.yml -e -d "*"
```
### Test
To test Pubsubbeat, run the following command:
```
make test
```
### Cleanup
To clean Pubsubbeat source code, run the following commands:
```
make pre-commit
```
To clean up the build directory and generated artifacts, run:
```
make clean
```
## Packaging
To build releases for available platforms:
```
make release
```
This will fetch and create binaries for all Linux, Windows and OSX