https://github.com/doitintl/banias

Opinionated serverless event analytics pipeline
https://github.com/doitintl/banias

analytics apache-beam bigdata dataflow golang

Last synced: 9 months ago
JSON representation

Opinionated serverless event analytics pipeline

• Host: GitHub
• URL: https://github.com/doitintl/banias
• Owner: doitintl
• License: mit
• Created: 2018-02-15T10:52:59.000Z (almost 8 years ago)
• Default Branch: master
• Last Pushed: 2023-04-14T17:41:53.000Z (almost 3 years ago)
• Last Synced: 2024-06-20T10:22:01.864Z (over 1 year ago)
• Topics: analytics, apache-beam, bigdata, dataflow, golang
• Language: Go
• Homepage: https://banias.io
• Size: 416 KB
• Stars: 43
• Watchers: 5
• Forks: 16
• Open Issues: 2
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

README

          
# Banias

![](banias-logo-lowres-trimmed.png)

[![License](https://img.shields.io/github/license/doitintl/banias.svg)](LICENSE) [![GitHub stars](https://img.shields.io/github/stars/doitintl/banias.svg?style=social&label=Stars&style=for-the-badge)](https://github.com/doitintl/banias) [![Build Status](https://secure.travis-ci.org/doitintl/banias.png?branch=master)](http://travis-ci.org/doitintl/banias)

[Blog Post](https://blog.doit-intl.com/say-goodbye-to-mixpanel-meet-banias-12e09fecc44a)

Banias (Arabic: بانياس الحولة‎; Hebrew: בניאס‬) is the Arabic and modern Hebrew name of an ancient site developed around a river once associated with the Greek god [Pan](https://www.wikiwand.com/en/Pan_(mythology)).

So, like the flow of the Banias, events are flowing into our system. So we decided to build a reference architecture and actual implementation of event analytics pipeline. You can take the code as it is and use it or use it a design reference.

Banias Architecture:

* API receiving the events data from the producers (e.g. web apps, mobile app or backend servers)

* The events are sent to Google Pub/Sub topic

* Apache Beam/Google Cloud Dataflow streams the events into BigQuery with or without mutations or agregations

![](Banias_Architecture.png)

## Installation

### [API Deployment](frontend/README.md)

### [Apache Beam/Google Cloud Dataflow Deployment](backend/README.md)