https://github.com/qreolq/data-analyser-microservice

This application receives data from Data generator service with Apache Kafka and stores it in MongoDB.
https://github.com/qreolq/data-analyser-microservice

apache-kafka cd-cd docker java kafka-consumer mongodb spring

Last synced: about 2 months ago
JSON representation

This application receives data from Data generator service with Apache Kafka and stores it in MongoDB.

• Host: GitHub
• URL: https://github.com/qreolq/data-analyser-microservice
• Owner: qReolq
• Created: 2023-12-02T16:50:49.000Z (about 1 year ago)
• Default Branch: master
• Last Pushed: 2024-01-10T17:09:34.000Z (almost 1 year ago)
• Last Synced: 2024-01-10T19:26:37.564Z (almost 1 year ago)
• Topics: apache-kafka, cd-cd, docker, java, kafka-consumer, mongodb, spring
• Language: Java
• Homepage:
• Size: 16.6 KB
• Stars: 0
• Watchers: 1
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

README

        
# Data analyser microservice

This application receives data from [Data generator service](https://github.com/qReolq/data-generator-microservice) with Apache Kafka and stores it in MongoDB.

Next, data is processed by [Data store service](https://github.com/qReolq/data-store-microservice).

### Technologies

Spring(Boot, JPA), Docker, MongoDB, Apache Kafka, CI/CD(Github actions)

### Environments

To start an application you need to pass variables to .env file.

- `KAFKA_BOOTSTRAP_SERVERS` - bootstrap server in Kafka

- `KAFKA_SUBSCRIBED_TOPICS` - kafka subscribed topics

- `MONGO_AUTHENTICATION_DATABASE` - mongoDB Authentication Database

- `MONGO_USERNAME` - username for MongoDB

- `MONGO_PASSWORD` - password for MongoDB

- `MONGO_DATABASE` - name of MongoDB

- `MONGO_PORT` - port of MongoDB

- `MONGO_HOST` - host of MongoDB

## Quick start

You can run all applications via docker-compose.yaml from docker folder.

Application is running on port 8082.

It contains all needed configs.

1. Clone this repo into folder.

```Bash

git clone https://github.com/qReolq/data-analyser-microservice.git

cd data-analyser-microservice/docker

```

2. Start docker compose

```Bash

docker compose up

```