https://github.com/iwpnd/geo-stream-kafka

producer and consumer FastAPI endpoints to handle incoming geo data
https://github.com/iwpnd/geo-stream-kafka

apache fastapi geodata kafka leaflet leafletjs websockets

Last synced: 3 months ago
JSON representation

producer and consumer FastAPI endpoints to handle incoming geo data

• Host: GitHub
• URL: https://github.com/iwpnd/geo-stream-kafka
• Owner: iwpnd
• License: mit
• Created: 2020-03-04T14:52:46.000Z (almost 5 years ago)
• Default Branch: master
• Last Pushed: 2020-03-17T06:31:06.000Z (almost 5 years ago)
• Last Synced: 2023-03-03T20:13:19.884Z (almost 2 years ago)
• Topics: apache, fastapi, geodata, kafka, leaflet, leafletjs, websockets
• Language: Python
• Size: 2.86 MB
• Stars: 57
• Watchers: 5
• Forks: 15
• Open Issues: 0
• Metadata Files:
  • Readme: readme.md
  • License: LICENSE

Awesome Lists containing this project

README

        
# geo-stream-kafka













see [blogpost](https://iwpnd.pw/articles/2020-03/apache-kafka-fastapi-geostream) for a more detailed description

```bash

docker-compose up -d

```

If you're on MacOS set an environment variable like:

```bash

export DOCKER_KAFKA_HOST=$(ipconfig getifaddr en0)

```

that is afterwards used in `docker-compose.yml` to identify the `KAFKA_ADVERTISED_HOST_NAME`. Some similar workaround has to exist for Windows users.

For linux I assume you can just set it to `localhost` if you're only running on Kafka node. See [github.com/wurstmeister/kafka-docker/wiki/Connectivity](https://github.com/wurstmeister/kafka-docker/wiki/Connectivity).

## Kafka

Kafka will be served on `localhost:9092`

## Frontend

open `/geostream/frontend/app/index.html` and associated `map.js` will consume messages when they come in

## Producer

can produce messages to a topic at `localhost:8002/producer/`

## Consumer

can consume kafka messages through at `localhost:8003/consumer/`