https://github.com/parikls/asyncio-red
Powers yours microservices with event driven approach using Redis as a backend.
https://github.com/parikls/asyncio-red
async-event-bus asyncio event-driven event-driven-architecture event-driven-microservices eventbus events events-management microservice microservice-framework microservices microservices-architecture python python-async python-asyncio python3 redis redis-channels redis-list redis-streams
Last synced: 2 months ago
JSON representation
Powers yours microservices with event driven approach using Redis as a backend.
- Host: GitHub
- URL: https://github.com/parikls/asyncio-red
- Owner: parikls
- Created: 2022-01-06T11:36:43.000Z (over 3 years ago)
- Default Branch: master
- Last Pushed: 2025-01-05T11:29:01.000Z (6 months ago)
- Last Synced: 2025-03-24T20:13:40.003Z (3 months ago)
- Topics: async-event-bus, asyncio, event-driven, event-driven-architecture, event-driven-microservices, eventbus, events, events-management, microservice, microservice-framework, microservices, microservices-architecture, python, python-async, python-asyncio, python3, redis, redis-channels, redis-list, redis-streams
- Language: Python
- Homepage: https://parikls.github.io/asyncio-red/
- Size: 77.1 KB
- Stars: 1
- Watchers: 1
- Forks: 1
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- Changelog: CHANGELOG.md
Awesome Lists containing this project
README
asyncio-RED (Redis Event Driven)
================================
Powers your microservices with event driven approach using redis as a backend.
Support both publishing and subscribing using lists, channels and streams.
`pydantic` is being used for events validation.
`s3` can be used for sharing event schemas between services.
Installation
------------
- `pip install asyncio-red`
Simple producer
---------------
```python
from redis.asyncio import Redis
from asyncio_red import RED, Via, BaseEvent
from pydantic import Field
class EventV1List(BaseEvent):
key: str = Field(..., title='Key description')
class EventV1Channel(BaseEvent):
key: str = Field(..., title='Key description')
class EventV1Stream(BaseEvent):
key: str = Field(..., title='Key description')
redis_client = Redis()
red = RED(app_name=str('service_1'), redis_client=redis_client)
red.add_out(
event=EventV1List,
via=Via.LIST,
target_name='events_list'
)
red.add_out(
event=EventV1Channel,
via=Via.CHANNELS,
target_name='events_channel'
)
red.add_out(
event=EventV1Stream,
via=Via.STREAMS,
target_name='events_stream'
)
async def your_awesome_function():
# dispatch events
await EventV1List(key='value').dispatch() # this one will be put to a list
await EventV1Channel(key='value').dispatch() # this one will be pushed to a channel
await EventV1Stream(key='value').dispatch() # this one will be pushed to a stream
```
Simple consumer
--------------
```python
from redis.asyncio import Redis
from asyncio_red import RED, Via, BaseEvent
from pydantic import Field
class EventV1List(BaseEvent):
key: str = Field(..., title='Key description')
class EventV1Channel(BaseEvent):
key: str = Field(..., title='Key description')
class EventV1Stream(BaseEvent):
key: str = Field(..., title='Key description')
redis_client = Redis()
red = RED(app_name=str('service_2'), redis_client=redis_client)
async def event_handler(event):
print(event)
red.add_in(
event=EventV1List,
via=Via.LIST,
handlers=(event_handler, ),
list_name="events_list",
)
red.add_in(
event=EventV1Channel,
via=Via.CHANNELS,
handlers=(event_handler, ),
error_handler=event_handler,
channel_name="events_channel"
)
red.add_in(
event=EventV1Stream,
via=Via.STREAMS,
handlers=(event_handler, event_handler),
stream_name="events_stream",
group_name="events_group",
consumer_name="consumer_name"
)
await red.run()
```
Shared events registry
----------------------
There is a possibility to keep event schemas registry on the S3 and share the schema across
different services. You'll need an AWS account and keys with access to S3.
- Go to app root dir and initialize asyncio-red:
```shell
asyncio_red init --app-name= --s3-bucket=
```
This will create an initial structure.
Define your events at `red/registry/.py`:
```python
from pydantic import Field
from asyncio_red.events import BaseEvent
class EventV1List(BaseEvent):
key: str = Field(..., title='Key description')
class EventV1Channel(BaseEvent):
key: str = Field(..., title='Key description')
class EventV1Stream(BaseEvent):
key: str = Field(..., title='Key description')
```
- push application events schemas to a registry: `asyncio-red push`
- on a different service you can pull shared schemas - do the same steps, e.g. init structure and run `asyncio-red pull`