https://github.com/mjunaidca/ai-mart-platform-session-code

https://github.com/mjunaidca/ai-mart-platform-session-code

Last synced: 10 days ago
JSON representation

• Host: GitHub
• URL: https://github.com/mjunaidca/ai-mart-platform-session-code
• Owner: mjunaidca
• Created: 2024-06-02T05:41:50.000Z (5 months ago)
• Default Branch: main
• Last Pushed: 2024-06-09T15:44:42.000Z (5 months ago)
• Last Synced: 2024-10-11T09:36:07.060Z (26 days ago)
• Language: Python
• Size: 111 KB
• Stars: 6
• Watchers: 1
• Forks: 6
• Open Issues: 0
• Metadata Files:
  • Readme: readme.md

Awesome Lists containing this project

README

        
# 02_kafka_messaging

### AIOKafkaProducer

AIOKafkaProducer is a high-level, asynchronous message producer.

Example of AIOKafkaProducer usage:

```

from aiokafka import AIOKafkaProducer

# Kafka Producer as a dependency

async def get_kafka_producer():

    producer = AIOKafkaProducer(bootstrap_servers='broker:19092')

    await producer.start()

    try:

        # Produce message

        await producer.send_and_wait("my_topic", b"Super message")

    finally:

        await producer.stop()

```

### AIOKafkaConsumer

AIOKafkaConsumer is a high-level, asynchronous message consumer. It interacts with the assigned Kafka Group Coordinator node to allow multiple consumers to load balance consumption of topics (requires kafka >= 0.9.0.0).

Example of AIOKafkaConsumer usage:

```

from aiokafka import AIOKafkaConsumer

import asyncio

async def consume_messages():

    consumer = AIOKafkaConsumer(

        'my_topic', 'my_other_topic',

        bootstrap_servers='localhost:9092',

        group_id="my-group")

    # Get cluster layout and join group `my-group`

    await consumer.start()

    try:

        # Consume messages

        async for msg in consumer:

            print("consumed: ", msg.topic, msg.partition, msg.offset,

                  msg.key, msg.value, msg.timestamp)

    finally:

        # Will leave consumer group; perform autocommit if enabled.

        await consumer.stop()

asyncio.create_task(consume_messages())

```

https://github.com/aio-libs/aiokafka