https://github.com/atomotic/airtable-cdc-kafka

A CDC (Change data capture) for Airtable into Kafka.
https://github.com/atomotic/airtable-cdc-kafka

airtable airtable-api cdc kafka

Last synced: 3 months ago
JSON representation

A CDC (Change data capture) for Airtable into Kafka.

• Host: GitHub
• URL: https://github.com/atomotic/airtable-cdc-kafka
• Owner: atomotic
• Created: 2020-12-27T19:20:17.000Z (over 5 years ago)
• Default Branch: main
• Last Pushed: 2021-01-05T10:32:21.000Z (over 5 years ago)
• Last Synced: 2025-02-23T14:17:48.379Z (over 1 year ago)
• Topics: airtable, airtable-api, cdc, kafka
• Language: Dockerfile
• Homepage:
• Size: 2.93 KB
• Stars: 4
• Watchers: 1
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

• awesome-kafka-connect - atomotic/airtable-cdc-kafka - Airtable CDC source using HTTP connector to poll Airtable API for modified records (Content Management / Airtable)

README

          
# airtable-cdc-kafka

A CDC (Change data capture) for Airtable into Kafka.   

Each modified row of the spreadsheet creates a message into a Kafka topic.

Kafka Connect with this [HTTP Connector](https://github.com/castorm/kafka-connect-http) scrapes regularly the [Airtable API](https://airtable.com/api) for modified records (rows)

Two fields are needed into the spreadsheet:

* **Done**, type Checkbox

* **updated_at**, type Formula, `LAST_MODIFIED_TIME()`

![](https://docuver.se/airtable-cdc-kafka.jpg)

Usage:

* Modify **conf/airtable.properties** with the API Token and your table URL and tweak `http.timer.interval`

* Start the stack: ```docker-compose up -d```

* Watch (consume) messages ([kaf](https://github.com/birdayz/kaf))

    ```kaf -b 192.168.0.100:9094 consume airtable```