Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/zendesk/maxwell
Maxwell's daemon, a mysql-to-json kafka producer
https://github.com/zendesk/maxwell
Last synced: 3 months ago
JSON representation
Maxwell's daemon, a mysql-to-json kafka producer
- Host: GitHub
- URL: https://github.com/zendesk/maxwell
- Owner: zendesk
- License: other
- Created: 2015-02-09T22:06:13.000Z (over 9 years ago)
- Default Branch: master
- Last Pushed: 2024-06-05T21:14:22.000Z (5 months ago)
- Last Synced: 2024-06-18T21:44:10.035Z (5 months ago)
- Language: Java
- Homepage: https://maxwells-daemon.io/
- Size: 24.9 MB
- Stars: 3,942
- Watchers: 520
- Forks: 995
- Open Issues: 222
-
Metadata Files:
- Readme: README.md
- Changelog: CHANGELOG.md
- License: LICENSE
Awesome Lists containing this project
- awesome-kafka - Maxwell
- awesome-kafka - Maxwell's daemon - a mysql-to-json kafka producer
README
This is __Maxwell's daemon__, a [change data capture](https://www.confluent.io/blog/how-change-data-capture-works-patterns-solutions-implementation/) application
that reads MySQL binlogs and writes data changes as JSON to Kafka, Kinesis, and other streaming platforms.[↓ Download](https://github.com/zendesk/maxwell/releases/download/v1.41.2/maxwell-1.41.2.tar.gz) \|
[⚝ Source / Community](https://github.com/zendesk/maxwell) \|
[☝ Getting Started](/quickstart) \|
[☷ Reference](/config)__What's it for?__
- ETL of all sorts
- maintaining an audit log of all changes to your database
- cache building/expiring
- search indexing
- inter-service communication__It goes like this:__
```
mysql> update `test`.`maxwell` set mycol = 55, daemon = 'Stanislaw Lem';
maxwell -> kafka:
{
"database": "test",
"table": "maxwell",
"type": "insert",
"ts": 1449786310,
"data": { "id":1, "daemon": "Stanislaw Lem", "mycol": 55 },
"old": { "mycol":, 23, "daemon": "what once was" }
}
```