https://github.com/brokercap/bristol
模拟 MySQL 从库,实时解析 MySQL Binlog 的简单易用的库
https://github.com/brokercap/bristol
go go-binlog gobinlog golang gomysql
Last synced: about 1 year ago
JSON representation
模拟 MySQL 从库,实时解析 MySQL Binlog 的简单易用的库
- Host: GitHub
- URL: https://github.com/brokercap/bristol
- Owner: brokercap
- Created: 2019-04-22T15:13:49.000Z (about 7 years ago)
- Default Branch: master
- Last Pushed: 2020-01-18T03:24:25.000Z (over 6 years ago)
- Last Synced: 2025-04-06T05:51:15.663Z (about 1 year ago)
- Topics: go, go-binlog, gobinlog, golang, gomysql
- Language: Go
- Homepage:
- Size: 1.26 MB
- Stars: 24
- Watchers: 3
- Forks: 16
- Open Issues: 1
-
Metadata Files:
- Readme: README.MD
Awesome Lists containing this project
README
## Bristol ---- 模拟MySQL从库连接,监听MySQL binlog变更并解析
#### DDL 支持说明
当前只支持字段在表结构末尾追加新字段，如果配置的二进制位点是在DDL 之前的位点，会出现数据和字段对应不上
数据类型修改之后，如果配置的二进制位点是在DDL 之前的位点，可能会出现数据出错
#### 类型转换
从Binlog解析出来的数据,在转成 map[string]interface{} 的数据格式的时候
MySQL里的存储类型对应Golang里的数据类型不一样
括号里的代表是Golang里的数据类型
- [x] - TINYINT ( int8 | unit8 )
- [x] - SMALLINT ( int16 | unit16 )
- [x] - MEDIUMINT ( int32 | uint32 )
- [x] - INT ( int32 | uint32 )
- [x] - BIGINT ( int64 | uint64 )
- [x] - FLOAT ( float32 )
- [x] - DOUBLE ( float64 )
- [x] - REAL ( float64 )
- [x] - DECIMAL , NUMERIC( 返回string类型 )
- [x] - DATE , TIME , YEAR , DATETIME , TIMESTAMP ( string )
- [x] - CHAR , VARCHAR ( string )
- [x] - TEXT , TINYTEXT , MEDIUMINTTEXT , - LONGTEXT ( string )
- [x] - BLOB, TINYBLOB , MEDIUMINTBLOB , LONGBLOB ( string )
- [x] - ENUM ( string )
- [x] - SET ( []string )
- [x] - BIT ( int64 )
#### 使用案例
`````go
filename := "mysql-bin.000071"
var position uint32 = 203785789
var DBsource = "root:root123@tcp(127.0.0.1:3306)/test"
reslut := make(chan error, 1)
m := make(map[string]uint8, 0)
m["bifrost_test"] = 1
m["mysql"] = 1
BinlogDump := &mysql.BinlogDump{
DataSource: DBsource,
CallbackFun: callback,
ReplicateDoDb: m,
OnlyEvent: []mysql.EventType{mysql.QUERY_EVENT, mysql.WRITE_ROWS_EVENTv1, mysql.UPDATE_ROWS_EVENTv1, mysql.DELETE_ROWS_EVENTv1,mysql.WRITE_ROWS_EVENTv2, mysql.UPDATE_ROWS_EVENTv2, mysql.DELETE_ROWS_EVENTv2},
}
go BinlogDump.StartDumpBinlog(filename, position, 100,reslut,"",0)
go func() {
for {
v := <-reslut
log.Printf("monitor reslut:%s \r\n", v)
}
}()
for {
time.Sleep(10 * time.Second)
}
`````
#### 数据检验
请参考 [一键数据检验测试工具](https://github.com/jc3wish/tree/master/Bristol/test)