https://github.com/pingcap/tiflow

This repo maintains DM (a data migration platform) and TiCDC (change data capture for TiDB)
https://github.com/pingcap/tiflow

cdc dm kafka mysql ticdc tidb

Last synced: 2 days ago
JSON representation

This repo maintains DM (a data migration platform) and TiCDC (change data capture for TiDB)

• Host: GitHub
• URL: https://github.com/pingcap/tiflow
• Owner: pingcap
• License: apache-2.0
• Created: 2019-08-09T11:34:44.000Z (over 5 years ago)
• Default Branch: master
• Last Pushed: 2024-10-29T11:57:20.000Z (about 1 month ago)
• Last Synced: 2024-10-29T12:07:02.606Z (about 1 month ago)
• Topics: cdc, dm, kafka, mysql, ticdc, tidb
• Language: Go
• Homepage:
• Size: 153 MB
• Stars: 426
• Watchers: 74
• Forks: 284
• Open Issues: 771
• Metadata Files:
  • Readme: README.md
  • Contributing: CONTRIBUTING.md
  • License: LICENSE
  • Code of conduct: CODE_OF_CONDUCT.md
  • Security: SECURITY.md

Awesome Lists containing this project

• awesome-mysql - DM - A High-Availability data migration platform which supports migrating data from MySQL/MariaDB to TiDB and merging shard tables (Binlog-Replication)

README

        
# TiFlow

[![LICENSE](https://img.shields.io/github/license/pingcap/tiflow.svg)](https://github.com/pingcap/tiflow/blob/master/LICENSE)

![GitHub release (latest SemVer)](https://img.shields.io/github/v/release/pingcap/tiflow)

![GitHub Release Date](https://img.shields.io/github/release-date/pingcap/tiflow)

![GitHub go.mod Go version](https://img.shields.io/github/go-mod/go-version/pingcap/tiflow)

[![Build Status](https://github.com/pingcap/tiflow/actions/workflows/check_and_build.yaml/badge.svg?branch=master)](https://github.com/pingcap/tiflow/actions/workflows/check_and_build.yaml?query=event%3Apush+branch%3Amaster)

[![codecov](https://codecov.io/gh/pingcap/tiflow/branch/master/graph/badge.svg)](https://codecov.io/gh/pingcap/tiflow)

[![Go Report Card](https://goreportcard.com/badge/github.com/pingcap/tiflow)](https://goreportcard.com/report/github.com/pingcap/tiflow)

## Introduction

**TiFlow** is a unified data replication platform for [TiDB](https://docs.pingcap.com/tidb/stable) that consists of two main components: TiDB Data Migration (DM) and TiCDC.

* DM enables full data migration and incremental data replication from MySQL or MariaDB to TiDB.

* TiCDC replicates change data to various downstream systems, such as MySQL protocol-compatible databases and [Kafka](https://kafka.apache.org/).

For more details, see [DM README](./README_DM.md) and [TiCDC README](./README_TiCDC.md).

## License

**TiFlow** is under the Apache 2.0 license. See the [LICENSE](./LICENSE) file for details.