https://github.com/editd/redis_data_transfer

A simple tool to transfer data between Redis servers or clusters.
https://github.com/editd/redis_data_transfer

Last synced: over 1 year ago
JSON representation

A simple tool to transfer data between Redis servers or clusters.

• Host: GitHub
• URL: https://github.com/editd/redis_data_transfer
• Owner: EDITD
• License: mit
• Created: 2020-04-03T13:20:36.000Z (over 6 years ago)
• Default Branch: master
• Last Pushed: 2022-12-09T06:39:08.000Z (over 3 years ago)
• Last Synced: 2025-04-12T13:57:20.009Z (over 1 year ago)
• Language: Python
• Size: 55.7 KB
• Stars: 1
• Watchers: 16
• Forks: 0
• Open Issues: 1
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

README

          
[![Build Status](https://travis-ci.org/EDITD/redis_data_transfer.svg?branch=master)](https://travis-ci.org/EDITD/redis_data_transfer)

[![Pypi Version](https://img.shields.io/pypi/v/redis_data_transfer.svg)](https://pypi.org/project/redis_data_transfer/)

[![Python Versions](https://img.shields.io/pypi/pyversions/redis_data_transfer.svg)](https://pypi.org/project/redis_data_transfer/)

# Redis data transfer tool

An easy-to-use tool to transfer data between redis servers or clusters.

### Installation

```pip install redis-data-transfer```

### Usage

The command line structure is quite simple:

```redis-data-transfer [options] your.source.server your.destination.server```

For details about the options available:

```redis-data-transfer --help```

### Concepts

The implementation is made around a pipeline system with queues and subprocesses. The user can

control the number of parallel subprocesses for each step of the pipeline:

* A single scanner reads all keys from the source.

* Checkers look in the destination and filter out any key that already exists. They can be disabled

  if desired.

* Readers fetch the content of each key from the source.

* Writers store the content for each key in the destination.

## Development

The code is [hosted on github](https://github.com/EDITD/redis_data_transfer).

The repository uses [poetry](https://python-poetry.org/) for packaging.

The project uses [tox](https://tox.wiki/en/latest/) for testing.