{"id":13395468,"url":"https://github.com/Qovery/Replibyte","last_synced_at":"2025-03-13T21:31:43.439Z","repository":{"id":37075934,"uuid":"459739627","full_name":"Qovery/Replibyte","owner":"Qovery","description":"Seed your development database with real data ⚡️","archived":false,"fork":false,"pushed_at":"2024-08-14T20:20:41.000Z","size":7859,"stargazers_count":4137,"open_issues_count":113,"forks_count":127,"subscribers_count":24,"default_branch":"main","last_synced_at":"2024-10-18T06:51:01.900Z","etag":null,"topics":["aws","backup","cloud","cloudnative","database","mongodb","mysql","postgres","postgresql","rust","rust-lang","s3"],"latest_commit_sha":null,"homepage":"https://www.replibyte.com","language":"Rust","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"gpl-3.0","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/Qovery.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2022-02-15T20:31:25.000Z","updated_at":"2024-10-15T18:23:00.000Z","dependencies_parsed_at":"2024-01-08T07:57:21.760Z","dependency_job_id":"594ff4dc-ba47-4360-9856-7aff62c9c36f","html_url":"https://github.com/Qovery/Replibyte","commit_stats":null,"previous_names":[],"tags_count":44,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Qovery%2FReplibyte","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Qovery%2FReplibyte/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Qovery%2FReplibyte/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Qovery%2FReplibyte/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/Qovery","download_url":"https://codeload.github.com/Qovery/Replibyte/tar.gz/refs/heads/main","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":221411581,"owners_count":16815696,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["aws","backup","cloud","cloudnative","database","mongodb","mysql","postgres","postgresql","rust","rust-lang","s3"],"created_at":"2024-07-30T17:02:00.679Z","updated_at":"2024-10-25T09:30:21.315Z","avatar_url":"https://github.com/Qovery.png","language":"Rust","readme":"\u003cp align=\"center\"\u003e \u003cimg src=\"assets/RepliByte%20Logo.png\" alt=\"replibyte logo\"/\u003e \u003c/p\u003e\n\n\u003ch3 align=\"center\"\u003eSeed Your Development Database With Real Data ⚡️\u003c/h3\u003e\n\u003cp align=\"center\"\u003eReplibyte is a blazingly fast tool to seed your databases with your production data while keeping sensitive data safe 🔥\u003c/p\u003e\n\n\u003cp align=\"center\"\u003e\n\u003ca href=\"https://opensource.org/licenses/MIT\"\u003e \u003cimg alt=\"MIT License\" src=\"https://img.shields.io/badge/License-MIT-yellow.svg\"\u003e \u003c/a\u003e\n\u003cimg src=\"https://img.shields.io/badge/stability-stable-green.svg?style=flat-square\" alt=\"stable badge\"\u003e\n\u003cimg src=\"https://img.shields.io/badge/stability-stable-green.svg?style=flat-square\" alt=\"stable badge\"\u003e\n\u003cimg src=\"https://github.com/Qovery/replibyte/actions/workflows/build-and-test.yml/badge.svg?style=flat-square\" alt=\"Build and Tests\"\u003e\n\u003ca href=\"https://discord.qovery.com\"\u003e \u003cimg alt=\"Discord\" src=\"https://img.shields.io/discord/688766934917185556?label=discord\u0026style=flat-square\"\u003e \u003c/a\u003e\n\u003c/p\u003e\n\n\u003cp align=\"center\"\u003e\n\u003ca href=\"https://runacap.com/ross-index/q3-2022/\" target=\"_blank\" rel=\"noopener\"\u003e\n\u003cimg style=\"width: 260px; height: 56px\" src=\"https://runacap.com/wp-content/uploads/2022/10/ROSS_badge_black_Q3_2022.svg\" alt=\"ROSS Index - Fastest Growing Open-Source Startups in Q3 2022 | Runa Capital\" width=\"260\" height=\"56\" /\u003e\n\u003c/a\u003e\n\n\u003c/p\u003e\n\n## Prerequisites\n\n- MacOSX / Linux / Windows\n- Nothing more! Replibyte is stateless and does not require anything special.\n\n## Usage\n\nCreate a dump\n\n```shell\nreplibyte -c conf.yaml dump create\n```\n\nList all dumps\n\n```shell\nreplibyte -c conf.yaml dump list\n\ntype          name                  size    when                    compressed  encrypted\nPostgreSQL    dump-1647706359405    154MB   Yesterday at 03:00 am   true        true\nPostgreSQL    dump-1647731334517    152MB   2 days ago at 03:00 am  true        true\nPostgreSQL    dump-1647734369306    149MB   3 days ago at 03:00 am  true        true\n```\n\nRestore the latest dump in a local container\n\n```shell\nreplibyte -c conf.yaml dump restore local -v latest -i postgres -p 5432\n```\n\nRestore the latest dump in a remote database\n\n```shell\nreplibyte -c conf.yaml dump restore remote -v latest\n```\n\n## Features\n\n- [x] Support data dump and restore for PostgreSQL, MySQL and MongoDB\n- [x] Analyze your data schema 🔎\n- [x] Replace sensitive data with fake data\n- [x] Works on large database (\u003e 10GB)\n- [x] Database Subsetting: Scale down a production database to a more reasonable size 🔥\n- [x] Start a local database with the production data in a single command 🔥\n- [x] On-the-fly data (de)compression (Zlib)\n- [x] On-the-fly data de/encryption (AES-256)\n- [x] Fully stateless (no server, no daemon) and lightweight binary 🍃\n- [x] Use [custom transformers](examples/wasm)\n\nHere are the features we plan to support\n\n- [ ] Auto-detect and version database schema change\n- [ ] Auto-detect sensitive fields\n- [ ] Auto-clean backed up data\n\n## Getting Started\n\n1. [How Replibyte works](https://www.replibyte.com/docs/how-replibyte-works)\n2. Initial setup: \n   1. [Install](https://www.replibyte.com/docs/getting-started/installation)\n   2. [Configure](https://www.replibyte.com/docs/getting-started/configuration)\n3. Step-by-step guides:\n   1. [Create a dump](https://www.replibyte.com/docs/guides/create-a-dump)\n   2. [Restore a dump](https://www.replibyte.com/docs/guides/restore-a-dump)\n   3. [Subset a dump](https://www.replibyte.com/docs/guides/subset-a-dump)\n   4. [Delete a dump](https://www.replibyte.com/docs/guides/delete-a-dump)\n   5. Deploy Replibyte\n      1. [Container](https://www.replibyte.com/docs/guides/deploy-replibyte/container)\n      2. [Qovery](https://www.replibyte.com/docs/guides/deploy-replibyte/qovery)\n\n## Demo\n\n[![What is RepliByte](assets/video_.png)](https://www.youtube.com/watch?v=IKeLnZvECQw)\n\n## Contributing\n\nCheck [here](https://www.replibyte.com/docs/contributing).\n\n## Thanks\n\nThanks to all people sharing their ideas to make Replibyte better. We do appreciate it. I would also thank [AirByte](https://airbyte.com/),\na great product and a trustworthy source of inspiration for this project.\n\n---\n\nReplibyte is initiated and maintained by [Qovery](https://www.qovery.com?ref=replibyte-readme). \n","funding_links":[],"categories":["Rust","cloud"],"sub_categories":[],"project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2FQovery%2FReplibyte","html_url":"https://awesome.ecosyste.ms/projects/github.com%2FQovery%2FReplibyte","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2FQovery%2FReplibyte/lists"}