{"id":20001161,"url":"https://github.com/apecloud/datasafed","last_synced_at":"2026-01-04T05:13:58.507Z","repository":{"id":220059684,"uuid":"688418510","full_name":"apecloud/datasafed","owner":"apecloud","description":"datasafed is a companion tool to KubeBlocks' DataProtection module, which can operate various kinds of storage backends for uploading and downloading backup data.","archived":false,"fork":false,"pushed_at":"2024-02-29T12:28:16.000Z","size":116,"stargazers_count":3,"open_issues_count":1,"forks_count":0,"subscribers_count":3,"default_branch":"main","last_synced_at":"2025-01-12T13:11:20.801Z","etag":null,"topics":[],"latest_commit_sha":null,"homepage":"","language":"Go","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"apache-2.0","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/apecloud.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2023-09-07T10:01:55.000Z","updated_at":"2024-12-11T06:15:49.000Z","dependencies_parsed_at":"2024-06-21T13:16:08.848Z","dependency_job_id":"94ec5912-8881-4d49-8fe2-238ed5c7541f","html_url":"https://github.com/apecloud/datasafed","commit_stats":null,"previous_names":["apecloud/datasafed"],"tags_count":6,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/apecloud%2Fdatasafed","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/apecloud%2Fdatasafed/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/apecloud%2Fdatasafed/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/apecloud%2Fdatasafed/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/apecloud","download_url":"https://codeload.github.com/apecloud/datasafed/tar.gz/refs/heads/main","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":241439474,"owners_count":19963098,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":[],"created_at":"2024-11-13T05:16:53.656Z","updated_at":"2026-01-04T05:13:58.474Z","avatar_url":"https://github.com/apecloud.png","language":"Go","funding_links":[],"categories":[],"sub_categories":[],"readme":"datasafed\n=========\n\n`datasafed` is a companion tool to KubeBlocks' DataProtection module, which can operate various kinds of storage backends for uploading and downloading backup data.\n\n## Build\n\n`datasafed` requires Go 1.21 or higher.\n\n```bash\n# Compile datasafed binary, output to build/\nmake build\n```\n\n### Build Docker Image\n\n```bash\n# Build image\nmake build-docker-image\n# Push image\nmake push-docker-image\n```\n\nIf you want to build a multi-arch image, you need to set BUILDX_ENABLED=true. The default archs to build are `linux/amd64` and `linux/arm64`, and you can specify other archs through `BUILDX_PLATFORMS`.\n\n```bash\nexport BUILDX_ENABLED=true\nexport BUILDX_PLATFORMS=darwin/arm64,linux/arm64\nmake build-docker-image\nmake push-docker-image\n```\n\n## Usage\n\n### Configuration\n\nBefore using `datasafed`, you need to prepare a configuration file, mainly the storage backend configuration information. `datasafed` integrates [rclone](https://rclone.org/) as the driver for accessing remote storage. Most configuration items are passed through to `rclone`, and a few configuration items are handled by `datasafed` itself. The configuration file is in the .ini format.\n\n```ini\n[storage]\n\n#############################\n# handled by rclone\n#############################\n# Refers to https://rclone.org/docs/#configure\ntype = s3\nprovider = AWS\nenv_auth = false\naccess_key_id = XXX\nsecret_access_key = YYY\nregion = us-east-1\n\n#############################\n# handled by datasafed\n#############################\n# All directory parameters are relative to root\nroot = mybucket/\n```\n\n`datasafed` loads the configuration from `/etc/datasafed/datasafed.conf` by default, but you can override this with the `-c/--conf` parameter.\n\n#### Special Environment Variables\n\n`DATASAFED_LOCAL_BACKEND_PATH`: If the user sets this variable to a local directory, `datasafed` will ignore the backend in the configuration file and use a [local backend](https://rclone.org/local/) pointing to the specified path.\n\n`DATASAFED_BACKEND_BASE_PATH`: This variable is a path, and `datasafed` will prepend this path to all remote path parameters, meaning that all operations will be restricted to the specified directory.\n\n```bash\n# Without DATASAFED_BACKEND_BASE_PATH:\n# It creates the file at /hello.txt\necho \"hello\" | datasafed push - hello.txt\n\n# With DATASAFED_BACKEND_BASE_PATH:\n# It creates the file at a/b/c/hello.txt\nexport DATASAFED_BACKEND_BASE_PATH=a/b/c\necho \"hello\" | datasafed push - hello.txt\n```\n\n### Commands\n\nSee [docs/datasafed.md](docs/datasafed.md) for details and examples.\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fapecloud%2Fdatasafed","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fapecloud%2Fdatasafed","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fapecloud%2Fdatasafed/lists"}