{"id":15290980,"url":"https://github.com/azure/blobxfer","last_synced_at":"2025-10-07T04:30:46.669Z","repository":{"id":46953426,"uuid":"64148806","full_name":"Azure/blobxfer","owner":"Azure","description":"Azure Storage transfer tool and data movement library","archived":true,"fork":false,"pushed_at":"2024-07-18T18:53:29.000Z","size":1231,"stargazers_count":151,"open_issues_count":6,"forks_count":38,"subscribers_count":36,"default_branch":"master","last_synced_at":"2025-01-15T23:16:25.264Z","etag":null,"topics":["azure","azure-blob","azure-blob-storage","azure-file","azure-storage","data-movement","docker-image","file-transfer","python","python-library"],"latest_commit_sha":null,"homepage":"","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/Azure.png","metadata":{"files":{"readme":"README.md","changelog":"CHANGELOG.md","contributing":"CONTRIBUTING.md","funding":null,"license":"LICENSE","code_of_conduct":"CODE_OF_CONDUCT.md","threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":"SECURITY.md","support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2016-07-25T16:03:06.000Z","updated_at":"2024-09-29T11:07:07.000Z","dependencies_parsed_at":"2024-06-18T21:12:32.049Z","dependency_job_id":"e3bea4dc-44fd-46b6-acc9-5f6bfabe3844","html_url":"https://github.com/Azure/blobxfer","commit_stats":{"total_commits":249,"total_committers":7,"mean_commits":35.57142857142857,"dds":0.02409638554216864,"last_synced_commit":"0ac1212326a43dfd6cb2b8525ff95f1c4ae540af"},"previous_names":[],"tags_count":35,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Azure%2Fblobxfer","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Azure%2Fblobxfer/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Azure%2Fblobxfer/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Azure%2Fblobxfer/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/Azure","download_url":"https://codeload.github.com/Azure/blobxfer/tar.gz/refs/heads/master","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":235586424,"owners_count":19014032,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["azure","azure-blob","azure-blob-storage","azure-file","azure-storage","data-movement","docker-image","file-transfer","python","python-library"],"created_at":"2024-09-30T16:10:23.312Z","updated_at":"2025-10-07T04:30:46.246Z","avatar_url":"https://github.com/Azure.png","language":"Python","funding_links":[],"categories":[],"sub_categories":[],"readme":"[![Build Status](https://azurebatch.visualstudio.com/blobxfer/_apis/build/status/blobxfer-CI)](https://azurebatch.visualstudio.com/blobxfer/_build/latest?definitionId=12)\n[![Build status](https://ci.appveyor.com/api/projects/status/qgth9p7jlessgp5i/branch/master?svg=true)](https://ci.appveyor.com/project/alfpark/blobxfer)\n[![codecov](https://codecov.io/gh/Azure/blobxfer/branch/master/graph/badge.svg)](https://codecov.io/gh/Azure/blobxfer)\n[![PyPI](https://img.shields.io/pypi/v/blobxfer.svg)](https://pypi.python.org/pypi/blobxfer)\n\n## PROJECT STATUS\n**This project is no longer actively maintained.** For tools officially supported by\nMicrosoft please refer to this\n[documentation](https://docs.microsoft.com/azure/storage/common/storage-choose-data-transfer-solution).\n\n# blobxfer\n`blobxfer` is an advanced data movement tool and library for Azure Storage\nBlob and Files. With `blobxfer` you can copy your files into or out of Azure\nStorage with the CLI or integrate the `blobxfer` data movement library into\nyour own Python scripts.\n\n## Major Features\n* Command-line interface (CLI) providing data movement capability to and\nfrom Azure Blob and File Storage\n* Standalone library for integration with scripts or other Python packages\n* High-performance design with asynchronous transfers and disk I/O\n* Supports ingress, egress and synchronization of entire directories,\ncontainers and file shares\n* YAML configuration driven execution support\n* Fine-grained resume support including resuming a broken operation\nwithin a file or object\n* Vectored IO support\n    * `stripe` mode allows striping a single file across multiple blobs (even\n      to multiple storage accounts) to break through single blob or fileshare\n      throughput limits\n    * `replica` mode allows replication of a file across multiple destinations\n      including to multiple storage accounts\n* Synchronous copy with cross-mode (object transform) replication support\n    * Leverages server-side copies by default\n    * Arbitrary URL copy support\n* Client-side encryption support\n* Support all Azure Blob types and Azure Files for both upload and download\n* Advanced skip options for rsync-like operations\n* Store/restore POSIX filemode and uid/gid\n* Support reading/pipe from `stdin` including to page blob destinations\n* Support reading from blob and file share snapshots for downloading and\nsynchronous copy\n* Support for setting access tier on objects for uploading and synchronous\ncopy\n* Configurable one-shot block upload support\n* Configurable chunk size for both upload and download\n* Automatic block size selection for block blob uploading\n* Automatic uploading of VHD/VHDX files as page blobs\n* Include and exclude filtering support\n* Rsync-like delete support\n* No clobber support in either direction\n* Automatic content type tagging\n* Support for setting the Cache Control property of blobs and files\n* File logging support\n* Support for HTTP proxies\n\n## Installation\nThere are three ways to install `blobxfer`:\n\n* `blobxfer` Python package from [PyPI](https://pypi.python.org/pypi/blobxfer)\n* Pre-built binaries available under [Releases](https://github.com/Azure/blobxfer/releases)\n* Docker images are available for both Linux and Windows platforms on the\n[Microsoft Container Registry](https://hub.docker.com/_/microsoft-blobxfer)\n\nPlease refer to the\n[installation guide](http://blobxfer.readthedocs.io/en/latest/01-installation/)\nfor more information on how to install `blobxfer`.\n\n## Documentation\nPlease refer to the [`blobxfer` documentation](http://blobxfer.readthedocs.io/)\nfor more details and usage information.\n\n## Change Log\nPlease see the\n[Change Log](http://blobxfer.readthedocs.io/en/latest/CHANGELOG/)\nfor project history.\n\n## Support\nThis project is community supported and not officially supported by Microsoft.\nThere is no defined SLA for addressing features, issues, and bugs which are\nexclusively serviced via GitHub issues. For tools officially supported by\nMicrosoft please refer to this\n[documentation](https://docs.microsoft.com/azure/storage/common/storage-choose-data-transfer-solution).\n\n* * *\nPlease see this project's [Code of Conduct](CODE_OF_CONDUCT.md) and\n[Contributing](CONTRIBUTING.md) guidelines.\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fazure%2Fblobxfer","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fazure%2Fblobxfer","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fazure%2Fblobxfer/lists"}