{"id":23102261,"url":"https://github.com/evenh/az-blob-hashdeep","last_synced_at":"2025-10-27T07:02:10.926Z","repository":{"id":37652154,"uuid":"219058334","full_name":"evenh/az-blob-hashdeep","owner":"evenh","description":"A simple tool for generating hashdeep compatible output for an Azure Blob Storage container.","archived":false,"fork":false,"pushed_at":"2023-04-10T02:57:47.000Z","size":137,"stargazers_count":6,"open_issues_count":6,"forks_count":0,"subscribers_count":2,"default_branch":"master","last_synced_at":"2025-04-04T13:22:22.525Z","etag":null,"topics":["azure","azure-blob-storage","azure-storage","hacktoberfest","hashdeep"],"latest_commit_sha":null,"homepage":"","language":"Go","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/evenh.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2019-11-01T20:32:15.000Z","updated_at":"2022-01-26T11:28:03.000Z","dependencies_parsed_at":"2024-06-20T01:29:48.457Z","dependency_job_id":"77457bd5-0785-4136-8e2e-476438871cb7","html_url":"https://github.com/evenh/az-blob-hashdeep","commit_stats":null,"previous_names":[],"tags_count":6,"template":false,"template_full_name":null,"purl":"pkg:github/evenh/az-blob-hashdeep","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/evenh%2Faz-blob-hashdeep","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/evenh%2Faz-blob-hashdeep/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/evenh%2Faz-blob-hashdeep/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/evenh%2Faz-blob-hashdeep/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/evenh","download_url":"https://codeload.github.com/evenh/az-blob-hashdeep/tar.gz/refs/heads/master","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/evenh%2Faz-blob-hashdeep/sbom","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":259750465,"owners_count":22905900,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["azure","azure-blob-storage","azure-storage","hacktoberfest","hashdeep"],"created_at":"2024-12-16T23:59:08.201Z","updated_at":"2025-10-27T07:02:10.871Z","avatar_url":"https://github.com/evenh.png","language":"Go","funding_links":[],"categories":[],"sub_categories":[],"readme":"# az-blob-hashdeep [![Build Status](https://travis-ci.org/evenh/az-blob-hashdeep.svg?branch=master)](https://travis-ci.org/evenh/az-blob-hashdeep) [![Go Report Card](https://goreportcard.com/badge/github.com/evenh/az-blob-hashdeep)](https://goreportcard.com/report/github.com/evenh/az-blob-hashdeep)\n\nA simple tool for generating [hashdeep](https://github.com/jessek/hashdeep) compatible output for an Azure Blob Storage container. Useful for verifying migration of data to/from Azure.\n\nThe default implementation requires that the `Content-MD5` is set for all the blobs in a container. It will **not** verify the hashes, it will only be used for the final output. Optionally `--calculate` can be set to download every file to memory in order to calculate the actual MD5.  \n\n## How to use?\n\nGet precompiled binaries from the [releases page](https://github.com/evenh/az-blob-hashdeep/releases) or use the [Docker image](https://hub.docker.com/repository/docker/evenh/az-blob-hashdeep): `evenh/az-blob-hashdeep`.\n\n```bash\nexport AZURE_ACCOUNT_NAME=myaccount\nexport AZURE_ACCOUNT_KEY=secretKey # --sas-key is also supported as an alternative\nexport AZURE_CONTAINER=migrationcontainer\n\n./az-blob-hashdeep generate --account-name=$AZURE_ACCOUNT_NAME \\\n                            --account-key=$AZURE_ACCOUNT_KEY \\\n                            --container=$AZURE_CONTAINER \\\n                            --output ~/$AZURE_ACCOUNT_NAME-$AZURE_CONTAINER.hashdeep\n```\n\nThis will result in a output like:\n\n```\n%%%% HASHDEEP-1.0\n%%%% size,md5,filename\n## Invoked from: /Users/evenh/dev/evenh/az-blob-hashdeep\n## $ ./az-blob-hashdeep generate --account-name=myaccount --account-key=secretKey --container=migrationcontainer --output /Users/evenh/myaccount-migrationcontainer.hashdeep\n##\n1026764,ddb5d9fb991f62be9c55383aefa8e8e3,00/00/000008af-2e78-4b21-9a0e-a44ee77d4606\n97428,4fdb49a5de56a1b11c9c37264a1bb927,00/00/00006c79-1c38-45f8-a3b8-ebb299fc67a1\n[more entries…]\n```\n\n### Use prefix\nThere is also a potential useful flag: `--prefix (-p)` which will prepend a prefix to file paths. Example:\n```\nPath: foo/bar/file.txt\nPrefix: old-fs-01\nOutputted path: old-fs-01/foo/bar/file.txt\n```\n\n## Generate MD5 hashes locally\nIf you want to generate MD5 hashes from the content of a container, pass the `--calculate` flag. This operation is heavily CPU bound and will eat up your cores :-)\n\n### Troubleshooting\n\nSet `ABH_DEBUG=true` to see more detailed logging.\n\n## Contributing\n\nContributions in form of issues and pull requests are most welcome.\n\n## License\n\nThis project is licensed under the Apache 2.0 License. See [LICENSE](./LICENSE) for more information.\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fevenh%2Faz-blob-hashdeep","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fevenh%2Faz-blob-hashdeep","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fevenh%2Faz-blob-hashdeep/lists"}