https://github.com/arvindshmicrosoft/azgunzip
Uncompress (and optionally "chunk" the output) GZip archives in Azure Blob Storage
https://github.com/arvindshmicrosoft/azgunzip
Last synced: 10 months ago
JSON representation
Uncompress (and optionally "chunk" the output) GZip archives in Azure Blob Storage
- Host: GitHub
- URL: https://github.com/arvindshmicrosoft/azgunzip
- Owner: arvindshmicrosoft
- License: mit
- Created: 2018-07-03T23:40:51.000Z (almost 8 years ago)
- Default Branch: master
- Last Pushed: 2018-07-04T00:02:47.000Z (almost 8 years ago)
- Last Synced: 2025-02-12T03:23:13.963Z (over 1 year ago)
- Language: C#
- Size: 20.5 KB
- Stars: 0
- Watchers: 1
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
# AzGunzip
Uncompress (and optionally "chunk" the output) GZip archives in Azure Blob Storage
# Requirements
.NET Framework 4.6.1 is needed.
# Usage
Sample command line is shown below. This will take a file called somefile.gz from an Azure Storage account called someblobaccountname, under a container called somecontainerwithgzip and then chunk the output in 100MB chunks to another Azure storage account called someotheraccount under a container called someothercontainer, and for each chunk of output (== separate blob), prefix the blob name with "test_" and add a suffix called ".txt" to each blob's name. It uses \n to look for line endings and thereby make sure that the output chunks are "aligned" to respect line endings.
AzGUnzip.exe --SourceAccount someblobaccountname --SourceContainer somecontainerwithgzip --SourceSAS "<>" --SourceFile somefile.gz --DestAccount someotheraccount --DestContainer someothercontainer --DestSAS "<>" --DestBlobPrefix "someprefix_" --DestBlobSuffix ".txt" --DestBlobSize 100000000 --LineDelimiter \n
# Acknowledgements
* Uses [SharpZipLib](github.com/icsharpcode/SharpZipLib) for uncompressing GZip files. Thanks to that team, especially so for fixing the Zip-slip vulnerability in the library just in time for this AzGunzip release!
* Uses [CommandLine](https://github.com/commandlineparser/commandline) for command-line parsing. Awesome library, I highly recommend this for anyone writing console apps!