Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

Awesome Lists | Featured Topics | Projects

https://github.com/nlitsme/zipdump

Analyze zipfile, either local, or from url
https://github.com/nlitsme/zipdump

file-format pkzip reverse-engineering zip

Last synced: 12 days ago
JSON representation

Analyze zipfile, either local, or from url

Awesome Lists containing this project

README

        

# zipdump
Analyze zipfile, either local, or from url

`zipdump` can either do a full zip analysis, finding all PK-like headers, or (default) it can do a quick scan ( like the usual `zip -v` type output ).

`zipdump -q` works equally quick on web based resources as on local files.
This makes it quite easy to quickly investigate a large number of large .zip files without actually needing to download them.

I wrote this tool because i wanted to look at the contents of lots of apple ios firmware files without downloading 100s of GB of data.

For instance:

python3 zipdump.py -q http://appldnld.apple.com/ios10.0/031-64655-20160705-A371AD14-3E3F-11E6-A58B-C84C60941A1E/com_apple_MobileAsset_SoftwareUpdate/d75e3af423ae0308a8b9e0847292375ba02e3b11.zip

`zipdump` needs pyton3.

Or you could extract a specific file from lots of zips using:

cat urllist | xargs zipdump -q --cat somefile.txt

COMMANDLINE OPTIONS
===================

* `--cat` FILENAME will decrypt, decompress the specified filename to stdout
* `--raw` FILENAME will decrypt, but not decompress the specified filename to stdout
* `--save` FILENAME will save the decrypted, decompressed file to the output directory
* `--outputdir` DIR specify where to save extracted files.
* `--analyze` Detailed .zip analysis, finds all PKnnn chunks.
* `--offset OFS --length SIZE` specify a chunk of a file to investigate
you can used this to list zip contents from a zip file embeded in another binary file.
* `--dumpraw` hexdump the entire zip file contents, optionally limiting the amount of data printed.
* `--limit LIMIT` limit raw dump output
* `--keys 0x1,0x2,0x3` specify the internal encryption key for decrypting encrypted files.
* `--password PASSWD ` specify the password for decrypting encrypted files.
* `--hexpassword HEXPASSWD ` specify the password for decrypting encrypted files.
useful when the password is not an ascii string.

* `-H` "HDR: value" add custom http headers to the http request.
* `--httptrace` print out all http traffic.

* `--extract` Extract all files to the `outputdir`, optionally stripping leading parts of the filename
* `--strip STRIP` strip N initial parts from pathnames before saving
* `--preserve` preserve permissions and timestamps
* `--allowdotdot` allow paths to walk outside of the output directory.

When searching for .zip files, you can recurse and skip links using these options:
* `--recurse` recurse into directories
* `--skiplinks` skip symbolic links

The zip file is read in `chunksize` chunks, default 1M, you can alter this using the `--chunksize` option.

Then there are several options controlling how much output is generated:
* `--pretty` very verbose output
* `--verbose`
* `--quiet`
* `--debug`

TODO
====

* add option to save a specific entry by index, or offset into the file.
* this would be useful when an archive contains an entry with a difficult to type name.
* add option to save an entry by name to a differently named file.
* DONE by default sanitize filenames before use, with option to disable sanitation.
* currently XTRA is printed only when specifying --dumpraw, i would like to see this
parsed and printed with --verbose.
* rename pretty to 'very verbose'
* add option to save each file to a zipfile specific subdirectory. So you can extract
multiple files in one command.
* support stdin
* as library: add better interface, which allows enumeration of contents, lookup of files, extraction of files.
* add option to print only the filenames
* add option to filter what to extract.

HISTORY
=======

This tool started out as a perl script named zipdbg in 2003.

(c) 2016 Willem Hengeveld