https://github.com/svisser/merges

Merge multiple sorted files
https://github.com/svisser/merges

Last synced: 4 days ago
JSON representation

Merge multiple sorted files

• Host: GitHub
• URL: https://github.com/svisser/merges
• Owner: svisser
• Created: 2014-12-13T17:35:18.000Z (about 10 years ago)
• Default Branch: master
• Last Pushed: 2014-12-13T17:37:06.000Z (about 10 years ago)
• Last Synced: 2024-10-18T20:31:42.882Z (2 months ago)
• Language: Python
• Size: 106 KB
• Stars: 1
• Watchers: 3
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.rst

Awesome Lists containing this project

README

        
merges: Merge multiple sorted files

===================================

|travismaster|

.. |travismaster| image:: https://secure.travis-ci.org/box-and-whisker/merges.png?branch=master

   :target: http://travis-ci.org/box-and-whisker/merges

``merges`` is a simple command-line tool merging multiple sorted files with

small memory footprint. It is similar to `mergelog `_

which merges and sorts http log files from web servers behind round-robin DNS. The

difference is that ``merges`` is not restricted to http log file format.

Usage::

    > merges [-h] [-c COL] [-n] [--sep SEP] files [files ...]

    -h, --help         show help message and exit

    -c COL, --col COL  column index (starts from 0)

    --sep SEP          column separator

    -n, --numeric      numeric sort

Examples

========

Merge two log files, assuming fourth columns contains the timestamp and the

files are space-separated::

    merges -c 3 --sep ' ' a.log b.log > merged.log

Using tools like ``s3cmd`` and ``parallel`` together with ``merges``, you can

incrementally merge and sort multiple log files on Amazon S3 simultaneously

while downloading is in progress::

    ...Add example here...

Installation

============

Installing merges is easy::

    pip install merges

or download the source and run::

    python setup.py install