https://github.com/pokle/cinge

Extracts and transforms LDIF files for loading into Elasticsearch
https://github.com/pokle/cinge

Last synced: 10 days ago
JSON representation

Extracts and transforms LDIF files for loading into Elasticsearch

• Host: GitHub
• URL: https://github.com/pokle/cinge
• Owner: pokle
• Created: 2013-04-14T12:20:21.000Z (over 11 years ago)
• Default Branch: master
• Last Pushed: 2013-04-23T06:43:45.000Z (over 11 years ago)
• Last Synced: 2023-03-11T00:19:10.577Z (over 1 year ago)
• Language: C
• Size: 117 KB
• Stars: 0
• Watchers: 1
• Forks: 0
• Open Issues: 1
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

README

        
cinge

=====

Extracts and transforms LDIF files for loading into Elasticsearch. (Well, it's still work in progress)

Benchmarks

==================

To count the number of newlines in an LDIF file (to understand the scale):

    12seconds to process a 4gb file on a 2.3Ghz Intel Core i7, 16gb, SSD

    40seconds to process a 4gb file on a 1.8Ghz Intel Core i7, 4gb, SSD

To extract the cn's from a 4gb file (already cached by the OS in its FS cache). This was on the 2.3Ghz Intel Core i7 with 16gb and SSD

	6.5 seconds by cinge

	3mins, 11 seconds by fgrep!!!!