https://github.com/sdslabs/kat-brute

Internal SDSLabs stuff
https://github.com/sdslabs/kat-brute

Last synced: 4 days ago
JSON representation

Internal SDSLabs stuff

• Host: GitHub
• URL: https://github.com/sdslabs/kat-brute
• Owner: sdslabs
• Created: 2015-03-06T15:48:02.000Z (over 11 years ago)
• Default Branch: master
• Last Pushed: 2015-03-08T14:42:26.000Z (over 11 years ago)
• Last Synced: 2025-02-23T20:32:02.950Z (over 1 year ago)
• Language: Ruby
• Homepage:
• Size: 227 KB
• Stars: 0
• Watchers: 3
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

README

          
#kat-brute

Internal stuff for SDSLabs.

#Setup

	git clone git@github.com:captn3m0/kat-brute.git

    bundle install

##Production Data

**Note**: This is network and storage intensive. Don't run locally

    # You can use wget, but its pretty slow

    sudo apt-get install axel -y

    axel -n 10 -a https://kickass.to/dailydump.txt.gz

    gunzip dailydump.txt.gz

    # Converts the ugly dump to valid csv

    ruby setup.rb

##Development Data

Since the production dataset is huge, we can test against smaller dataset (available in repo)

    gunzip tiny.csv.gz

    mv tiny.csv data.csv

#Parser

    # Converts data.CSV to our required dataset

    ruby parse.rb

Resulting output is availble in `data.jdb`. In case you just want the final dataset,

a sample dataset can be found in `sample.jdb.gz`.