{"id":25074720,"url":"https://github.com/rix4uni/unew","last_synced_at":"2025-04-15T00:12:39.495Z","repository":{"id":191064020,"uuid":"683852870","full_name":"rix4uni/unew","owner":"rix4uni","description":"A tool combined of 2 commands features in 1 sort and tee for adding new lines to files, skipping duplicates","archived":false,"fork":false,"pushed_at":"2025-01-20T12:31:56.000Z","size":51,"stargazers_count":8,"open_issues_count":0,"forks_count":1,"subscribers_count":1,"default_branch":"main","last_synced_at":"2025-04-15T00:12:19.921Z","etag":null,"topics":["bug-bounty","bugbounty","bugbountytips","duplicates","hacking","infosec","osint","osint-resources","osint-tool","penetration-testing","pentest-tool","pentesting","recon","reconnaissance","security","security-tools","threat-intelligence"],"latest_commit_sha":null,"homepage":"","language":"Go","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/rix4uni.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2023-08-27T22:41:48.000Z","updated_at":"2025-03-06T08:19:28.000Z","dependencies_parsed_at":"2024-09-11T22:49:39.331Z","dependency_job_id":"03708dbe-73f8-44d3-860a-4f5b755fe12c","html_url":"https://github.com/rix4uni/unew","commit_stats":null,"previous_names":["rix4uni/unew"],"tags_count":5,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/rix4uni%2Funew","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/rix4uni%2Funew/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/rix4uni%2Funew/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/rix4uni%2Funew/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/rix4uni","download_url":"https://codeload.github.com/rix4uni/unew/tar.gz/refs/heads/main","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":248981270,"owners_count":21193147,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["bug-bounty","bugbounty","bugbountytips","duplicates","hacking","infosec","osint","osint-resources","osint-tool","penetration-testing","pentest-tool","pentesting","recon","reconnaissance","security","security-tools","threat-intelligence"],"created_at":"2025-02-07T00:18:22.390Z","updated_at":"2025-04-15T00:12:39.476Z","avatar_url":"https://github.com/rix4uni.png","language":"Go","funding_links":[],"categories":[],"sub_categories":[],"readme":"## unew\r\n\r\nA tool combined of 2 commands features in 1 `sort` and `tee` for adding new lines to files, skipping duplicates\r\n\r\n## Installation\r\n```\r\ngo install github.com/rix4uni/unew@latest\r\n```\r\n\r\n## Download prebuilt binaries\r\n```\r\nwget https://github.com/rix4uni/unew/releases/download/v0.0.6/unew-linux-amd64-0.0.6.tgz\r\ntar -xvzf unew-linux-amd64-0.0.6.tgz\r\nrm -rf unew-linux-amd64-0.0.6.tgz\r\nmv unew ~/go/bin/unew\r\n```\r\nOr download [binary release](https://github.com/rix4uni/unew/releases) for your platform.\r\n\r\n## Compile from source\r\n```\r\ngit clone --depth 1 github.com/rix4uni/unew.git\r\ncd unew; go install\r\n```\r\n\r\n## Usage\r\n```\r\nUsage of unew:\r\n  -a    append output; do not sort\r\n  -ef\r\n        do not create empty files\r\n  -el\r\n        remove empty lines from input\r\n  -i    ignore case during comparison\r\n  -q    quiet mode (no output at all on terminal)\r\n  -shuf\r\n        shuffle the output lines randomly\r\n  -split int\r\n        split the output into files with a specified number of lines per file\r\n  -t    trim leading and trailing whitespace before comparison\r\n  -version\r\n        print version information and exit\r\n```\r\n\r\n## Speed Comparison\r\n```\r\n▶ time cat chaos-subs.txt | unew -q subs1.txt\r\nreal    0m26.252s\r\nuser    0m28.826s\r\nsys     0m9.321s\r\n\r\n▶ time cat chaos-subs.txt | anew -q subs2.txt\r\nreal    1m2.659s\r\nuser    0m37.907s\r\nsys     0m36.362s\r\n\r\n▶ time cat chaos-subs.txt | sort -u \u003e subs3.txt\r\nreal    1m26.432s\r\nuser    1m11.493s\r\nsys     0m3.562s\r\n```\r\n\r\n## Usage Examples\r\n```\r\n# input\r\n▶ cat things.txt\r\nrix4uni.com\r\n\r\nadmin.rix4uni.com\r\nadmin.rix4uni.com\r\nJENKINS.rix4uni.com\r\n\r\n# output e.g. 1\r\n▶ cat things.txt | unew -a\r\nrix4uni.com\r\n\r\nadmin.rix4uni.com\r\nadmin.rix4uni.com\r\nJENKINS.rix4uni.com\r\n\r\n# output e.g. 2\r\n▶ cat things.txt | unew\r\nrix4uni.com\r\n\r\nadmin.rix4uni.com\r\nJENKINS.rix4uni.com\r\n\r\n# output e.g. 3\r\n▶ cat things.txt | unew -el\r\nrix4uni.com\r\nadmin.rix4uni.com\r\nJENKINS.rix4uni.com\r\n\r\n# output e.g. 4\r\n▶ cat things.txt | unew -el -i\r\nrix4uni.com\r\nadmin.rix4uni.com\r\njenkins.rix4uni.com\r\n\r\n# output e.g. 5\r\n▶ cat things.txt | unew -split 100 newthings_split_.txt\r\n```\r\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Frix4uni%2Funew","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Frix4uni%2Funew","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Frix4uni%2Funew/lists"}