{"id":20903486,"url":"https://github.com/coalfire-research/git-scrapers","last_synced_at":"2025-05-13T04:33:16.476Z","repository":{"id":72139412,"uuid":"157750934","full_name":"Coalfire-Research/Git-Scrapers","owner":"Coalfire-Research","description":"Collect OSINT from git repositories","archived":false,"fork":false,"pushed_at":"2021-04-06T23:11:44.000Z","size":18,"stargazers_count":20,"open_issues_count":3,"forks_count":8,"subscribers_count":4,"default_branch":"main","last_synced_at":"2025-04-01T18:11:39.693Z","etag":null,"topics":["developers","git","github","osint"],"latest_commit_sha":null,"homepage":"","language":"Ruby","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"other","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/Coalfire-Research.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2018-11-15T17:53:12.000Z","updated_at":"2025-02-28T11:06:31.000Z","dependencies_parsed_at":"2023-05-26T20:15:44.340Z","dependency_job_id":null,"html_url":"https://github.com/Coalfire-Research/Git-Scrapers","commit_stats":null,"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Coalfire-Research%2FGit-Scrapers","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Coalfire-Research%2FGit-Scrapers/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Coalfire-Research%2FGit-Scrapers/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Coalfire-Research%2FGit-Scrapers/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/Coalfire-Research","download_url":"https://codeload.github.com/Coalfire-Research/Git-Scrapers/tar.gz/refs/heads/main","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":253877265,"owners_count":21977632,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["developers","git","github","osint"],"created_at":"2024-11-18T13:13:38.693Z","updated_at":"2025-05-13T04:33:16.468Z","avatar_url":"https://github.com/Coalfire-Research.png","language":"Ruby","funding_links":[],"categories":[],"sub_categories":[],"readme":"git-user.rb\n======\nPatrick Hurd, Coalfire Federal\n\n---\n\nOSINT tool specifically for targetting developers.\n\nWhat you get:\n- Profile information\n- Commit authorship information\n- See options list for non-default output\n\nSetup\n-----\n\n1. `sudo apt install ruby`\n2. `sudo gem install httparty`\n3. `sudo apt install aha` (Required for mine output)\n4. `sudo apt install whois` (Required for whois output)\n4. [Add your GitHub username/password/token to your gitconfig](https://stackoverflow.com/a/51327559) if you plan on mining private repos\n\nUsage:\n------\n```\nUsage: git-user.rb [options]\n    -h, --help                       Show this help banner\n\n    -u, --user USERNAME              User to gather info from\n    -o, --organization ORGANIZATION  Organization to scrape\n    -r, --repo REPO                  The repo whom's contributors to scrape\n        --local ABSOLUTE_PATH        Perform scrape on a repo local to your filesystem\n        --name NAME                  Name to refer to a --local repo in report filenames\n\n    -a, --auth                       Authenticate with HTTP basic auth\n    -t, --token TOKEN                Use specified GitHub personal access token\n\n    -s, --stackoverflow              Try to find users' accounts on StackOverflow\n    -p, --pwned                      Search for relevant data breaches using haveibeenpwned\n    -e, --extra_checking             Do extra checking on email addresses\n    -m, --mine                       Mine the repo or user/organization's repos for secrets\n        --whois                      Perform whois lookup on domains found in profile information\n    -l, --loud                       Perform active recon on users (scrape their personal site)\n\n        --html                       Output main report to an HTML document\n    -w, --wordlist                   Generate wordlist for use in password attacks\n    -c, --csv                        Export discovered accounts to a GoPhish-importable CSV file\n```\n\nAdd the following line to your `.bashrc` or `.zshrc` if you're using zsh to enable argument autocompletion (optional):\n\n```bash\ncomplete -W \"--help --user --organization --repo --auth --token --stackoverflow --pwned --extra_checking --mine --html --wordlist --whois --loud --csv --local --name\" git-user.rb\n```\n\nExample command:\n\n`./git-user.rb -t deadb33f... -o Coalfire-Research -r Git-Scrapers -s -p -e -m --html -c`\n\nIf you have two-factor authentication enabled on your GitHub account, you will need to [create](https://help.github.com/en/articles/creating-a-personal-access-token-for-the-command-line) and use an application token instead of your password (using `-t TOKEN` instead of `-a`).\n\nRepo mining will skip forked repos.\n\nHow you can help:\n-----\nCheck out the issues\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fcoalfire-research%2Fgit-scrapers","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fcoalfire-research%2Fgit-scrapers","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fcoalfire-research%2Fgit-scrapers/lists"}