{"id":13454592,"url":"https://github.com/arthaud/git-dumper","last_synced_at":"2025-05-13T16:06:47.718Z","repository":{"id":19319558,"uuid":"86774943","full_name":"arthaud/git-dumper","owner":"arthaud","description":"A tool to dump a git repository from a website","archived":false,"fork":false,"pushed_at":"2024-11-23T19:11:03.000Z","size":53,"stargazers_count":2058,"open_issues_count":9,"forks_count":268,"subscribers_count":19,"default_branch":"master","last_synced_at":"2025-04-10T20:51:52.117Z","etag":null,"topics":["git","security","web"],"latest_commit_sha":null,"homepage":null,"language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/arthaud.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2017-03-31T03:39:53.000Z","updated_at":"2025-04-10T18:45:07.000Z","dependencies_parsed_at":"2024-01-25T19:05:10.785Z","dependency_job_id":"bb356bef-c63a-48a2-a108-cc8b011432ee","html_url":"https://github.com/arthaud/git-dumper","commit_stats":{"total_commits":59,"total_committers":15,"mean_commits":3.933333333333333,"dds":0.5084745762711864,"last_synced_commit":"d0e70672190f54636c94e51529a2f3f34fe90527"},"previous_names":[],"tags_count":2,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/arthaud%2Fgit-dumper","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/arthaud%2Fgit-dumper/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/arthaud%2Fgit-dumper/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/arthaud%2Fgit-dumper/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/arthaud","download_url":"https://codeload.github.com/arthaud/git-dumper/tar.gz/refs/heads/master","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":250513380,"owners_count":21443200,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["git","security","web"],"created_at":"2024-07-31T08:00:55.662Z","updated_at":"2025-04-23T20:44:34.374Z","avatar_url":"https://github.com/arthaud.png","language":"Python","readme":"# git-dumper\n\nA tool to dump a git repository from a website.\n\n## Install\n\nThis can be installed easily with pip:\n```\npip install git-dumper\n```\n\n## Usage\n\n```\nusage: git-dumper [options] URL DIR\n\nDump a git repository from a website.\n\npositional arguments:\n  URL                   url\n  DIR                   output directory\n\noptional arguments:\n  -h, --help            show this help message and exit\n  --proxy PROXY         use the specified proxy\n  -j JOBS, --jobs JOBS  number of simultaneous requests\n  -r RETRY, --retry RETRY\n                        number of request attempts before giving up\n  -t TIMEOUT, --timeout TIMEOUT\n                        maximum time in seconds before giving up\n  -u USER_AGENT, --user-agent USER_AGENT\n                        user-agent to use for requests\n  -H HEADER, --header HEADER\n                        additional http headers, e.g `NAME=VALUE`\n  --client-cert-p12 CLIENT_CERT_P12\n                        client certificate in PKCS#12 format\n  --client-cert-p12-password CLIENT_CERT_P12_PASSWORD\n                        password for the client certificate\n```\n\n### Example\n\n```\ngit-dumper http://website.com/.git ~/website\n```\n\n### Disclaimer\n\n**Use this software at your own risk!**\n\nYou should know that if the repository you are downloading is controlled by an attacker,\nthis could lead to remote code execution on your machine.\n\n## Build from source\n\nSimply install the dependencies with pip:\n```\npip install -r requirements.txt\n```\n\nThen, simply use:\n```\n./git_dumper.py http://website.com/.git ~/website\n```\n\n## How does it work?\n\nThe tool will first check if directory listing is available. If it is, then it will just recursively download the .git directory (what you would do with `wget`).\n\nIf directory listing is not available, it will use several methods to find as many files as possible. Step by step, git-dumper will:\n* Fetch all common files (`.gitignore`, `.git/HEAD`, `.git/index`, etc.);\n* Find as many refs as possible (such as `refs/heads/master`, `refs/remotes/origin/HEAD`, etc.) by analyzing `.git/HEAD`, `.git/logs/HEAD`, `.git/config`, `.git/packed-refs` and so on;\n* Find as many objects (sha1) as possible by analyzing `.git/packed-refs`, `.git/index`, `.git/refs/*` and `.git/logs/*`;\n* Fetch all objects recursively, analyzing each commits to find their parents;\n* Run `git checkout .` to recover the current working tree\n","funding_links":[],"categories":["Python","Web Exploitation","Miscellaneous","Python (1887)","Tools","Web","Git"],"sub_categories":["Web-accessible source code ripping tools","Git","Defense Evasion","Web Accessible Source Code Ripping Tools","XSS"],"project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Farthaud%2Fgit-dumper","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Farthaud%2Fgit-dumper","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Farthaud%2Fgit-dumper/lists"}