{"id":13707040,"url":"https://github.com/shurco/goClone","last_synced_at":"2025-05-05T23:32:07.272Z","repository":{"id":179642362,"uuid":"663916563","full_name":"shurco/goClone","owner":"shurco","description":"🌱 goClone - clone websites in seconds","archived":false,"fork":false,"pushed_at":"2025-05-05T12:38:25.000Z","size":7447,"stargazers_count":69,"open_issues_count":1,"forks_count":4,"subscribers_count":2,"default_branch":"main","last_synced_at":"2025-05-05T13:49:37.633Z","etag":null,"topics":["cloner","cloning","crawler","crawling","go","goclone","golang","hacktoberfest","scraping","scraping-websites","scrapper","website-cloner","website-scraper","wp2static"],"latest_commit_sha":null,"homepage":"","language":"Go","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/shurco.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":".github/CODEOWNERS","security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null,"zenodo":null},"funding":{"github":"shurco"}},"created_at":"2023-07-08T12:36:12.000Z","updated_at":"2025-05-05T12:38:23.000Z","dependencies_parsed_at":"2023-10-12T06:51:46.535Z","dependency_job_id":"5818f009-e937-4045-9f7a-3211ad6c4179","html_url":"https://github.com/shurco/goClone","commit_stats":null,"previous_names":["shurco/goclone"],"tags_count":4,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/shurco%2FgoClone","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/shurco%2FgoClone/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/shurco%2FgoClone/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/shurco%2FgoClone/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/shurco","download_url":"https://codeload.github.com/shurco/goClone/tar.gz/refs/heads/main","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":252593305,"owners_count":21773441,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["cloner","cloning","crawler","crawling","go","goclone","golang","hacktoberfest","scraping","scraping-websites","scrapper","website-cloner","website-scraper","wp2static"],"created_at":"2024-08-02T22:01:16.342Z","updated_at":"2025-05-05T23:32:02.260Z","avatar_url":"https://github.com/shurco.png","language":"Go","funding_links":["https://github.com/sponsors/shurco"],"categories":["Go"],"sub_categories":[],"readme":"# 🌱 goClone\n\n\u003ca href=\"https://github.com/shurco/goClone/releases\"\u003e\u003cimg src=\"https://img.shields.io/github/v/release/shurco/goclone?sort=semver\u0026label=Release\u0026color=651FFF\"\u003e\u003c/a\u003e\n\u003ca href=\"https://goreportcard.com/report/github.com/shurco/goClone\"\u003e\u003cimg src=\"https://goreportcard.com/badge/github.com/shurco/goClone\"\u003e\u003c/a\u003e\n\u003ca href=\"https://www.codefactor.io/repository/github/shurco/goclone\"\u003e\u003cimg src=\"https://www.codefactor.io/repository/github/shurco/goclone/badge\" alt=\"CodeFactor\" /\u003e\u003c/a\u003e\n\u003ca href=\"https://github.com/shurco/goClone/actions/workflows/release.yml\"\u003e\u003cimg src=\"https://github.com/shurco/goClone/actions/workflows/release.yml/badge.svg\"\u003e\u003c/a\u003e\n\u003ca href=\"https://github.com/shurco/goClone/blob/master/LICENSE\"\u003e\u003cimg src=\"https://img.shields.io/badge/License-MIT-yellow.svg\"\u003e\u003c/a\u003e\n\n\ngoClone is a powerful utility that enables you to effortlessly download entire websites from the Internet and save them to your local directory. With goClone, you can easily obtain HTML, CSS, JavaScript, images, and other associated files directly from the server and store them on your computer.\n\nOne of the standout features of goClone is its ability to accurately preserve the original website's relative link structure. This means that when you open any page of the \"mirrored\" website in your browser, you can seamlessly navigate through the site by following links just as if you were browsing it online.\n\ngoClone empowers you to have offline access to websites, making it convenient for various purposes such as research, archiving, or simply enjoying a website without an internet connection.\n\nSo go ahead, give goClone a try and experience the freedom of having your favorite websites at your fingertips, even when you're offline!\n\n![Example](/.github/media/example.gif)\n\n\u003ca name=\"macos\"\u003e\u003c/a\u003e\n## MacOS installing\n\n```shell\n$ brew install shurco/tap/goclone\n```\n\nAlternately, you can configure the tap and install the package separately:\n\n``` shell\n$ brew tap shurco/tap\n$ brew install goclone\n```\n\n\n\u003ca name=\"manual\"\u003e\u003c/a\u003e\n\n## Manual\n\n```bash\n# go get :)\ngo get github.com/shurco/goClone\n# change to project directory using your GOPATH\ncd $GOPATH/src/github.com/shurco/goClone/cmd\n# build and install application\ngo install\n```\n\n\n\u003ca name=\"examples\"\u003e\u003c/a\u003e\n\n## Examples\n\n```bash\n# goclone \u003curl\u003e\ngoclone https://domain.com\n```\n\n\u003ca name=\"usage\"\u003e\u003c/a\u003e\n\n## Usage\n\n```\nUsage:\n  goclone \u003curl\u003e [flags]\n\nFlags:\n  -b, --browser_endpoint string   chrome headless browser WS endpoint\n  -c, --cookie                    if set true, cookies won't send\n  -h, --help                      help for goclone\n  -o, --open                      automatically open project in default browser\n  -p, --proxy_string string       proxy connection string\n  -r, --robots                    disable robots.txt checks\n  -s, --serve                     serve the generated files using gofiber\n  -P, --servePort int             serve port number (default 8088)\n  -u, --user_agent string         custom User-Agent (default \"goclone\")\n  -v, --version                   version for goclone\n```\n\n## Making JS Rendered Requests\n\nJS Rendered requests can be made using ```-b``` flag. For example start image :  \n\n\n``` bash\ndocker run -d -p 9222:9222 --rm --name headless-shell chromedp/headless-shell\n```\n\nthen run goclone: \n\n```bash\ngoclone -b \"ws://localhost:9222\" https://domain.com\n```\n\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fshurco%2FgoClone","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fshurco%2FgoClone","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fshurco%2FgoClone/lists"}