https://github.com/goclone-dev/goclone
Website Cloner - Utilizes powerful Go routines to clone websites to your computer within seconds.
https://github.com/goclone-dev/goclone
cloning crawler go golang website-cloner website-scraper
Last synced: 9 months ago
JSON representation
Website Cloner - Utilizes powerful Go routines to clone websites to your computer within seconds.
- Host: GitHub
- URL: https://github.com/goclone-dev/goclone
- Owner: goclone-dev
- License: mit
- Created: 2020-03-23T01:09:12.000Z (almost 6 years ago)
- Default Branch: master
- Last Pushed: 2025-04-14T11:00:42.000Z (10 months ago)
- Last Synced: 2025-04-14T23:17:22.787Z (10 months ago)
- Topics: cloning, crawler, go, golang, website-cloner, website-scraper
- Language: Go
- Homepage: https://goclone.io
- Size: 123 MB
- Stars: 1,503
- Watchers: 30
- Forks: 310
- Open Issues: 16
-
Metadata Files:
- Readme: README.md
- Contributing: docs/CONTRIBUTING.md
- License: LICENSE
Awesome Lists containing this project
README
Copy websites to your computer! Goclone is a utility that allows you to download a website from the Internet to a local directory. Get html, css, js, images, and other files from the server to your computer. Goclone arranges the original site's relative link-structure. Simply open a page of the "mirrored" website in your browser, and you can browse the site from link to link as if you were viewing it online.
## Table of Contents
- [Installation](#installation)
- [Brew](#brew)
- [Manual](#manual)
- [Examples](#examples)
- [Contributors](#contributors)
## 🚀 Installation
### Brew
```bash
# tap
brew tap goclone-dev/goclone
# install tool
brew install goclone
```
### Manual
```bash
# Go version >= 1.20
go install github.com/goclone-dev/goclone/cmd/goclone@latest
```
#### Or
```bash
# Clone the repository
git clone https://github.com/goclone-dev/goclone.git
cd goclone
# Build and run
go build -o goclone cmd/goclone/main.go
# Move binary to a directory in your PATH (optional)
mv goclone /usr/local/bin/
```
## Examples
```bash
# goclone
goclone https://configtree.co
```
## Usage
```
Usage:
goclone [flags]
Flags:
-C, --cookie strings Pre-set these cookies
-h, --help help for goclone
-o, --open Automatically open project in default browser
-p, --proxy_string string Proxy connection string. Support http and socks5 https://pkg.go.dev/github.com/gocolly/colly#Collector.SetProxy
-s, --serve Serve the generated files using Echo.
-P, --servePort int Serve port number. (default 5000)
-u, --user_agent string Custom User Agent
```
## Contributors
Contributions are welcome! Please see [Contributing Guide](https://github.com/goclone-dev/goclone/blob/master/docs/CONTRIBUTING.md) for more details.
Tha Ghost
💻
Juan Mesaglio
💻
Ben Lafferty
💻
Omar Sagoo
💻