Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/imthaghost/goclone
Website Cloner - Utilizes powerful Go routines to clone websites to your computer within seconds.
https://github.com/imthaghost/goclone
cloning crawler go golang website-cloner website-scraper
Last synced: 3 days ago
JSON representation
Website Cloner - Utilizes powerful Go routines to clone websites to your computer within seconds.
- Host: GitHub
- URL: https://github.com/imthaghost/goclone
- Owner: imthaghost
- License: mit
- Created: 2020-03-23T01:09:12.000Z (almost 5 years ago)
- Default Branch: master
- Last Pushed: 2024-03-10T18:34:58.000Z (10 months ago)
- Last Synced: 2024-12-14T14:02:40.286Z (10 days ago)
- Topics: cloning, crawler, go, golang, website-cloner, website-scraper
- Language: Go
- Homepage: https://goclone.io
- Size: 123 MB
- Stars: 1,395
- Watchers: 29
- Forks: 297
- Open Issues: 21
-
Metadata Files:
- Readme: README.md
- Contributing: docs/CONTRIBUTING.md
- License: LICENSE
Awesome Lists containing this project
README
Copy websites to your computer! Goclone is a utility that allows you to download a website from the Internet to a local directory. Get html, css, js, images, and other files from the server to your computer. Goclone arranges the original site's relative link-structure. Simply open a page of the "mirrored" website in your browser, and you can browse the site from link to link as if you were viewing it online.
## Table of Contents
- [Installation](#installation)
- [Brew](#brew)
- [Manual](#manual)
- [Examples](#examples)
- [Contributors](#contributors)
## 🚀 Installation
### Brew
```bash
# tap
brew tap imthaghost/goclone
# install tool
brew install goclone
```
### Manual
```bash
# Go version >= 1.20
go install github.com/imthaghost/goclone/cmd/goclone@latest
```
#### Or
```bash
# go get :)
go get github.com/imthaghost/goclone
# change to project directory using your GOPATH
cd $GOPATH/src/github.com/imthaghost/goclone/cmd/goclone
# build and install application
go install
```
## Examples
```bash
# goclone
goclone https://configtree.co
```
## Usage
```
Usage:
goclone [flags]
Flags:
-C, --cookie strings Pre-set these cookies
-h, --help help for goclone
-o, --open Automatically open project in default browser
-p, --proxy_string string Proxy connection string. Support http and socks5 https://pkg.go.dev/github.com/gocolly/colly#Collector.SetProxy
-s, --serve Serve the generated files using Echo.
-P, --servePort int Serve port number. (default 5000)
-u, --user_agent string Custom User Agent
```
## Contributors
Contributions are welcome! Please see [Contributing Guide](https://github.com/imthaghost/goclone/blob/master/docs/CONTRIBUTING.md) for more details.
Tha Ghost
💻
Juan Mesaglio
💻
Ben Lafferty
💻
Omar Sagoo
💻