https://github.com/hackinggate/go-web-page-fetcher
https://github.com/hackinggate/go-web-page-fetcher
Last synced: 8 months ago
JSON representation
- Host: GitHub
- URL: https://github.com/hackinggate/go-web-page-fetcher
- Owner: HackingGate
- Created: 2023-10-12T07:04:45.000Z (over 2 years ago)
- Default Branch: main
- Last Pushed: 2023-10-26T11:41:47.000Z (over 2 years ago)
- Last Synced: 2024-04-17T00:56:30.450Z (about 2 years ago)
- Language: Go
- Size: 15.6 KB
- Stars: 0
- Watchers: 2
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
## Web Page Fetcher
A simple Go tool to download and save the main content of a given webpage as an HTML file.
### Features
- Downloads the main content of a given webpage as an HTML file.
- Option to display metadata of the fetched webpage, including the number of links, images, and the last fetched timestamp.
### Build and use it directly
Ensure you have Go installed on your machine.
#### Build
```bash
make build
```
#### Usage
```bash
./fetch
```
#### Examples
```bash
./fetch https://www.example.com
./fetch --metadata https://www.example.com
./fetch https://www.example.com https://www.example.com/about
./fetch --metadata https://www.example.com https://www.example.com/about
```
### Build and use it with Docker
Ensure you have Docker installed on your machine.
#### Build
```bash
make docker-build
```
#### Usage
```bash
make docker-run ARGS=" "
```
#### Examples
```bash
make docker-run ARGS="https://www.example.com"
make docker-run ARGS="--metadata https://www.example.com"
make docker-run ARGS="https://www.example.com https://www.example.com/about"
make docker-run ARGS="--metadata https://www.example.com https://www.example.com/about"
```