https://github.com/nagilum/mirror
A simple console app to download a website
https://github.com/nagilum/mirror
Last synced: 3 months ago
JSON representation
A simple console app to download a website
- Host: GitHub
- URL: https://github.com/nagilum/mirror
- Owner: nagilum
- License: mit
- Created: 2022-03-20T01:51:22.000Z (about 3 years ago)
- Default Branch: main
- Last Pushed: 2022-03-20T21:44:54.000Z (about 3 years ago)
- Last Synced: 2025-01-16T13:47:53.162Z (4 months ago)
- Language: C#
- Size: 12.7 KB
- Stars: 0
- Watchers: 2
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- License: LICENSE.md
Awesome Lists containing this project
README
# Mirror
A console app to download a local copy of a website.
The user provides the URL.
The program downloads the URL to a local copy, and tries to analyze it for further links to follow on the same domain.
Rinse and repeat till all links are exhausted.
## Where Are The Files?
The files are stored under `local-copies` folder created where the app runs.
## Reports
The app also creates a report JSON file that holds some metadata, errors that happened while scanning, and a list of all URLs that was scanned.
The report is stored in the same folder as the executable, and is called `scan-report-{yyyy}-{MM}-{dd}-{HH}-{mm}-{ss}.json`.
## How To Run
You either run it through the dotnet CLI, by invoking it as such:
```
dotnet run
```
Example:
```
dotnet run https://microsoft.com
```
Or, of course, compile your own executable and just run it with the URL as the parameter.
## Other Options
There are two options apart from the URL.
Set timeout for all HTTP calls. Defaults to 5 seconds.
```
-t
```
Set path to store the local copies and reports. Defaults to current working directory.
```
-p
```