https://github.com/digital-technology-agency/web-scan

A program that generates a combination of letters from the alphabet and composes an address for accessing the site.After that, it reads the data from the title and description of this site and saves it to the structure. At the end, the program displays all the titles and descriptions of the available sites.
https://github.com/digital-technology-agency/web-scan

alphabet channels fun generate go golang golang-package gorutines scanner simple webscan

Last synced: 5 months ago
JSON representation

A program that generates a combination of letters from the alphabet and composes an address for accessing the site.After that, it reads the data from the title and description of this site and saves it to the structure. At the end, the program displays all the titles and descriptions of the available sites.

• Host: GitHub
• URL: https://github.com/digital-technology-agency/web-scan
• Owner: digital-technology-agency
• License: mit
• Created: 2021-08-23T05:55:03.000Z (about 4 years ago)
• Default Branch: master
• Last Pushed: 2021-11-09T06:13:11.000Z (almost 4 years ago)
• Last Synced: 2024-06-19T06:56:50.093Z (over 1 year ago)
• Topics: alphabet, channels, fun, generate, go, golang, golang-package, gorutines, scanner, simple, webscan
• Language: Go
• Homepage: https://dta.agency
• Size: 5.86 MB
• Stars: 12
• Watchers: 3
• Forks: 1
• Open Issues: 18
• Metadata Files:
  • Readme: README.md
  • Contributing: CONTRIBUTING.md
  • Funding: .github/FUNDING.yml
  • License: LICENSE
  • Code of conduct: CODE_OF_CONDUCT.md

Awesome Lists containing this project

README

          
# web-scan



[![Donate](https://img.shields.io/badge/Donat-For%20project-yellow)](https://www.donationalerts.com/r/dta_agency)

![Platform](https://img.shields.io/badge/platform-win%20%7C%20mac%20%7C%20linux-blue)

# Intro

[![GoDoc](https://godoc.org/github.com/digital-technology-agency/web-scan?status.svg)](https://godoc.org/github.com/digital-technology-agency/web-scan)

[![Go](https://github.com/digital-technology-agency/web-scan/actions/workflows/go.yml/badge.svg)](https://github.com/digital-technology-agency/web-scan/actions/workflows/go.yml)

[![Go Report Card](https://goreportcard.com/badge/github.com/digital-technology-agency/web-scan)](https://goreportcard.com/report/github.com/digital-technology-agency/web-scan)

[![License](http://img.shields.io/badge/Licence-MIT-brightgreen.svg)](LICENSE)

[![Website dta.agency](https://img.shields.io/website-up-down-green-red/http/shields.io.svg)](https://dta.agency)

[![GitHub release](https://img.shields.io/github/v/release/digital-technology-agency/web-scan)](https://github.com/digital-technology-agency/web-scan/releases/latest)

 


A program that generates a combination of letters from the alphabet and composes an address for accessing the site.After

that, it reads the data from the title and description of this site and saves it to the structure. At the end, the

program displays all the titles and descriptions of the available sites.

## Usage

### [golang/cmd/go](https://golang.org/cmd/go/)

```bash

go get github.com/digital-technology-agency/web-scan

```

## Data store

* sqlite - SQLite

* jsoneachrow - Json Each row

## Generator type

- simple - Simple generator type

## Init configuration file

```bash

$ ./wscan init

```

---

#### Configuration file `config.json`

```json

{

  "process_count": 1,

  "alphabet": "abcdefgefghijklmnop",

  "url_len": 5,

  "concurrency_count": 5,

  "data_store_type": "sqlite",

  "generator_type": "simple",

  "protocol_types": [

    "http",

    "https"

  ]

}

```

## Run

```bash

$ ./wscan -configuration_file config.json

```