https://github.com/maxgio92/package-crawler

A package crawler for most known Linux distros
https://github.com/maxgio92/package-crawler

crawler go linux package

Last synced: about 1 month ago
JSON representation

A package crawler for most known Linux distros

• Host: GitHub
• URL: https://github.com/maxgio92/package-crawler
• Owner: maxgio92
• Created: 2023-06-30T15:25:24.000Z (over 1 year ago)
• Default Branch: devel
• Last Pushed: 2023-10-26T13:53:20.000Z (about 1 year ago)
• Last Synced: 2024-06-21T17:04:05.857Z (7 months ago)
• Topics: crawler, go, linux, package
• Language: Go
• Homepage:
• Size: 33.2 KB
• Stars: 1
• Watchers: 1
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

README

        
## package-crawler

A crawler for packages distributed by Linux distros. This is a proof of concept for a multi-stage data processing pipeline in Go.

> **Disclaimer**: this project is in experimental stage.

## Quickstart

```shell

package-crawler --all PACKAGE_NAME 2>debug.log 1>result.json

```

## Development

### Testing

All tests:

```

go test -tags all_tests ./...

```

#### Unit tests

All unit tests:

```

go test -tags all_unit_tests ./...

```

Unit tests per feature:

```

go test -tags unit_tests,packages ./...

go test -tags unit_tests,database ./...

go test -tags unit_tests,repository ./...

```

#### Integration tests

All integration tests:

```

go test -tags all_integration_tests ./...

```

Integration tests per feature:

```

go test -tags integration_tests,packages ./...

go test -tags integration_tests,database ./...

go test -tags integration_tests,repository ./...

```