Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

Awesome Lists | Featured Topics | Projects

https://github.com/bro-n-bro/spacebox-crawler

Last synced: 8 days ago
JSON representation

Host: GitHub
URL: https://github.com/bro-n-bro/spacebox-crawler
Owner: bro-n-bro
License: mit
Created: 2022-12-27T16:41:06.000Z (almost 2 years ago)
Default Branch: main
Last Pushed: 2024-09-13T16:46:36.000Z (2 months ago)
Last Synced: 2024-09-14T07:37:49.316Z (2 months ago)
Language: Go
Size: 1.36 MB
Stars: 8
Watchers: 0
Forks: 2
Open Issues: 20
Metadata Files:
- Readme: README.md
- License: LICENSE

Awesome Lists containing this project

README

# Spacebox-crawler

![linter](https://github.com/bro-n-bro/spacebox-crawler/actions/workflows/lint.yml/badge.svg)

Spacebox-crawler is a central part of [Spacebox](https://github.com/bro-n-bro/spacebox) indexer. Crawler pull data from the node, parse, and puts info into appropriate topics in the Apache Kafka.

## build

```bash
docker build -t spacebox-crawler:latest .
```

## run

Running crawler standalone is pretty much pointless, so please refer to the main [Spacebox repo](https://github.com/bro-n-bro/spacebox#readme) to find out how to start the whole setup.