https://github.com/elek/storagenode-checksum

Utility to double check if all the storaged data of a Storj Storagenode is HEALTHY.
https://github.com/elek/storagenode-checksum

storj

Last synced: 12 days ago
JSON representation

Utility to double check if all the storaged data of a Storj Storagenode is HEALTHY.

• Host: GitHub
• URL: https://github.com/elek/storagenode-checksum
• Owner: elek
• License: agpl-3.0
• Created: 2024-01-12T15:21:06.000Z (12 months ago)
• Default Branch: main
• Last Pushed: 2024-01-12T15:47:11.000Z (12 months ago)
• Last Synced: 2024-10-31T21:13:09.443Z (2 months ago)
• Topics: storj
• Language: Go
• Homepage:
• Size: 33.2 KB
• Stars: 0
• Watchers: 1
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

• awesome-storj - Stored Data checker - Check if data stored on your Storagenode is all good (Clients with Storj support and integrations)

README

        

This is a consistency checker for Storagnodes of the Storj network.

It reads all the blob files (...sj1 files), and recalculates the checksum to compare it with the stored one.

Run it from the storage dir (the dir where you see at least one blobs subfolder).

Install:

```

github.com/elek/storagenode-checker@latest

```

Example:

```

storagenode-checker /storj/storj01/data/storage

```

Example of rotten data:

```

cd /storj/storj01/data/storage

storagenode-checker

checking namespace  7b2de9d72c2e935f1918c058caaf8ed00f0581639008707317ff1bd000000000

hash comparison error: d6b5d209213990998978e2e3c8d455cbc394a069092a88b822a6977686ba0f0b

hash comparison error: d6b5d509f9c818936b72fd93c30dbecf2edf1744f42d71905bdb8ac594dca6fc

hash comparison error: d6b5e4a6eca64fdd0cd2ad2d45dcbfb5d7e9745259775763e456e2ac620f9d6c

```

Follow the progress:

```

export STBB_DEBUG=127.0.0.1:9898

storagenode-checker

```

From different terminal:

```

curl localhost:9898/metrics | grep Checksum_checkBlob | grep count

function_times{kind="success",scope="....",name="Checksum_checkBlob",field="count"} 171569

```