https://github.com/romainbou/scrape-to-ipfs

A Scaper that adds the files to IPFS
https://github.com/romainbou/scrape-to-ipfs

ipfs

Last synced: 4 months ago
JSON representation

A Scaper that adds the files to IPFS

• Host: GitHub
• URL: https://github.com/romainbou/scrape-to-ipfs
• Owner: romainbou
• License: mit
• Created: 2018-11-30T23:15:23.000Z (over 6 years ago)
• Default Branch: master
• Last Pushed: 2020-08-06T11:11:22.000Z (almost 5 years ago)
• Last Synced: 2025-02-02T07:44:41.394Z (5 months ago)
• Topics: ipfs
• Language: Go
• Homepage:
• Size: 14.6 KB
• Stars: 1
• Watchers: 2
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

README

        
# Static page to IPFS gateway

[![Build Status](https://travis-ci.org/romainbou/scrape-to-ipfs.svg?branch=master)](https://travis-ci.org/romainbou/scrape-to-ipfs)

[![Go Report Card](https://goreportcard.com/badge/github.com/romainbou/scrape-to-ipfs)](https://goreportcard.com/report/github.com/romainbou/scrape-to-ipfs)

Scapes a static web pages and automatically push and serve them via IPFS

## Build and run with Docker

 ```bash

 make image

 make run-docker

 ```

## Test

 ```bash

 make test

 ```

## Environement variables

|  Env        | Default                       |  Description          |

|-------------|-------------------------------|-----------------------|

| PORT        | 8000                          | Server listening port |

| GATEWAY_URL | https://gateway.ipfs.io/ipfs/ | IPFS HTTPS Gateway    |

| IPFS_DAEMON | localhost:5001                | IPFS daemon address   |

| TEMPLATES   | templates/                    | Templates folder      |

## TODO

- [ ] Scrape a page on request and replace or save all relative URLs

- [ ] Push the files to an IPFS daemon

- [x] Redirect to an IPFS gateway

- [ ] Publish the result to IPNS