https://github.com/badger-finance/badger-scraper

Scraper bot to validate Badger App DOM
https://github.com/badger-finance/badger-scraper

Last synced: 4 days ago
JSON representation

Scraper bot to validate Badger App DOM

• Host: GitHub
• URL: https://github.com/badger-finance/badger-scraper
• Owner: Badger-Finance
• License: mit
• Created: 2021-12-05T15:38:59.000Z (almost 3 years ago)
• Default Branch: main
• Last Pushed: 2022-09-23T13:53:50.000Z (about 2 years ago)
• Last Synced: 2024-01-23T02:43:54.704Z (10 months ago)
• Language: Python
• Size: 81.1 KB
• Stars: 0
• Watchers: 2
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

README

        
# badger-scraper

[![Test Run](https://github.com/Badger-Finance/badger-scraper/actions/workflows/test-run.yml/badge.svg)](https://github.com/Badger-Finance/badger-scraper/actions/workflows/test-run.yml)

## Scraper bot to validate Badger App DOM

## Overview

There are two dockerfiles:

1. `Dockerfile`: For building the actual service

2. `ui.Dockerfile`: For building and running v2-ui instance in a separate container

It takes around 5 minutes to build UI container, so, scraper service should wait until UI instance responds with 

HTTP 200 and then it can perform content validations

## Installing

```shell

docker-compose build

```

## Running

```shell

docker-compose up

```

This will compare "https://app.badger.com" HTML content against the value URL in 

`BADGER_APP_COMPARE_URL` env var

## Env vars

Check `.env.example` for example.

- `CHROMEDRIVER_PATH` - PATH to docker chromedriver executable. Default is 

`/usr/local/bin/chromedriver` for Docker runtime

- `DISCORD_WEBHOOK_URL` set this so message to discord will be sent

- `BADGER_APP_COMPARE_URL` - website to compare prod badger.app

- `V2_UI_READ_TOKEN` - GH token to be used to clone UI repo