https://github.com/hadley/available-work

Scrape Weston Lambert's available products
https://github.com/hadley/available-work

Last synced: 2 months ago
JSON representation

Scrape Weston Lambert's available products

• Host: GitHub
• URL: https://github.com/hadley/available-work
• Owner: hadley
• License: mit
• Created: 2023-09-21T13:43:27.000Z (over 1 year ago)
• Default Branch: main
• Last Pushed: 2025-04-11T21:22:10.000Z (2 months ago)
• Last Synced: 2025-04-11T22:30:29.529Z (2 months ago)
• Language: R
• Homepage:
• Size: 213 KB
• Stars: 16
• Watchers: 2
• Forks: 5
• Open Issues: 2
• Metadata Files:
  • Readme: README.md
  • License: LICENSE.md

Awesome Lists containing this project

• jimsghstars - hadley/available-work - Scrape Weston Lambert's available products (Dockerfile)

README

        
# Weston Lambert's available work

This repo demonstrates a [GitHub action](.github/workflows/scrape.yaml) that every 3 hours scrapes Weston Lambert's [available work](http://www.westonlambert.com) page. It records the currently available products to [products.csv](products.csv), and there are any new products that are unsold, sends me a [push notification](https://github.com/hadley/available-work/blob/main/scrape.R#L43-L47) using [ntfy.sh](https://ntfy.sh).

It uses a staged deployment process where [deploy.yaml](.github/workflows/deploy.yml) creates a docker container when you tag a commit. Then [run.yml](.github/workflows/run.yml) checks out that container and runs [scrape.R](scrape.R) every three hours.