https://github.com/pinjasaur/u-pull-rss
U Pull R Parts junkyard inventory scraped into RSS
https://github.com/pinjasaur/u-pull-rss
Last synced: about 1 month ago
JSON representation
U Pull R Parts junkyard inventory scraped into RSS
- Host: GitHub
- URL: https://github.com/pinjasaur/u-pull-rss
- Owner: Pinjasaur
- License: mit
- Created: 2023-08-14T05:20:04.000Z (almost 3 years ago)
- Default Branch: master
- Last Pushed: 2024-04-12T13:33:46.000Z (about 2 years ago)
- Last Synced: 2026-05-06T11:47:46.554Z (about 2 months ago)
- Homepage: https://pinjasaur.github.io/u-pull-rss/
- Size: 4.58 MB
- Stars: 0
- Watchers: 1
- Forks: 0
- Open Issues: 1
-
Metadata Files:
- Readme: README.md
- Changelog: changelog/2023-08-25.md
- License: LICENSE
Awesome Lists containing this project
README
# u-pull-rss
> [!WARNING]
> This currently doesn't work. The upstream API changed. See .
[U Pull R Parts](https://upullrparts.com/) junkyard inventory scraped into RSS.
## How
There's a scheduled (cron) job that runs daily at 9am UTC via a GitHub Actions pipeline. "Why 9am UTC?", you ask. Because, dear reader, it's early morning CT (3 or 4am, depending on the offset). This job does the following:
- Use the UPRP API to get the inventory as HTML, just like their website
- `curl 'https://upullrparts.com/wp-admin/admin-ajax.php' --compressed -X POST --data-raw 'action=getVehicles'`
- Convert the HTML to Markdown, so each table row is a single line (makes diffing easier)
- Run a diff, deduplicating where necessary (reordered lines) to get the bare additions and removals
- Finesse that into a Markdown code fence as `diff` language stored in YYYY-MM-DD.md format
- Re-build the RSS feed on the fly, converting the Markdown into HTML for the feed item body
The RSS lives at [/feed.rss](./feed.rss). You'd put this URL into your feed reader of choice. If you want a recommendation, I use [Miniflux](https://miniflux.app/).
You can view the current inventory at [/inventory](./inventory) and the changelog index at [/changelog](./changelog).
## Who
Me. It's licensed under [MIT](https://pinjasaur.mit-license.org/2023).
## Why
I wanted to see changes to the junkyard inventory real(ish) time, as well as historically.
## Thanks
Simon Willison for their [article on scraping](https://simonwillison.net/2020/Oct/9/git-scraping/) which I leveraged.