https://github.com/oliverswitzer/kickstarter-jobs-scraper

A scraper that will notify laid-off employees with recall rights if the Kickstarter jobs page changes
https://github.com/oliverswitzer/kickstarter-jobs-scraper

Last synced: 10 days ago
JSON representation

A scraper that will notify laid-off employees with recall rights if the Kickstarter jobs page changes

• Host: GitHub
• URL: https://github.com/oliverswitzer/kickstarter-jobs-scraper
• Owner: oliverswitzer
• Created: 2020-05-01T18:00:27.000Z (over 4 years ago)
• Default Branch: master
• Last Pushed: 2023-01-31T00:03:49.000Z (almost 2 years ago)
• Last Synced: 2024-04-14T11:53:15.769Z (7 months ago)
• Language: Ruby
• Homepage:
• Size: 28.3 KB
• Stars: 0
• Watchers: 3
• Forks: 1
• Open Issues: 6
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

README

        
# Tl;dr

This project is a scraper that will post to Slack whenever new jobs are posted or removed from the [Kickstarter jobs page](https://www.kickstarter.com/jobs). We run the scraper on a daily basis in Heroku. 

The idea is to give employees who were laid off from Kickstarter in May 2020 who have [recall rights](https://en.wikipedia.org/wiki/Right_of_recall) a way to stay informed on what job positions have been posted.

# New to the codebase?

The main flow is delineated in `core/uses_cases/scrape_and_post_changes.rb`. This will be the most informative file to look 

at to grep what this app is doing.

# Development setup

* Install postgres: `brew install postgresql`

* Create the database: `createdb ksr-jobs-scraper-development`

* Install dependencies: `bundle install`

* Run migrations: `bundle exec ruby migrate.rb`

* Define a `.env` file using `.env.sample` as an example

Then run the app

* `bundle exec ruby app.rb`

### Debugging in console

* Make sure you have the latest version of `pry` installed

  * `gem install pry`

  * `gem install pry-rescue`

  * `gem install pry-byebug`

* Open the console `pry -I . -r app.rb`

### Deploying

* `git push heroku master`

### Running migrations

For right now, it is necessary to run migrations manually when you deploy to heroku. 

To do this:

1. Ensure you've added your migration to `persistence/migrate.rb`

1. Push to heroku `git push heroku master`

1. Run `heroku run "bundle exec ruby persistence/migrate.rb""`