An open API service indexing awesome lists of open source software.

https://github.com/nick-peter-marcus/job-scraper-email-alert

Python script for job alerts and email notification
https://github.com/nick-peter-marcus/job-scraper-email-alert

email-notification python selenium-webdriver webscraping

Last synced: 4 months ago
JSON representation

Python script for job alerts and email notification

Awesome Lists containing this project

README

          

# Python script for job alerts and email notification.

I built this Python script to get email notifications whenever new job ads have been posted on career sites relevant to me.

There is one central, modular script, job_scrape.py, calling individual functions in /websites/ each scraping a different career site.

Each scraper module works as follows:
1. Parse* webpages containing current job listings.
2. Process and store job details in a dictionary.
3. Compare current postings with those from last execution.
4. Extract new postings and, if applicable, filter on relevant criteria (e.g. location).
5. Return a dictionary containing details of the filtered postings, or None when there are no new jobs.

These results are then joined as formatted email texts (MIMEMultipart class) in job_scrape.py. A secured SMTP connection will be started and the email will be send.

This script is executed every 24h as a scheduled task on PythonAnywhere.

*Note:
For static webpages, the BeautifulSoup package is used to scrape and parse HTML-documents.
For dynamic webpages, Selenium's WebDriver is utilized, initiating a headless browser to capture rendered data.