https://github.com/iiakshat/bing-jobs
https://github.com/iiakshat/bing-jobs
Last synced: about 1 month ago
JSON representation
- Host: GitHub
- URL: https://github.com/iiakshat/bing-jobs
- Owner: iiakshat
- Created: 2024-05-25T17:21:30.000Z (11 months ago)
- Default Branch: main
- Last Pushed: 2024-05-27T17:08:10.000Z (11 months ago)
- Last Synced: 2025-01-20T19:25:07.687Z (3 months ago)
- Language: Python
- Size: 7.81 KB
- Stars: 0
- Watchers: 1
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
# Job Scraper using BeautifulSoup for Bing
This project is a web application built with Flask that takes a URL from Microsoft Bing's job search page, scrapes job details using BeautifulSoup, and outputs the results as a JSON file.
## Features
- Input a URL from Microsoft Bing's job search page.
- Scrape job details such as job titles, companies, and locations.
- Download the scraped job details as a JSON file.
## Prerequisites
Before you begin, ensure you have the following installed:
- Python 3.x
- Flask
- BeautifulSoup4
- Requests
## Installation
__Clone the repository:__
```bash
git clone https://github.com/yourusername/job-scraper-flask.git
cd job-scraper-flask
```
__Create and activate a virtual environment:__
```bash
python -m venv venv
source venv/bin/activate # On Windows use `venv\Scripts\activate
```
__Install the required packages:__
```bash
pip install -r requirements.txt
```
__Start the Flask application:__
```bash
python app.py
```
__Open your web browser and navigate to http://127.0.0.1:5000/__
__Enter a Bing job search URL (e.g., https://www.bing.com/jobs?q=ml+jobs&scp=0&rb=0&rc=20&L2=true&c=1&form=JOBL2S) and click the submit button.__
__The application will scrape job details and will automatically download a JSON file containing the results.__
## How to Use?
- ### Search for any job role, scroll down and navigate to jobs tab:
- ### Click on 'See more listings` and Copy the URL from the header:
- ### Go to `http://127.0.0.1:5000/`, and paste the URL in the input area:
- ### Hit `Submit` and download will begin automatically:
