Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/dms-codes/scrape_dosen_unand
Web Scraping with Python This Python script is used for web scraping data from a website of Unand University's lecturers' directory.
https://github.com/dms-codes/scrape_dosen_unand
python scraping webscraping
Last synced: 2 days ago
JSON representation
Web Scraping with Python This Python script is used for web scraping data from a website of Unand University's lecturers' directory.
- Host: GitHub
- URL: https://github.com/dms-codes/scrape_dosen_unand
- Owner: dms-codes
- Created: 2023-10-10T22:52:51.000Z (over 1 year ago)
- Default Branch: main
- Last Pushed: 2023-10-11T01:32:22.000Z (over 1 year ago)
- Last Synced: 2023-10-11T05:41:05.659Z (over 1 year ago)
- Topics: python, scraping, webscraping
- Language: Python
- Homepage: https://github.com/dms-codes/scrape_dosen_unand
- Size: 12.7 KB
- Stars: 0
- Watchers: 1
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
# Web Scraping with Python
This Python script is used for web scraping data from a website of Unand University's lecturers' directory.
## Table of Contents
- [Overview](#overview)
- [Prerequisites](#prerequisites)
- [Usage](#usage)
- [Functionality](#functionality)
- [Code Explanation](#code-explanation)
- [License](#license)## Overview
This script scrapes data of lecturers from the Unand University directory website. The data includes information such as name, NIP, NIDN, gender, status, position, unit, faculty, rank, and the highest education level attained by the lecturers. The script navigates through the pages and profiles to extract this data and saves it to a CSV file for further analysis or use.
## Prerequisites
Before running the script, ensure you have the following prerequisites:
1. Python 3 installed on your system.
2. Required Python libraries (`requests`, `BeautifulSoup`, `csv`).
3. Active internet connection to fetch web content.You can install the necessary libraries using pip:
```bash
pip install requests beautifulsoup4