https://github.com/akunna1/offline-web-scraper
Offline R Web Scraper of the HTML page of the Neptune Technologies (NP) Job Application Platform I built (i.e term_project.html) months earlier
https://github.com/akunna1/offline-web-scraper
html r-programming rvest scraping xml2
Last synced: 6 months ago
JSON representation
Offline R Web Scraper of the HTML page of the Neptune Technologies (NP) Job Application Platform I built (i.e term_project.html) months earlier
- Host: GitHub
- URL: https://github.com/akunna1/offline-web-scraper
- Owner: akunna1
- Created: 2024-08-01T23:47:40.000Z (almost 2 years ago)
- Default Branch: main
- Last Pushed: 2024-08-02T00:22:53.000Z (almost 2 years ago)
- Last Synced: 2025-01-31T22:07:23.123Z (over 1 year ago)
- Topics: html, r-programming, rvest, scraping, xml2
- Language: HTML
- Homepage: https://akunnatechstudio.com/scraping
- Size: 10.7 KB
- Stars: 0
- Watchers: 1
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
# Offline-Web-Scraper
An **offline R-based web scraper** built to extract key content from the `term_project.html` file of the **Neptune Technologies Job Application Platform**.
---
## Project Purpose
This scraper is designed for **analyzing the HTML structure** of a previously built static webpage—`term_project.html`—without requiring an internet connection.
---
## What It Does
The R script parses a local HTML file and extracts:
* Page title
* All headings (`
`–``)
* Paragraph text
* Links (anchor `` tags)
* Specific content from targeted sections using CSS selectors
---
## 📦 Tools & Libraries Used
* `rvest` – for web scraping
* `xml2` – to read and parse HTML
* `dplyr` – for data wrangling
* Base R functions
---
## 📝 How to Use
1. Save your `term_project.html` file locally in your R working directory
2. Run the scraper script in RStudio or your preferred IDE
3. View the output in the console or export to `.csv` or `.txt` for further analysis