https://github.com/overrevvv/newsscrapperapp
Full Stack Web Scrapper App
https://github.com/overrevvv/newsscrapperapp
axios cheeriojs css expressjs html javascript vuejs
Last synced: 3 months ago
JSON representation
Full Stack Web Scrapper App
- Host: GitHub
- URL: https://github.com/overrevvv/newsscrapperapp
- Owner: OverRevvv
- Created: 2023-05-21T17:19:33.000Z (about 3 years ago)
- Default Branch: main
- Last Pushed: 2023-08-26T13:30:08.000Z (almost 3 years ago)
- Last Synced: 2026-01-03T14:37:25.880Z (6 months ago)
- Topics: axios, cheeriojs, css, expressjs, html, javascript, vuejs
- Language: Vue
- Homepage: https://newsscrapper.vercel.app/
- Size: 4.85 MB
- Stars: 1
- Watchers: 1
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
# NewsScrapper
## What is this?
A full stack news scrapper that is scrapping data from multiple target websites and serving that data via a app.
[🔗 LINK : Click Me!!](https://newsscrapper.vercel.app/)
# Tech
- Vue.js
- Vite.js
- Axios.js
- Cheerio.js
- Express.js
## Setup
Make sure to install the dependencies for both frontend and backend.
for backend
```bash
npm install
```
for frontend
```bash
cd client
npm install
```
## Development
### How it works
- App is divided into two part frontend and backend.
- Frontend (`client` folder) contains Vue + Vite app for development purpose.
- Backend (`root` folder) is express app which serves the `dist` that is build of frontend app and handles `API` data requests made by frontend Vue SPA.
- Backend express app scrapes data from target websites using Cheerio and Axios and send it directly on frontend when `API` requests are made on endpoints.
Start the development backend server on http://localhost:3000
```bash
npm run start
```
Start the development Vue + Vite app server on http://localhost:5172
```bash
cd client
npm run dev
```
build command for frontend Vue + Vite app to update `dist` folder
```bash
cd client
vite build
```