https://github.com/yagolopez/webscrapping-microservices
Experimental Microservices for Data Adquisition using Web Scrapping
https://github.com/yagolopez/webscrapping-microservices
isomorphic-javascript nextjs reactjs server-side-rendering ssr universal-javascript webscrapping
Last synced: 28 days ago
JSON representation
Experimental Microservices for Data Adquisition using Web Scrapping
- Host: GitHub
- URL: https://github.com/yagolopez/webscrapping-microservices
- Owner: YagoLopez
- Created: 2020-07-13T22:12:23.000Z (almost 5 years ago)
- Default Branch: master
- Last Pushed: 2023-01-06T11:25:06.000Z (over 2 years ago)
- Last Synced: 2025-04-09T18:15:02.735Z (28 days ago)
- Topics: isomorphic-javascript, nextjs, reactjs, server-side-rendering, ssr, universal-javascript, webscrapping
- Language: TypeScript
- Homepage: https://webscrapping-microservices.vercel.app
- Size: 1.12 MB
- Stars: 1
- Watchers: 1
- Forks: 0
- Open Issues: 11
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
# Experimental Microservices for Data Adquisition using Web Scrapping
[![Repository stats](https://github-readme-stats.vercel.app/api?username=YagoLopez&hide=["contribs"])](https://github.com/anuraghazra/github-readme-stats)
## Features 🛠️
- React Hooks
- Server Side Rendering with Nextjs
- WebScrapping based on Cheerio library
- [Universal/Isomorphic](https://en.wikipedia.org/wiki/Isomorphic_JavaScript) Javascript
- Microservices accesible as REST endpoints
- Typescript
## Demo
- https://webscrapping-microservices.vercel.app/
## Run and build
```bash
# install dependencies
$ npm install
# list available scripts
$ npm run
# serve with hot reload at localhost:3000
$ npm run dev
# build for production
$ npm run build
# Run production build
$ npm run start
# Compile API docs in doc directory
$ npm run gen:doc
```
## Endpoints
- https://webscrapping-microservices.vercel.app/api/extract-text?url=
- https://webscrapping-microservices.vercel.app/api/github-trending-repos
## API Docs
- [Documentation](https://yagolopez.js.org/webscrapping-microservices/docs/index.html)
## Audit
- [Link](https://lighthouse-dot-webdotdevsite.appspot.com//lh/html?url=https%3A%2F%2Fwebscrapping-microservices.vercel.app%2F)