Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/techno-trace/vuescoop-it
This app is for education purposes to show the abilities of the puppeteer framework
https://github.com/techno-trace/vuescoop-it
Last synced: 13 days ago
JSON representation
This app is for education purposes to show the abilities of the puppeteer framework
- Host: GitHub
- URL: https://github.com/techno-trace/vuescoop-it
- Owner: techno-trace
- Created: 2024-07-26T06:23:49.000Z (6 months ago)
- Default Branch: master
- Last Pushed: 2024-07-26T09:05:22.000Z (6 months ago)
- Last Synced: 2024-11-13T00:32:08.251Z (2 months ago)
- Language: TypeScript
- Size: 69.3 KB
- Stars: 1
- Watchers: 1
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
# 🌟 VueScoop-It 🌟
## Overview
**VueScoop-It** is an educational demo project designed to showcase the capabilities of the Puppeteer framework for web scraping and automation. With this tool, you can effortlessly home materials from various sites.
Vueschool.io has excellent courses.
## Features
- 🌐 **Web Scraping:** Utilizing Puppeteer for efficient web scraping.
- 📜 **Custom Logging:** Implementing Winston for robust logging functionality.
- 📊 **Progress Tracking:** Real-time progress bars with CLI-Progress.
- 🔧 **Configuration Management:** Using dotenv for managing environment variables.
## Installation
### Prerequisites
- ⚡ Node.js (v14 or above)
- ⚙️ npm, pnpm, or yarn
### Steps
#### Clone the Repository
```bash
git clone https://github.com/techno-trace/vuescoop-it.git
cd vuescoop-it
```
#### Install Dependencies
##### Using npm
```bash
npm install
```
##### Using pnpm
```bash
pnpm install
```
##### Using yarn
```bash
yarn install
```
## Usage
### Scripts
#### 🚀 Start Webpack
```bash
npm run start
```
This command will bundle the project using Webpack.
#### 🏃 Run the Main Script
```bash
npm run go
```
This command executes the `run/run.js` script.
#### 🛠️ Test the Project
```bash
npm run test
```
This command bundles the project, clears any previous data, and runs the main script.
#### 📥 Download Content
```bash
npm run download
```
This command bundles the project and runs the main script to download content.
## Keywords
- vueschool
- course downloader
- vue course downloader
- vue school
- vuescoop
- puppeteer
- web scraping
- puppeteer-testing
- vuescoop-it
- node js logger
- logger
- winston logger
- custom winston logger
## Technologies Used
- 🚀 **Puppeteer**
- 📡 **Axios**
- 📝 **Winston**
- 💼 **Webpack**
## Author
👤 **Digambar Saha**
## License
📄 This project is licensed under the ISC License.
## Dependencies
The project uses several dependencies including but not limited to:
- 🚀 **Puppeteer**
- 📡 **Axios**
- 📝 **Winston**
- 💼 **Webpack**
For a complete list, please refer to the `package.json` file.
## Development Dependencies
- 🔄 TypeScript types for various modules
- 🔨 ts-loader
- ⚙️ webpack and webpack-cli
---
Feel free to contribute to this project by submitting issues or pull requests. Happy coding! 🎉