{"id":19946137,"url":"https://github.com/techno-trace/vuescoop-it","last_synced_at":"2025-10-27T05:04:48.240Z","repository":{"id":250287343,"uuid":"833966132","full_name":"techno-trace/vuescoop-it","owner":"techno-trace","description":"This app is for education purposes to show the abilities of the puppeteer framework","archived":false,"fork":false,"pushed_at":"2024-07-26T09:05:22.000Z","size":71,"stargazers_count":1,"open_issues_count":0,"forks_count":0,"subscribers_count":1,"default_branch":"master","last_synced_at":"2025-03-01T14:16:16.106Z","etag":null,"topics":[],"latest_commit_sha":null,"homepage":null,"language":"TypeScript","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/techno-trace.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2024-07-26T06:23:49.000Z","updated_at":"2024-07-26T09:08:10.000Z","dependencies_parsed_at":"2024-07-26T10:27:19.132Z","dependency_job_id":"b8527a1f-3410-4e46-a9e3-88d223d84c5e","html_url":"https://github.com/techno-trace/vuescoop-it","commit_stats":null,"previous_names":["techno-trace/vuescoop-it"],"tags_count":1,"template":false,"template_full_name":null,"purl":"pkg:github/techno-trace/vuescoop-it","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/techno-trace%2Fvuescoop-it","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/techno-trace%2Fvuescoop-it/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/techno-trace%2Fvuescoop-it/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/techno-trace%2Fvuescoop-it/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/techno-trace","download_url":"https://codeload.github.com/techno-trace/vuescoop-it/tar.gz/refs/heads/master","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/techno-trace%2Fvuescoop-it/sbom","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":266076036,"owners_count":23872729,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":[],"created_at":"2024-11-13T00:28:31.042Z","updated_at":"2025-10-27T05:04:43.185Z","avatar_url":"https://github.com/techno-trace.png","language":"TypeScript","funding_links":[],"categories":[],"sub_categories":[],"readme":"# 🌟 VueScoop-It 🌟\n![Puppeteer](https://img.shields.io/badge/Puppeteer-40B5A4?logo=puppeteer\u0026logoColor=white\u0026style=flat)\n![Axios](https://img.shields.io/badge/Axios-671DDF?logo=axios\u0026logoColor=white\u0026style=flat)\n![Winston](https://img.shields.io/badge/Winston-000000?logo=winston\u0026logoColor=white\u0026style=flat)\n![Webpack](https://img.shields.io/badge/Webpack-8DD6F9?logo=webpack\u0026logoColor=black\u0026style=flat)\n![TypeScript](https://img.shields.io/badge/TypeScript-007ACC?logo=typescript\u0026logoColor=white\u0026style=flat)\n![Moment](https://img.shields.io/badge/Moment.js-2D3E50?logo=javascript\u0026logoColor=white\u0026style=flat)\n![Ray](https://img.shields.io/badge/Ray-FFCC00?logo=ray\u0026logoColor=black\u0026style=flat)\n![TypeScript](https://img.shields.io/badge/TypeScript-007ACC?logo=typescript\u0026logoColor=white\u0026style=flat)\n![ts-loader](https://img.shields.io/badge/ts--loader-blue?logo=typescript\u0026logoColor=white\u0026style=flat)\n![Webpack](https://img.shields.io/badge/Webpack-8DD6F9?logo=webpack\u0026logoColor=black\u0026style=flat)\n\n\n## Overview\n**VueScoop-It** is an educational demo project designed to showcase the capabilities of the Puppeteer framework for web scraping and automation. With this tool, you can effortlessly home materials from various sites.\nVueschool.io has excellent courses.\n\n## Features\n- 🌐 **Web Scraping:** Utilizing Puppeteer for efficient web scraping.\n- 📜 **Custom Logging:** Implementing Winston for robust logging functionality.\n- 📊 **Progress Tracking:** Real-time progress bars with CLI-Progress.\n- 🔧 **Configuration Management:** Using dotenv for managing environment variables.\n\n## Installation\n\n### Prerequisites\n- ⚡ Node.js (v14 or above)\n- ⚙️ npm, pnpm, or yarn\n\n### Steps\n\n#### Clone the Repository\n```bash\ngit clone https://github.com/techno-trace/vuescoop-it.git\ncd vuescoop-it\n```\n\n#### Install Dependencies\n\n##### Using npm\n```bash\nnpm install\n```\n\n##### Using pnpm\n```bash\npnpm install\n```\n\n##### Using yarn\n```bash\nyarn install\n```\n\n## Usage\n\n### Scripts\n\n#### 🚀 Start Webpack\n```bash\nnpm run start\n```\nThis command will bundle the project using Webpack.\n\n#### 🏃 Run the Main Script\n```bash\nnpm run go\n```\nThis command executes the `run/run.js` script.\n\n#### 🛠️ Test the Project\n```bash\nnpm run test\n```\nThis command bundles the project, clears any previous data, and runs the main script.\n\n#### 📥 Download Content\n```bash\nnpm run download\n```\nThis command bundles the project and runs the main script to download content.\n\n## Keywords\n- vueschool\n- course downloader\n- vue course downloader\n- vue school\n- vuescoop\n- puppeteer\n- web scraping\n- puppeteer-testing\n- vuescoop-it\n- node js logger\n- logger\n- winston logger\n- custom winston logger\n\n## Technologies Used\n- 🚀 **Puppeteer**\n- 📡 **Axios**\n- 📝 **Winston**\n- 💼 **Webpack**\n\n## Author\n👤 **Digambar Saha**\n\n## License\n📄 This project is licensed under the ISC License.\n\n## Dependencies\nThe project uses several dependencies including but not limited to:\n- 🚀 **Puppeteer**\n- 📡 **Axios**\n- 📝 **Winston**\n- 💼 **Webpack**\n\nFor a complete list, please refer to the `package.json` file.\n\n## Development Dependencies\n- 🔄 TypeScript types for various modules\n- 🔨 ts-loader\n- ⚙️ webpack and webpack-cli\n\n---\n\nFeel free to contribute to this project by submitting issues or pull requests. Happy coding! 🎉","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Ftechno-trace%2Fvuescoop-it","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Ftechno-trace%2Fvuescoop-it","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Ftechno-trace%2Fvuescoop-it/lists"}