Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/peterrauscher/NextScraper
A chrome extension for extracting data from dynamically loaded pages, without a headless browser. Jumpstart your next web-scraping project with NextScraper!
https://github.com/peterrauscher/NextScraper
chrome-extension react web-scraping
Last synced: 26 days ago
JSON representation
A chrome extension for extracting data from dynamically loaded pages, without a headless browser. Jumpstart your next web-scraping project with NextScraper!
- Host: GitHub
- URL: https://github.com/peterrauscher/NextScraper
- Owner: peterrauscher
- License: mit
- Created: 2023-11-08T19:39:39.000Z (about 1 year ago)
- Default Branch: main
- Last Pushed: 2024-01-29T23:50:54.000Z (11 months ago)
- Last Synced: 2024-08-21T21:26:37.197Z (5 months ago)
- Topics: chrome-extension, react, web-scraping
- Language: JavaScript
- Homepage: https://chromewebstore.google.com/detail/nextscraper/kjlhnflincmlpkgahnidgebbngieobod
- Size: 174 KB
- Stars: 2
- Watchers: 1
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
# NextScraper
Supercharge your data extraction from Next.js, React, or Redux websites effortlessly.
## Install
[![Chrome][Chrome-image]][Chrome-url]
[Chrome-image]: https://img.shields.io/badge/Google_chrome-4285F4?style=for-the-badge&logo=Google-chrome&logoColor=white
[Chrome-url]: https://chromewebstore.google.com/detail/nextscraper/kjlhnflincmlpkgahnidgebbngieobod
## Features
- **Scrape Data from React/Next.js Sites:** Extract information from dynamic web applications instantly. Analyze and explore it right in NextScraper.
- **Export Data:** Export data from Next.js, React, and Redux sites with ease. Download JSON files in one click.
- **Code Snippet Generator:** Save time by letting NextScraper create fast code snippets that allow you to scrape data _**without**_ loading a headless browser.
## Privacy
No data leaves your browser. Ever. NextScraper does not collect any analytics and the [source code is openly available on Github](https://github.com/peterrauscher/NextScraper). Feel free to build it yourself with the instructions below for your peace of mind.
Read the full [Privacy Policy](/PrivacyPolicy.md) here.
## Building Locally
1. Install Node.js >= 14.18.0. Ideally use the latest LTS version.
2. Clone the Github repository.
3. Switch to the `publish` branch for the latest release.
4. Install dependencies and build:
```bash
npm ci
npm run build
```
5. Visit `chrome://extensions` in Google Chrome.
5. Enable developer mode and select `Load Unpacked`
6. Select the build folder that was created in the project directory.
7. The extension is now installed.
## Development
### Getting Started
1. Install Node.js >= 14.18.0. Ideally use the latest LTS version.
2. Fork or clone the repo.
3. In the project folder:
```bash
npm ci
npm run dev
```
This should create a `build` folder in the project directory.
4. Visit `chrome://extensions` in Google Chrome.
5. Enable developer mode and select `Load Unpacked`
6. Select the build folder that was created.
7. Vite should live-reload any changes as you make them!
### Adding a Feature
The ideal workflow looks something like this.
1. Fork the repository on GitHub.
2. Create a new branch describing the feature you'll work on.
3. Open a pull request to merge your branch with `main`.
4. Await/request review.
5. Your changes will be merged when approved.
## Socials
If you like this extension, please feel free to add me on X, connect with me on LinkedIn, follow my Github or buy me a coffee at the links below!
[](https://twitter.com/peterauscher)
[](https://www.linkedin.com/in/peter-rauscher/)
[](https://github.com/peterrauscher)
[](https://www.buymeacoffee.com/4b2sk4x6mxp)