{"id":15769511,"url":"https://github.com/btc415/web-scraping-extension","last_synced_at":"2025-04-21T04:31:08.526Z","repository":{"id":228840433,"uuid":"775062635","full_name":"BTC415/Web-Scraping-Extension","owner":"BTC415","description":"A chrome extension for extracting data from dynamically loaded pages, without a headless browser. Jumpstart your next web-scraping project!","archived":false,"fork":false,"pushed_at":"2024-03-20T17:37:49.000Z","size":169,"stargazers_count":5,"open_issues_count":0,"forks_count":1,"subscribers_count":1,"default_branch":"main","last_synced_at":"2024-10-11T14:15:32.139Z","etag":null,"topics":[],"latest_commit_sha":null,"homepage":"","language":"JavaScript","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/BTC415.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null}},"created_at":"2024-03-20T17:33:14.000Z","updated_at":"2024-09-02T14:38:35.000Z","dependencies_parsed_at":"2024-03-20T19:10:09.537Z","dependency_job_id":null,"html_url":"https://github.com/BTC415/Web-Scraping-Extension","commit_stats":null,"previous_names":["btc415/web-scraping-extension"],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/BTC415%2FWeb-Scraping-Extension","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/BTC415%2FWeb-Scraping-Extension/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/BTC415%2FWeb-Scraping-Extension/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/BTC415%2FWeb-Scraping-Extension/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/BTC415","download_url":"https://codeload.github.com/BTC415/Web-Scraping-Extension/tar.gz/refs/heads/main","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":223849432,"owners_count":17213640,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":[],"created_at":"2024-10-04T14:03:07.917Z","updated_at":"2024-11-09T16:02:34.608Z","avatar_url":"https://github.com/BTC415.png","language":"JavaScript","funding_links":[],"categories":[],"sub_categories":[],"readme":"\n## Install\n\n[![Chrome][Chrome-image]][Chrome-url]\n\n[Chrome-image]: https://img.shields.io/badge/Google_chrome-4285F4?style=for-the-badge\u0026logo=Google-chrome\u0026logoColor=white\n[Chrome-url]: https://chromewebstore.google.com/detail/nextscraper/kjlhnflincmlpkgahnidgebbngieobod\n\n## Features\n\n- **Scrape Data from React/Next.js Sites:** Extract information from dynamic web applications instantly. Analyze and explore it right in NextScraper.\n- **Export Data:** Export data from Next.js, React, and Redux sites with ease. Download JSON files in one click.\n- **Code Snippet Generator:** Save time by letting NextScraper create fast code snippets that allow you to scrape data _**without**_ loading a headless browser.\n\n## Privacy\n\nNo data leaves your browser. Ever. This extension does not collect any analytics and the [source code is openly available on Github](https://github.com/BTC415/Web-Scraping-Extension). Feel free to build it yourself with the instructions below for your peace of mind.\n\nRead the full [Privacy Policy](/PrivacyPolicy.md) here.\n\n## Building Locally\n\n1. Install Node.js \u003e= 14.18.0. Ideally use the latest LTS version.\n2. Clone the Github repository.\n3. Switch to the `publish` branch for the latest release.\n4. Install dependencies and build:\n    ```bash\n    npm ci\n    npm run build\n    ```\n5. Visit `chrome://extensions` in Google Chrome.\n5. Enable developer mode and select `Load Unpacked`\n6. Select the build folder that was created in the project directory.\n7. The extension is now installed.\n\n## Development\n\n### Getting Started\n\n1. Install Node.js \u003e= 14.18.0. Ideally use the latest LTS version.\n2. Fork or clone the repo.\n3. In the project folder:\n    ```bash\n    npm ci\n    npm run dev\n    ```\n    This should create a `build` folder in the project directory.\n\n4. Visit `chrome://extensions` in Google Chrome.\n5. Enable developer mode and select `Load Unpacked`\n6. Select the build folder that was created.\n7. Vite should live-reload any changes as you make them!\n\n### Adding a Feature\nThe ideal workflow looks something like this.\n\n1. Fork the repository on GitHub.\n2. Create a new branch describing the feature you'll work on.\n3. Open a pull request to merge your branch with `main`.\n4. Await/request review.\n5. Your changes will be merged when approved.\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fbtc415%2Fweb-scraping-extension","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fbtc415%2Fweb-scraping-extension","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fbtc415%2Fweb-scraping-extension/lists"}