https://github.com/apify/crawlee-parallel-scraping-example

An example repository showcasing how you can scrape in parallel using one request queue
https://github.com/apify/crawlee-parallel-scraping-example

Last synced: 8 months ago
JSON representation

An example repository showcasing how you can scrape in parallel using one request queue

• Host: GitHub
• URL: https://github.com/apify/crawlee-parallel-scraping-example
• Owner: apify
• Created: 2023-12-01T14:46:50.000Z (over 2 years ago)
• Default Branch: dev
• Last Pushed: 2023-12-15T02:38:49.000Z (over 2 years ago)
• Last Synced: 2024-12-24T22:36:36.811Z (over 1 year ago)
• Language: TypeScript
• Size: 71.3 KB
• Stars: 4
• Watchers: 4
• Forks: 0
• Open Issues: 1
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

README

          
# Crawlee Parallel Scraping example

An example repository of how you can build a scraper that can scrape a website in parallel.

If you're looking for examples or want to learn more visit:

-   [Documentation](https://crawlee.dev/api/playwright-crawler/class/PlaywrightCrawler)

-   [Examples](https://crawlee.dev/docs/examples/playwright-crawler)