https://github.com/elc/web-scraping-pipeline

This is a demo project to compare two web scrapping frameworks, Playwright and Selenium and using the new Pipelining tool Dagster
https://github.com/elc/web-scraping-pipeline

async benchmark dagster helium neptune-ai python selenium webscraping

Last synced: 3 months ago
JSON representation

This is a demo project to compare two web scrapping frameworks, Playwright and Selenium and using the new Pipelining tool Dagster

• Host: GitHub
• URL: https://github.com/elc/web-scraping-pipeline
• Owner: ELC
• Created: 2021-09-07T13:00:13.000Z (over 3 years ago)
• Default Branch: master
• Last Pushed: 2021-09-09T01:57:12.000Z (over 3 years ago)
• Last Synced: 2024-10-11T11:59:24.651Z (4 months ago)
• Topics: async, benchmark, dagster, helium, neptune-ai, python, selenium, webscraping
• Language: Python
• Homepage:
• Size: 311 KB
• Stars: 13
• Watchers: 2
• Forks: 0
• Open Issues: 0

Awesome Lists containing this project