https://github.com/apify/scrapy-migrator
A standalone POC script for wrapping Scrapy projects with Apify middleware.
https://github.com/apify/scrapy-migrator
Last synced: 7 months ago
JSON representation
A standalone POC script for wrapping Scrapy projects with Apify middleware.
- Host: GitHub
- URL: https://github.com/apify/scrapy-migrator
- Owner: apify
- Created: 2023-10-06T15:36:55.000Z (over 2 years ago)
- Default Branch: master
- Last Pushed: 2023-12-15T02:15:24.000Z (over 2 years ago)
- Last Synced: 2025-02-16T16:19:55.439Z (over 1 year ago)
- Language: Python
- Size: 15.6 KB
- Stars: 1
- Watchers: 4
- Forks: 0
- Open Issues: 1
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
# scrapy-migrator
A standalone POC script for wrapping Scrapy projects with Apify middleware.
## Usage
```bash
npm i
## This runs the migration on the example project (./tutorial)
node ./src/index.js
cd tutorial
## This runs the example project wrapped in Apify middleware
pip install -r requirements.txt -r requirements_apify.txt
python -m tutorial
```