https://github.com/xlisp/ai-auto-crawler
ai-auto-crawler: puppeteer + autogen
https://github.com/xlisp/ai-auto-crawler
autogen crawler gpt puppeteer
Last synced: about 1 month ago
JSON representation
ai-auto-crawler: puppeteer + autogen
- Host: GitHub
- URL: https://github.com/xlisp/ai-auto-crawler
- Owner: xlisp
- Created: 2024-09-29T10:54:27.000Z (about 1 year ago)
- Default Branch: main
- Last Pushed: 2024-10-27T15:03:09.000Z (11 months ago)
- Last Synced: 2025-04-03T12:55:37.099Z (6 months ago)
- Topics: autogen, crawler, gpt, puppeteer
- Language: JavaScript
- Homepage:
- Size: 70.3 KB
- Stars: 5
- Watchers: 1
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
# ai-auto-crawler: puppeteer + autogen
## Init
* Setup python env
```sh
conda create -n ai-auto-crawler python=3.11
conda activate ai-auto-crawler
poetry install
```
```sh
npm install
node crawler.js
```