Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/unconv/gpt4v-browsing
Web Scraping with GPT-4 Vision API and Puppeteer
https://github.com/unconv/gpt4v-browsing
Last synced: 3 days ago
JSON representation
Web Scraping with GPT-4 Vision API and Puppeteer
- Host: GitHub
- URL: https://github.com/unconv/gpt4v-browsing
- Owner: unconv
- Created: 2023-11-24T14:04:49.000Z (12 months ago)
- Default Branch: master
- Last Pushed: 2024-01-31T15:42:41.000Z (9 months ago)
- Last Synced: 2024-08-02T15:50:33.716Z (3 months ago)
- Language: JavaScript
- Size: 24.4 KB
- Stars: 515
- Watchers: 11
- Forks: 242
- Open Issues: 2
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
- awesome-ChatGPT-repositories - gpt4v-browsing - Web Scraping with GPT-4 Vision API and Puppeteer (Others)
README
# GPT4 Vision Web Crawling
This is a GPT4 Vision API and Puppeteer powered tool that can answer questions based on website screenshots. You ask it a question and it will browse to a website and take a screenshot. Then it will use GPT4 Vision API to answer the question based on the screenshot.
## JavaScript version
The JavaScript version (`vision_crawl.js`) is able to not only open a URL directly, but it can also click on links on pages.
```shell
$ npm install
$ node vision_crawl.js
```
## Python version
The Python version (`vision_crawl.py`) is the original version, that only opens one URL at a time directly. The Python version uses JavaScript too, for the Puppeteer part.
```shell
$ npm install
$ pip install -r requirements.txt
$ python3 vision_crawl.py
```
## Examples
You can ask stuff like this, for example:
- "What is the weather like in California?"
- "What are the latest news in the world?"
- "What is the current stock price of Tesla?"
- "How many subscribers does Unconventional Coding have on YouTube?"