Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/debugger404/scrape-ai
Scrape-AI is a Python library for intelligent web scraping using LLMs like, OpenAI, Anthropicand Selenium. It dynamically fetches data based on user queries, enabling agent-like scraping with configurable models, modular design, and support for real-time data extraction from dynamic websites.
https://github.com/debugger404/scrape-ai
agent-based anthropic azure chrome-driver dynamic-websites google intelligent-agents large-language-models modular-design python real-time-data selenium web-scraping
Last synced: 3 months ago
JSON representation
Scrape-AI is a Python library for intelligent web scraping using LLMs like, OpenAI, Anthropicand Selenium. It dynamically fetches data based on user queries, enabling agent-like scraping with configurable models, modular design, and support for real-time data extraction from dynamic websites.
- Host: GitHub
- URL: https://github.com/debugger404/scrape-ai
- Owner: deBUGger404
- License: mit
- Created: 2024-09-08T12:52:11.000Z (4 months ago)
- Default Branch: main
- Last Pushed: 2024-09-08T12:54:16.000Z (4 months ago)
- Last Synced: 2024-10-11T18:21:52.930Z (3 months ago)
- Topics: agent-based, anthropic, azure, chrome-driver, dynamic-websites, google, intelligent-agents, large-language-models, modular-design, python, real-time-data, selenium, web-scraping
- Language: Python
- Homepage: https://pypi.org/project/scrapeAI/
- Size: 15.6 KB
- Stars: 1
- Watchers: 2
- Forks: 0
- Open Issues: 0