https://github.com/isathyam31/insightscraper
InsightScraper is an application that scrapes and analyzes website content, then generates summaries using Google's Gemini Pro model. Unlock insights effortlessly!
https://github.com/isathyam31/insightscraper
google-generative-ai streamlit
Last synced: 2 months ago
JSON representation
InsightScraper is an application that scrapes and analyzes website content, then generates summaries using Google's Gemini Pro model. Unlock insights effortlessly!
- Host: GitHub
- URL: https://github.com/isathyam31/insightscraper
- Owner: iSathyam31
- License: apache-2.0
- Created: 2024-06-08T21:22:42.000Z (about 2 years ago)
- Default Branch: main
- Last Pushed: 2024-06-08T21:34:26.000Z (about 2 years ago)
- Last Synced: 2025-05-17T20:35:31.282Z (about 1 year ago)
- Topics: google-generative-ai, streamlit
- Language: Python
- Homepage:
- Size: 8.79 KB
- Stars: 0
- Watchers: 1
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
## Introduction
This is a Python application that leverages Google's Gemini Pro model to analyze the content of a website and generate insightful summaries. It utilizes web scraping techniques to extract textual content from a given URL and then processes this content through the Gemini Pro model to provide detailed insights.
## Installation
To set up the environment and install the required dependencies, follow these steps:
1. Clone the repository:
```
git clone https://github.com/iSathyam31/InsightScraper.git
```
2. Navigate to the project directory:
3. Create a virtual environment and activate it(optional but recommended):
```
conda create -p venv python=3.11 -y
conda activate venv/
```
4. Install the required packages:
```
pip install -r requirements.txt
```
## Usage
To run the GeminiWeb Analyzer, follow these steps:
1. Ensure that your virtual environment is activated (if you created one).
2. Run the Streamlit app:
```
streamlit run main.py
```
3. Open your web browser and navigate to the provided URL (typically http://localhost:8501).
4. Enter the URL of the website you want to analyze in the input field.
5. Click on the "Analyze Website" button.
6. Wait for the analysis to complete. The app will display the website content and the generated summary from the Gemini Pro model.
## Dependencies
- [Streamlit](https://streamlit.io/)
- [Google's GenerativeAI](https://pypi.org/project/google-generativeai/)
- [Requests](https://pypi.org/project/requests/)
- [Beautiful Soup](https://pypi.org/project/beautifulsoup4/)
## Contributing
Contributions to GeminiWeb Analyzer are welcome! If you encounter any issues or have suggestions for improvements, please feel free to open an issue or submit a pull request.
## License
This project is licensed under the Apache License. See the [LICENSE](LICENSE) file for details.