{"id":25473587,"url":"https://github.com/isathyam31/insightscraper","last_synced_at":"2026-04-27T11:31:23.184Z","repository":{"id":243442607,"uuid":"812425848","full_name":"iSathyam31/InsightScraper","owner":"iSathyam31","description":"InsightScraper is an application that scrapes and analyzes website content, then generates summaries using Google's Gemini Pro model. Unlock insights effortlessly!","archived":false,"fork":false,"pushed_at":"2024-06-08T21:34:26.000Z","size":9,"stargazers_count":0,"open_issues_count":0,"forks_count":0,"subscribers_count":1,"default_branch":"main","last_synced_at":"2025-05-17T20:35:31.282Z","etag":null,"topics":["google-generative-ai","streamlit"],"latest_commit_sha":null,"homepage":"","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"apache-2.0","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/iSathyam31.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2024-06-08T21:22:42.000Z","updated_at":"2025-01-04T05:45:48.000Z","dependencies_parsed_at":null,"dependency_job_id":"6bb00b64-6c09-4419-9e18-17ddee16816c","html_url":"https://github.com/iSathyam31/InsightScraper","commit_stats":null,"previous_names":["isathyam31/insightscraper"],"tags_count":0,"template":false,"template_full_name":null,"purl":"pkg:github/iSathyam31/InsightScraper","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/iSathyam31%2FInsightScraper","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/iSathyam31%2FInsightScraper/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/iSathyam31%2FInsightScraper/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/iSathyam31%2FInsightScraper/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/iSathyam31","download_url":"https://codeload.github.com/iSathyam31/InsightScraper/tar.gz/refs/heads/main","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/iSathyam31%2FInsightScraper/sbom","scorecard":null,"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":286080680,"owners_count":32335295,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2026-04-26T23:26:28.701Z","status":"online","status_checked_at":"2026-04-27T02:00:06.769Z","response_time":128,"last_error":null,"robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":true,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["google-generative-ai","streamlit"],"created_at":"2025-02-18T10:35:13.813Z","updated_at":"2026-04-27T11:31:23.179Z","avatar_url":"https://github.com/iSathyam31.png","language":"Python","funding_links":[],"categories":[],"sub_categories":[],"readme":"## Introduction\nThis is a Python application that leverages Google's Gemini Pro model to analyze the content of a website and generate insightful summaries. It utilizes web scraping techniques to extract textual content from a given URL and then processes this content through the Gemini Pro model to provide detailed insights.\n\n\n## Installation\nTo set up the environment and install the required dependencies, follow these steps:\n\n1. Clone the repository:\n```\ngit clone https://github.com/iSathyam31/InsightScraper.git\n```\n\n2. Navigate to the project directory:\n\n3. Create a virtual environment and activate it(optional but recommended):\n```\nconda create -p venv python=3.11 -y\nconda activate venv/\n```\n\n4. Install the required packages:\n```\npip install -r requirements.txt\n```\n\n\n## Usage\n\nTo run the GeminiWeb Analyzer, follow these steps:\n\n1. Ensure that your virtual environment is activated (if you created one).\n\n2. Run the Streamlit app:\n```\nstreamlit run main.py\n```\n\n\n3. Open your web browser and navigate to the provided URL (typically http://localhost:8501).\n\n4. Enter the URL of the website you want to analyze in the input field.\n\n5. Click on the \"Analyze Website\" button.\n\n6. Wait for the analysis to complete. The app will display the website content and the generated summary from the Gemini Pro model.\n\n\n## Dependencies\n\n- [Streamlit](https://streamlit.io/)\n- [Google's GenerativeAI](https://pypi.org/project/google-generativeai/)\n- [Requests](https://pypi.org/project/requests/)\n- [Beautiful Soup](https://pypi.org/project/beautifulsoup4/)\n\n## Contributing\n\nContributions to GeminiWeb Analyzer are welcome! If you encounter any issues or have suggestions for improvements, please feel free to open an issue or submit a pull request.\n\n## License\n\nThis project is licensed under the Apache License. See the [LICENSE](LICENSE) file for details.","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fisathyam31%2Finsightscraper","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fisathyam31%2Finsightscraper","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fisathyam31%2Finsightscraper/lists"}