{"id":30864887,"url":"https://github.com/threadlinee/web-scraper","last_synced_at":"2026-02-14T10:31:37.412Z","repository":{"id":258390862,"uuid":"873844802","full_name":"Threadlinee/Web-Scraper","owner":"Threadlinee","description":"Simple Web-Scraper made using Python... *_*","archived":false,"fork":false,"pushed_at":"2024-10-16T20:23:41.000Z","size":6,"stargazers_count":2,"open_issues_count":0,"forks_count":0,"subscribers_count":1,"default_branch":"main","last_synced_at":"2025-05-03T11:19:29.940Z","etag":null,"topics":["information-gathering","python","script","web-scraper","website"],"latest_commit_sha":null,"homepage":"","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/Threadlinee.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2024-10-16T20:19:33.000Z","updated_at":"2025-04-12T21:30:49.000Z","dependencies_parsed_at":"2024-10-18T19:36:25.058Z","dependency_job_id":"feec2264-806c-4118-a28e-b2f9acadc2ca","html_url":"https://github.com/Threadlinee/Web-Scraper","commit_stats":null,"previous_names":["dionabazi/web-scraper","540sno/web-scraper","threadlinee/web-scraper"],"tags_count":0,"template":false,"template_full_name":null,"purl":"pkg:github/Threadlinee/Web-Scraper","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Threadlinee%2FWeb-Scraper","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Threadlinee%2FWeb-Scraper/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Threadlinee%2FWeb-Scraper/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Threadlinee%2FWeb-Scraper/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/Threadlinee","download_url":"https://codeload.github.com/Threadlinee/Web-Scraper/tar.gz/refs/heads/main","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Threadlinee%2FWeb-Scraper/sbom","scorecard":null,"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":274088636,"owners_count":25220261,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","status":"online","status_checked_at":"2025-09-07T02:00:09.463Z","response_time":67,"last_error":null,"robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":true,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["information-gathering","python","script","web-scraper","website"],"created_at":"2025-09-07T20:15:28.164Z","updated_at":"2026-02-14T10:31:37.375Z","avatar_url":"https://github.com/Threadlinee.png","language":"Python","funding_links":["https://ko-fi.com/dionabazi"],"categories":[],"sub_categories":[],"readme":"# Web-Scraper\nWeb Scraper 🌐\n\nA simple yet powerful web scraping tool built with Python, designed to extract data from websites seamlessly. This project utilizes requests and BeautifulSoup to scrape and parse HTML content, making it easy for users to gather the information they need from the web.\nFeatures ✨\n\n    User-friendly: Simple command-line interface for ease of use.\n    Customizable: Easily modify the target URL and scraping parameters.\n    Data Extraction: Extracts specific data points from HTML elements.\n    Export Options: Save scraped data in various formats (e.g., CSV, JSON).\n\nInstallation 🛠️\n\n    Clone the repository:\n\n\ngit clone https://github.com/dionabazi/Web-Scraper.git\n\ncd Web-Scraper\n\nInstall required libraries using the requirements.txt file:\n\nbash\n\n    pip install -r requirements.txt --break-system-packages\n\nUsage 🚀\n\n    Open the command line and navigate to the project directory.\n\n    Run the scraper with the desired URL:\n\n    python web_scraper.py \u003ctarget_url\u003e\n\n    Follow the prompts to specify the data you wish to extract.\n\nContributing 🤝\n\nContributions are welcome! If you have suggestions for improvements or new features, please fork the repository and submit a pull request.\nLicense 📄\n\nThis project is licensed under the MIT License. See the LICENSE file for details.\n\nScreenshots\n\n![Screenshot_2024-10-16_16_20_51](https://github.com/user-attachments/assets/9f3f1462-23ce-4034-bba5-070cff8f6de3)\n\n\n![Screenshot_2024-10-16_16_22_01](https://github.com/user-attachments/assets/43870a84-ffb4-4ad4-a1e8-f251fdde1dc2)\n\n\n[![bmc-button (2)](https://github.com/user-attachments/assets/8a994d82-5bf8-480e-9e64-728d5aba2e14)](https://ko-fi.com/dionabazi)\n\nThank you for your support! 💕\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fthreadlinee%2Fweb-scraper","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fthreadlinee%2Fweb-scraper","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fthreadlinee%2Fweb-scraper/lists"}