{"id":26396279,"url":"https://github.com/vipulbunny/web-tech-scanner","last_synced_at":"2026-05-22T14:07:50.765Z","repository":{"id":279473376,"uuid":"938934387","full_name":"VIPULbunny/Web-Tech-Scanner","owner":"VIPULbunny","description":"A Python-based web scraping tool that detects technologies used on a website by analyzing its scripts, meta tags, and HTML content.","archived":false,"fork":false,"pushed_at":"2025-02-27T11:10:38.000Z","size":240,"stargazers_count":0,"open_issues_count":0,"forks_count":0,"subscribers_count":1,"default_branch":"main","last_synced_at":"2025-02-27T15:29:56.983Z","etag":null,"topics":["beautifulsoup","beautifulsoup4","data-analysis","data-science","python","requests","technology-detection","web-scraping"],"latest_commit_sha":null,"homepage":"","language":"Jupyter Notebook","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/VIPULbunny.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2025-02-25T18:19:06.000Z","updated_at":"2025-02-27T11:12:19.000Z","dependencies_parsed_at":"2025-02-27T15:31:45.259Z","dependency_job_id":null,"html_url":"https://github.com/VIPULbunny/Web-Tech-Scanner","commit_stats":null,"previous_names":["vipulbunny/project-004","vipulbunny/web-tech-scanner"],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/VIPULbunny%2FWeb-Tech-Scanner","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/VIPULbunny%2FWeb-Tech-Scanner/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/VIPULbunny%2FWeb-Tech-Scanner/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/VIPULbunny%2FWeb-Tech-Scanner/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/VIPULbunny","download_url":"https://codeload.github.com/VIPULbunny/Web-Tech-Scanner/tar.gz/refs/heads/main","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":244024386,"owners_count":20385414,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["beautifulsoup","beautifulsoup4","data-analysis","data-science","python","requests","technology-detection","web-scraping"],"created_at":"2025-03-17T11:28:06.963Z","updated_at":"2026-05-22T14:07:45.714Z","avatar_url":"https://github.com/VIPULbunny.png","language":"Jupyter Notebook","funding_links":[],"categories":[],"sub_categories":[],"readme":"# 🔍 Technology Detector\n\nA powerful Python-based tool that scrapes a given website and detects the technologies used on it! This tool utilizes web scraping and pattern matching to identify various technologies, frameworks, and libraries implemented in the site's HTML, scripts, and metadata.\n\n## 🚀 Features\n- Scrapes a website and analyzes its **HTML, meta tags, and scripts**\n- Matches technologies against a predefined dataset\n- Provides a **clean and accurate** list of detected technologies\n- Fast and efficient, using **BeautifulSoup** for parsing and **requests** for fetching data\n\n## 📌 Tags\n`Python` `Web Scraping` `Technology Detector` `BeautifulSoup` `Requests` `Automation`\n\n---\n\n## 📥 Installation\n### Prerequisites\nEnsure you have **Python 3.x** installed along with the required libraries.\n\n```sh\npip install pandas requests beautifulsoup4\n```\n\n### Clone the Repository\n```sh\ngit clone https://github.com/yourusername/technology-detector.git\ncd technology-detector\n```\n\n---\n\n## ⚡ Usage\nRun the script and enter a website URL to analyze.\n\n```sh\npython technolog.py\n```\n\n### Example Output:\n```\nEnter the website URL: https://example.com\nFormatted URL: example.com\nTechnologies used in this website: jQuery, Bootstrap, Google Analytics\n```\n\n---\n\n## 🛠 How It Works\n1. **Loads Technology Data** 📂\n   - Fetches a dataset of web technologies from a JSON file.\n   - Converts the dataset into a structured **pandas DataFrame**.\n\n2. **Scrapes the Website** 🌐\n   - Uses `requests` to fetch the page source.\n   - Parses the HTML using `BeautifulSoup`.\n\n3. **Matches Technologies** 🔍\n   - Extracts **scripts, meta tags, and headers** from the website.\n   - Checks for predefined technology patterns.\n   - Returns a list of matched technologies.\n\n---\n\n---\n\n## 🌟 Future Enhancements\n✅ Add support for more technology datasets 🔧\n✅ Improve accuracy with **machine learning-based detection** 🤖\n✅ Build a **GUI or Web Interface** for ease of use 🖥️\n\n---\n\n## 🤝 Contributing\nPull requests are welcome! For major changes, please open an issue first to discuss what you'd like to modify.\n\n---\n\n## 📜 License\nThis project is open-source and available under the **MIT License**.\n\n---\n\n## 📧 Contact\nHave questions or suggestions? Feel free to reach out!\n\n📩 Email: vipulsolanki339@gmail.com  \n🔗 GitHub: [VIPULbunny](https://github.com/VIPULbunny)\n\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fvipulbunny%2Fweb-tech-scanner","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fvipulbunny%2Fweb-tech-scanner","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fvipulbunny%2Fweb-tech-scanner/lists"}