{"id":25381641,"url":"https://github.com/oussemabenhassena5/laptop-scraper","last_synced_at":"2026-04-28T11:01:54.062Z","repository":{"id":275652346,"uuid":"926750473","full_name":"oussemabenhassena5/Laptop-Scraper","owner":"oussemabenhassena5","description":"🕸️ Advanced web scraper for extracting comprehensive laptop product information from TunisiaNet using Python, Selenium, and multi-format data export.","archived":false,"fork":false,"pushed_at":"2025-02-03T21:59:53.000Z","size":346,"stargazers_count":0,"open_issues_count":0,"forks_count":0,"subscribers_count":1,"default_branch":"main","last_synced_at":"2025-04-09T12:36:20.640Z","etag":null,"topics":["python","selenium","webcrawler","webscraping"],"latest_commit_sha":null,"homepage":"","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/oussemabenhassena5.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2025-02-03T19:48:28.000Z","updated_at":"2025-02-05T13:31:11.000Z","dependencies_parsed_at":"2025-02-03T21:22:56.620Z","dependency_job_id":"aa1a27c4-74d3-4a47-8552-2155ff2fae9e","html_url":"https://github.com/oussemabenhassena5/Laptop-Scraper","commit_stats":null,"previous_names":["oussemabenhassena5/laptop-scraper"],"tags_count":0,"template":false,"template_full_name":null,"purl":"pkg:github/oussemabenhassena5/Laptop-Scraper","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/oussemabenhassena5%2FLaptop-Scraper","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/oussemabenhassena5%2FLaptop-Scraper/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/oussemabenhassena5%2FLaptop-Scraper/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/oussemabenhassena5%2FLaptop-Scraper/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/oussemabenhassena5","download_url":"https://codeload.github.com/oussemabenhassena5/Laptop-Scraper/tar.gz/refs/heads/main","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/oussemabenhassena5%2FLaptop-Scraper/sbom","scorecard":null,"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":286080680,"owners_count":32377599,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2026-04-28T09:24:15.638Z","status":"ssl_error","status_checked_at":"2026-04-28T09:24:15.071Z","response_time":56,"last_error":"SSL_connect returned=1 errno=0 peeraddr=140.82.121.6:443 state=error: unexpected eof while reading","robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":false,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["python","selenium","webcrawler","webscraping"],"created_at":"2025-02-15T06:32:09.703Z","updated_at":"2026-04-28T11:01:54.057Z","avatar_url":"https://github.com/oussemabenhassena5.png","language":"Python","funding_links":[],"categories":[],"sub_categories":[],"readme":"# 🚀 TunisiaNet Laptop Scraper\n\n## 📊 Advanced Web Scraping Solution for Tech Products\n\n![Python](https://img.shields.io/badge/Python-3.8+-blue.svg)\n![Selenium](https://img.shields.io/badge/Selenium-Powered-green.svg)\n![Web Scraping](https://img.shields.io/badge/Web-Scraping-orange.svg)\n\n## 🌟 Project Overview\n\n`TunisiaNet Laptop Scraper` is an advanced web scraping tool designed to extract comprehensive product information from TunisiaNet's laptop catalog. This powerful Python script leverages Selenium to navigate, extract, and transform web data into multiple, easily consumable formats.\n\n## ✨ Key Features\n\n- 🔍 Comprehensive Product Scraping\n  - Extract detailed laptop information\n  - Navigate through multiple product pages\n  - Handle dynamic web content\n\n- 📦 Multiple Output Formats\n  - JSON\n  - CSV\n  - Excel\n  - Markdown Report\n  - SQLite Database\n\n- 📈 Advanced Data Visualization\n  - Price distribution plot\n  - Detailed statistical analysis\n\n- 🛡️ Robust Error Handling\n  - Comprehensive logging\n  - Flexible data extraction\n\n## 🛠 Prerequisites\n\n- Python 3.8+\n- Chrome Browser\n- Chrome WebDriver\n\n## 🚀 Quick Setup\n\n1. Clone the Repository\n```bash\ngit clone https://github.com/yourusername/Laptop-Scraper.git\ncd Laptop-Scraper\n```\n\n2. Create Virtual Environment\n```bash\npython3 -m venv venv\nsource venv/bin/activate  # On Windows, use `venv\\Scripts\\activate`\n```\n\n3. Install Dependencies\n```bash\npip install -r requirements.txt\n```\n\n## 🖥️ Usage\n\nRun the scraper:\n```bash\npython scraper.py\n```\n\n## 📂 Project Structure\n```\nLaptop-Scraper/\n│\n├── scraper.py         # Main scraping script\n├── requirements.txt   # Project dependencies\n├── results/           # Output directory\n│   ├── products.json\n│   ├── products.csv\n│   ├── products.xlsx\n│   ├── products_report.md\n│   └── price_distribution.png\n│\n└── logs/              # Logging directory\n    └── tunisianet_scraper_TIMESTAMP.log\n```\n\n## 🎯 Output Examples\n\n### 📊 JSON Sample\n```json\n{\n        \"title\": \"Pc Portable HP 15-Fd0051nk / I3-N305 / 32 Go / 512 Go SSD / Gold\",\n        \"reference\": \"[A2AN9EA-32]\",\n        \"description\": \"Écran Full HD 15.6\\\" (1920 x 1080), antireflet - Processeur Intel Core i3-N305, (jusqu’à 3.8 GHz, 6 Mo de mémoire cache) - Mémoire 32 Go DDR4 - Disque SSD NVMe M.2 512 Go - Carte graphique Intel UHD Intégré - Wi-Fi 6 - Bluetooth 5.3 - Clavier complet gris clair avec pavé numérique - Caméra HP True Vision HD 720p - Doubles haut-parleurs - 1x USB-C - 2x USB-A - 1x HDMI 1.4b - 1x prise combinée casque/microphone - FreeDOS - Couleur Gold - Garantie 1 an\",\n        \"price\": \"1 305,000 DT\",\n        \"availability\": \"En stock\",\n        \"img_url\": \"https://www.tunisianet.com.tn/401810-home/pc-portable-dell-vostro-3530-i3-1305u-24-go-512-go-ssd-noir.jpg\"\n    }\n```\n\n### 📈 Price Distribution Visualization\n![Price Distribution](results/price_distribution.png)\n\n### 📄 Markdown Report Snapshot\n- **Total Products:** 714\n- **Price Analysis:**\n  - Minimum Price: 500 DT\n  - Maximum Price: 13000 DT\n  - Average Price: 1500 DT\n\n## 🤝 Contributing\n\n1. Fork the repository\n2. Create your feature branch\n3. Commit your changes\n4. Push to the branch\n5. Create a Pull Request\n\n## ⚠️ Disclaimer\n\nThis tool is for educational purposes. Always respect website terms of service and robots.txt.\n\n## 📜 License\n\nMIT License\n\n\n---\n\n**Happy Scraping! 🕷️📊**","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Foussemabenhassena5%2Flaptop-scraper","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Foussemabenhassena5%2Flaptop-scraper","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Foussemabenhassena5%2Flaptop-scraper/lists"}