{"id":50889725,"url":"https://github.com/install-it/it-claws","last_synced_at":"2026-06-15T20:31:34.355Z","repository":{"id":296793120,"uuid":"983901990","full_name":"install-it/it-claws","owner":"install-it","description":"Automates the process of find and download the latest softwares and tools.","archived":false,"fork":false,"pushed_at":"2026-06-12T17:03:11.000Z","size":254,"stargazers_count":0,"open_issues_count":0,"forks_count":0,"subscribers_count":1,"default_branch":"main","last_synced_at":"2026-06-12T19:06:10.439Z","etag":null,"topics":["driver","python","scraper","selenium","webscrapping"],"latest_commit_sha":null,"homepage":"","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"gpl-2.0","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/install-it.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null,"zenodo":null,"notice":null,"maintainers":null,"copyright":null,"agents":null,"dco":null,"cla":null}},"created_at":"2025-05-15T05:07:29.000Z","updated_at":"2026-06-06T12:24:38.000Z","dependencies_parsed_at":"2025-09-26T11:15:06.909Z","dependency_job_id":"4faeefcc-80bd-403d-931b-186bf3d595b9","html_url":"https://github.com/install-it/it-claws","commit_stats":null,"previous_names":["markmybytes/driver-scraper","markmybytes/driver-claw","driverbox/driver-claw","install-it/it-claws"],"tags_count":13,"template":false,"template_full_name":null,"purl":"pkg:github/install-it/it-claws","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/install-it%2Fit-claws","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/install-it%2Fit-claws/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/install-it%2Fit-claws/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/install-it%2Fit-claws/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/install-it","download_url":"https://codeload.github.com/install-it/it-claws/tar.gz/refs/heads/main","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/install-it%2Fit-claws/sbom","scorecard":null,"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":286080680,"owners_count":34379915,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2026-05-26T15:22:16.424Z","status":"online","status_checked_at":"2026-06-15T02:00:07.085Z","response_time":63,"last_error":null,"robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":true,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["driver","python","scraper","selenium","webscrapping"],"created_at":"2026-06-15T20:31:33.352Z","updated_at":"2026-06-15T20:31:34.347Z","avatar_url":"https://github.com/install-it.png","language":"Python","funding_links":[],"categories":[],"sub_categories":[],"readme":"# it-claws\n\n\u003ca id=\"readme-top\"\u003e\u003c/a\u003e\n\n\u003c!-- PROJECT SHIELDS --\u003e\n\u003cdiv align=\"center\"\u003e\n\n[![Tag][tag-shield]][tag-url]\n[![Contributors][contributors-shield]][contributors-url]\n[![Forks][forks-shield]][forks-url]\n[![Stargazers][stars-shield]][stars-url]\n[![Issues][issues-shield]][issues-url]\n[![License][license-shield]][license-url]\n\n\u003c/div\u003e\n\n\u003c!-- PROJECT LOGO --\u003e\n\u003cbr /\u003e\n\u003cdiv align=\"center\"\u003e\n  \u003ca href=\"https://github.com/install-it/it-claws\"\u003e\n    \u003cimg src=\"https://github.com/user-attachments/assets/83d46686-2893-41c1-9077-ef0fede26dcc\" alt=\"Logo\" width=\"892\" height=\"552\"\u003e\n  \u003c/a\u003e\n\n  \u003ch3 align=\"center\"\u003eit-claws\u003c/h3\u003e\n\n  \u003cp align=\"center\"\u003e\n    Automated concurrent scraper for staging PC driver deployment environments\n    \u003cbr /\u003e\n    \u003ca href=\"https://github.com/install-it/it-claws/issues/new?labels=bug\u0026template=bug-report---.md\"\u003eReport Bug\u003c/a\u003e\n    ·\n    \u003ca href=\"https://github.com/install-it/it-claws/issues/new?labels=enhancement\u0026template=feature-request---.md\"\u003eRequest Feature\u003c/a\u003e\n  \u003c/p\u003e\n\u003c/div\u003e\n\n\u003c!-- ABOUT THE PROJECT --\u003e\n\n## About The Project\n\nit-claws is a Python-based tool that automatically downloads the latest PC hardware drivers, diagnostic tools, and common software from official vendor websites. Using Selenium for browser automation and httpx for static requests, it navigates vendor sites to retrieve up-to-date installation packages — suitable for staging driver packs for enterprise deployment.\n\nUnlike simple download utilities, it-claws runs concurrently with configurable retry logic, supports dynamic and static page scraping, and can pack everything into a compressed ZIP archive via 7z.\n\nThe tool serves as a companion to [install-it](https://github.com/install-it/install-it/). See the [Usage](#usage) section for more information.\n\nit-claws also supports **Docker** deployment with tmpfs RAM disk and automated cloud upload via rclone. See [scripts](scripts/) for the automation pipeline.\n\n\u003cp align=\"right\"\u003e(\u003ca href=\"#readme-top\"\u003eback to top\u003c/a\u003e)\u003c/p\u003e\n\n### Built With\n\n[\u003cimg src=\"https://img.shields.io/badge/7zip-000?style=for-the-badge\u0026logo=7zip\u0026logoColor=white\"\u003e](https://www.7-zip.org/)\n[\u003cimg src=\"https://img.shields.io/badge/Python-3776AB?style=for-the-badge\u0026logo=python\u0026logoColor=white\"\u003e](https://www.python.org/)\n[\u003cimg src=\"https://img.shields.io/badge/Selenium-01a71c?style=for-the-badge\u0026logo=selenium\u0026logoColor=white\"\u003e](https://www.selenium.dev/)\n[\u003cimg src=\"https://img.shields.io/badge/httpx-FF6600?style=for-the-badge\u0026logo=python\u0026logoColor=white\"\u003e](https://www.python-httpx.org/)\n\n\u003cp align=\"right\"\u003e(\u003ca href=\"#readme-top\"\u003eback to top\u003c/a\u003e)\u003c/p\u003e\n\n\u003c!-- USAGE --\u003e\n\n## Usage\n\n### Basic flow\n\n1. **Select targets**\n   - Use `-t` to specify space-separated target names\n   - Use `-i` for interactive selection\n   - Use `--all` to select all targets\n   - Use `--target-from \u003cfile\u003e` to load a preset text file\n\n2. **Download**\n   - The tool resolves download URLs (static or dynamic)\n   - Files are downloaded concurrently with configurable retries\n\n3. **Archive \u0026 output**\n   - Results are staged in the output directory\n   - Optionally pack into a compressed ZIP archive\n\n### Selecting targets\n\n```sh\nit-claws -t \"AMD Chipset Drivers\" \"Realtek HD Universal Audio\"\nit-claws -i\nit-claws --all\n```\n\nUse a preset file (one target per line, `#` for comments):\n\n```sh\nit-claws --target-from presets/default.txt\n```\n\nCombine with interactive to tweak the preset before running:\n\n```sh\nit-claws --target-from presets/default.txt -i\n```\n\n### Output options\n\n```sh\nit-claws -o ./my-drivers -f my-custom-folder --max-concurrent 10\n```\n\n### Resilience \u0026 archiving\n\n```sh\nit-claws -o ./downloads -a ./driver-pack.zip --retries 2 -l 9\n```\n\n- `--retries`: retry attempts per failed download (default: `1`)\n- `-a` / `--archive-path`: destination for the output ZIP archive\n- `-l` / `--compress-level`: 7z compression level `0`–`9` (default: `5`)\n\n### Extract RAR files on Linux\n\nThe `7z` package may not support RAR format. Install `p7zip-full p7zip-rar` as an alternative.\n\n\u003cp align=\"right\"\u003e(\u003ca href=\"#readme-top\"\u003eback to top\u003c/a\u003e)\u003c/p\u003e\n\n\u003c!-- DEPLOYMENT --\u003e\n\n## Deployment\n\nThis project can be deployed via Docker with tmpfs RAM disk and automated rclone upload. See [`scripts/`](scripts/) for the automation pipeline and environment variable reference.\n\n```bash\ndocker run --rm --privileged \\\n  -v /my/host/config:/config \\\n  -e RC_REMOTE_PATH=\"onedrive:PC_Deployments\" \\\n  -e RETRIES=\"2\" \\\n  -e COMPRESS_LEVEL=\"9\" \\\n  it-claws\n```\n\nOverride the default command:\n\n```bash\ndocker run --name=it-claws \\\n  -v /path/to/config:/config \\\n  ghcr.io/install-it/it-claws:latest \\\n  it-claws -t \"AMD Chipset Drivers\" \"Realtek HD Universal Audio\"\n```\n\n\u003cp align=\"right\"\u003e(\u003ca href=\"#readme-top\"\u003eback to top\u003c/a\u003e)\u003c/p\u003e\n\n\u003c!-- GETTING STARTED --\u003e\n\n## Getting Started\n\n### Prerequisites\n\n- [uv](https://docs.astral.sh/uv/)\n- [7zip](https://www.7-zip.org/download.html)\n- A supported web browser (Chrome, Edge, or Firefox)\n\n### Install dependencies\n\n```bash\nuv sync\n\nuv sync --group dev # install dev dependencies\n```\n\n### Common commands\n\n**Run the scraper**\n\n```bash\nit-claws\n```\n\n**Display help**\n\n```bash\nit-claws -h\n```\n\n\u003cp align=\"right\"\u003e(\u003ca href=\"#readme-top\"\u003eback to top\u003c/a\u003e)\u003c/p\u003e\n\n\u003c!-- MARKDOWN LINKS \u0026 IMAGES --\u003e\n\n[tag-url]: https://github.com/install-it/it-claws/releases\n[tag-shield]: https://img.shields.io/github/v/tag/install-it/it-claws?style=for-the-badge\u0026label=LATEST\u0026color=%23B1B1B1\n[contributors-shield]: https://img.shields.io/github/contributors/install-it/it-claws.svg?style=for-the-badge\n[contributors-url]: https://github.com/install-it/it-claws/graphs/contributors\n[forks-shield]: https://img.shields.io/github/forks/install-it/it-claws.svg?style=for-the-badge\n[forks-url]: https://github.com/install-it/it-claws/network/members\n[stars-shield]: https://img.shields.io/github/stars/install-it/it-claws.svg?style=for-the-badge\n[stars-url]: https://github.com/install-it/it-claws/stargazers\n[issues-shield]: https://img.shields.io/github/issues/install-it/it-claws.svg?style=for-the-badge\n[issues-url]: https://github.com/install-it/it-claws/issues\n[license-shield]: https://img.shields.io/github/license/install-it/it-claws.svg?style=for-the-badge\n[license-url]: https://github.com/install-it/it-claws/blob/master/LICENSE.txt\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Finstall-it%2Fit-claws","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Finstall-it%2Fit-claws","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Finstall-it%2Fit-claws/lists"}