{"id":24163273,"url":"https://github.com/hackfutsec/zonespy","last_synced_at":"2025-03-02T05:43:05.858Z","repository":{"id":271173804,"uuid":"912605335","full_name":"HackfutSec/ZoneSpy","owner":"HackfutSec","description":"ZoneSpy is a Python script for scraping Zone-H archives, checking notifiers and associated URLs, supporting bulk operations and session management.","archived":false,"fork":false,"pushed_at":"2025-02-03T19:41:14.000Z","size":15,"stargazers_count":1,"open_issues_count":0,"forks_count":0,"subscribers_count":1,"default_branch":"main","last_synced_at":"2025-02-03T20:32:42.830Z","etag":null,"topics":["bulk-data","cyber-threat-intelligence","cybersecurity","defacement","ethical-hacking","hacking","python","python-webscraping","security","web","webscraping","webscraping-data","webscrapping","websecurity","zone-h"],"latest_commit_sha":null,"homepage":"https://github.com/HackfutSec/ZoneSpy.git","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/HackfutSec.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2025-01-06T02:38:46.000Z","updated_at":"2025-02-03T19:41:17.000Z","dependencies_parsed_at":"2025-01-06T08:32:30.232Z","dependency_job_id":null,"html_url":"https://github.com/HackfutSec/ZoneSpy","commit_stats":null,"previous_names":["hackfutsec/zonespy"],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/HackfutSec%2FZoneSpy","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/HackfutSec%2FZoneSpy/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/HackfutSec%2FZoneSpy/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/HackfutSec%2FZoneSpy/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/HackfutSec","download_url":"https://codeload.github.com/HackfutSec/ZoneSpy/tar.gz/refs/heads/main","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":241465082,"owners_count":19967243,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["bulk-data","cyber-threat-intelligence","cybersecurity","defacement","ethical-hacking","hacking","python","python-webscraping","security","web","webscraping","webscraping-data","webscrapping","websecurity","zone-h"],"created_at":"2025-01-12T18:17:14.501Z","updated_at":"2025-03-02T05:43:05.826Z","avatar_url":"https://github.com/HackfutSec.png","language":"Python","readme":"## ZoneSpy: A Powerful Zone-H Archive Scraper and Notifier Checker\n\n**ZoneSpy** is a Python-based script designed to scrape and extract information from Zone-H archives and notifiers. This tool allows users to monitor defacements and extract domain URLs from Zone-H's publicly available archives, including **published** and **OnHold** defacements. It also supports bulk operations, allowing users to check multiple notifiers or archives at once.\n\n### Features\n- **Notifier Checker:** Fetch URLs associated with a specific defacer's username from the Zone-H archive.\n- **Bulk Notifier Checker:** Allows you to process multiple defacers from a list of usernames stored in a text file.\n- **OnHold Archive Checker:** Scrapes URLs from Zone-H’s OnHold defacements.\n- **Archive URL Checker:** Check and extract URLs from any specific Zone-H archive.\n- **Session Management:** Stores your session information securely in a configuration file, so you don’t need to enter your credentials every time you run the script.\n- **Multi-threading Support:** Efficiently processes multiple requests using **ThreadPoolExecutor**, making it suitable for large-scale scrapping.\n- **Results Storage:** Automatically stores valid URLs to a results file for further use or analysis.\n\n### Installation\n\n1. Clone the repository:\n    ```bash\n    git clone https://github.com/HackfutSec/ZoneSpy.git\n    cd ZoneSpy\n    ```\n\n2. Install dependencies:\n    ```bash\n    pip install -r requirements.txt\n    ```\n\n### Usage\n\n1. **Start the Program:**\n   ```bash\n   python zoneSpy.py\n   ```\n\n2. **Menu Options:**\n   Once the program is running, you will be presented with a menu to choose from several options:\n   - **1:** Check a specific notifier by a defacer's username.\n   - **2:** Check multiple notifiers from a list of usernames.\n   - **3:** Check a specific archive URL.\n   - **4:** Check multiple archives from a list of archive URLs.\n   - **5:** Check the OnHold archives.\n   - **6:** Check everything (Notifiers, Archives, OnHold).\n   - **7:** Exit the program.\n\n3. **Session Management:**  \n   The first time you run the program, you will be prompted to enter your **PHPSESSID** and **ZHE token** for authentication. These values will be saved in a session configuration file (`session_config.json`) for future use.\n\n### Example\n\n```bash\n[INFO] Please enter your Zone-H session information.\n[] Enter PHPSESSID (e.g., iqhg1hpl6u3h9pramlkjaur1s3): iqhg1hpl6u3h9pramlkjaur1s3\n[] Enter ZHE Token (e.g., a78656eb0643e749d79808e64eade4f7): a78656eb0643e749d79808e64eade4f7\n```\n\nOnce the session is set, you can start scraping specific notifiers or archives, and the URLs will be saved to a results file.\n\n### Dependencies\n- `requests` – for making HTTP requests to the Zone-H site.\n- `beautifulsoup4` – for parsing HTML content and extracting information.\n- `tldextract` – for validating and extracting domain names.\n- `concurrent.futures` – for handling multi-threaded operations.\n- `colorama` – for colored terminal output to improve UX.\n\n### License\n\nThis project is licensed under the MIT License.\n","funding_links":[],"categories":[],"sub_categories":[],"project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fhackfutsec%2Fzonespy","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fhackfutsec%2Fzonespy","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fhackfutsec%2Fzonespy/lists"}