{"id":19223930,"url":"https://github.com/voidwalker7/spider-n-probe","last_synced_at":"2025-10-25T20:02:35.313Z","repository":{"id":243530038,"uuid":"812679103","full_name":"VoIDWALkER7/Spider-N-Probe","owner":"VoIDWALkER7","description":"Spider N Probe written in Python","archived":false,"fork":false,"pushed_at":"2024-06-09T15:58:45.000Z","size":6,"stargazers_count":0,"open_issues_count":0,"forks_count":0,"subscribers_count":1,"default_branch":"main","last_synced_at":"2025-01-04T21:17:43.273Z","etag":null,"topics":["cyber-security","probe","python","spider"],"latest_commit_sha":null,"homepage":"","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/VoIDWALkER7.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2024-06-09T15:20:09.000Z","updated_at":"2024-06-18T07:05:13.000Z","dependencies_parsed_at":null,"dependency_job_id":"ece6ba6c-fdf3-4b34-bdb5-590f29ee7430","html_url":"https://github.com/VoIDWALkER7/Spider-N-Probe","commit_stats":null,"previous_names":["voidwalker7/spider-n-probe"],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/VoIDWALkER7%2FSpider-N-Probe","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/VoIDWALkER7%2FSpider-N-Probe/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/VoIDWALkER7%2FSpider-N-Probe/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/VoIDWALkER7%2FSpider-N-Probe/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/VoIDWALkER7","download_url":"https://codeload.github.com/VoIDWALkER7/Spider-N-Probe/tar.gz/refs/heads/main","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":240298487,"owners_count":19779283,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["cyber-security","probe","python","spider"],"created_at":"2024-11-09T15:09:55.182Z","updated_at":"2025-10-25T20:02:35.210Z","avatar_url":"https://github.com/VoIDWALkER7.png","language":"Python","funding_links":[],"categories":[],"sub_categories":[],"readme":"This repository contains a spider and a probe tool. \n\nThe spider tool takes an url as an input alongside a keyword and prints out urls that contain that input while keeping in mind that no duplicated url is present in the output.\n![image](https://github.com/VoIDWALkER7/Spider-N-Probe/assets/84080270/28ad8a83-c5b0-4fa4-84da-b44295eb1091)\n\n^ The successful spider run\n\nIn the urls.txt file, we have pasted the output from spider.py so that we can use that file as an input for the probe.py. \n\nNow, for probe.py, we will run it alongside cat command. \n\n```cat urls.txt | python3 probe.py``` \n\nAll the responsive urls will be stored in a file called filtered_urls.txt and all the bad urls will be discarded. \n\n\n![image](https://github.com/VoIDWALkER7/Spider-N-Probe/assets/84080270/47c016a2-fb9b-4072-ada9-e1447659db85)\n\n^ The successful probe run\n\n![image](https://github.com/VoIDWALkER7/Spider-N-Probe/assets/84080270/58d204b8-8179-4e80-ab33-149b0fa66677)\n\n^ Output file successfully generated\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fvoidwalker7%2Fspider-n-probe","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fvoidwalker7%2Fspider-n-probe","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fvoidwalker7%2Fspider-n-probe/lists"}