https://github.com/voidwalker7/spider-n-probe

Spider N Probe written in Python
https://github.com/voidwalker7/spider-n-probe

cyber-security probe python spider

Last synced: 8 months ago
JSON representation

Spider N Probe written in Python

• Host: GitHub
• URL: https://github.com/voidwalker7/spider-n-probe
• Owner: VoIDWALkER7
• Created: 2024-06-09T15:20:09.000Z (about 2 years ago)
• Default Branch: main
• Last Pushed: 2024-06-09T15:58:45.000Z (about 2 years ago)
• Last Synced: 2025-01-04T21:17:43.273Z (over 1 year ago)
• Topics: cyber-security, probe, python, spider
• Language: Python
• Homepage:
• Size: 5.86 KB
• Stars: 0
• Watchers: 1
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

README

          
This repository contains a spider and a probe tool. 

The spider tool takes an url as an input alongside a keyword and prints out urls that contain that input while keeping in mind that no duplicated url is present in the output.

![image](https://github.com/VoIDWALkER7/Spider-N-Probe/assets/84080270/28ad8a83-c5b0-4fa4-84da-b44295eb1091)

^ The successful spider run

In the urls.txt file, we have pasted the output from spider.py so that we can use that file as an input for the probe.py. 

Now, for probe.py, we will run it alongside cat command. 

```cat urls.txt | python3 probe.py``` 

All the responsive urls will be stored in a file called filtered_urls.txt and all the bad urls will be discarded. 

![image](https://github.com/VoIDWALkER7/Spider-N-Probe/assets/84080270/47c016a2-fb9b-4072-ada9-e1447659db85)

^ The successful probe run

![image](https://github.com/VoIDWALkER7/Spider-N-Probe/assets/84080270/58d204b8-8179-4e80-ab33-149b0fa66677)

^ Output file successfully generated