https://github.com/pvnotpv/url-tree

Tool to generate a tree from a list of urls with color for each nodes.
https://github.com/pvnotpv/url-tree

bugbounty endpoint-discovery mitmproxy-addons pentesting pentesting-tools recon reconnaissance tree urls

Last synced: 16 days ago
JSON representation

Tool to generate a tree from a list of urls with color for each nodes.

• Host: GitHub
• URL: https://github.com/pvnotpv/url-tree
• Owner: pvnotpv
• Created: 2023-11-11T11:24:46.000Z (about 1 year ago)
• Default Branch: main
• Last Pushed: 2024-01-28T10:16:27.000Z (about 1 year ago)
• Last Synced: 2024-01-28T12:54:11.495Z (about 1 year ago)
• Topics: bugbounty, endpoint-discovery, mitmproxy-addons, pentesting, pentesting-tools, recon, reconnaissance, tree, urls
• Language: Python
• Homepage:
• Size: 77.1 KB
• Stars: 2
• Watchers: 1
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

README

        
# url-tree  

### Useful to map a site especially when bughunting.



  



The bash script is used to beautify the output

```

sed -e '$s/├/└/' -e '3s/├/┌/' | sed -e 's/^/      /' | sed -e '1,2d'

```

- If these special characters aren't supported replace them with a dash.

# Misc

- You can use it with mitmproxy-cli since it doesn't have a tree like structure like on GUI apps.

- Just inject this script to mitmproxy

```

def request(flow):

    url = flow.request.url

    with open('urls.txt', 'a') as file:

        file.write(url + '\n')

```

- To remove parameters use : ``` cut -d "?" -f1 | urltree ```

- gf pattern to clean urls:

```

{

    "flags": "-v",

    "pattern": "svg\\|jpg\\|jpeg\\|gif\\|css\\|tif\\|tiff\\|png\\|ttf\\|woff\\|woff2\\|ico\\|.js\\|.html\\|.ashx"

}

```

- The node.nodeid property can be used to print the node number of each items, used to change the color of nodes.

### Todo

- Implement a better version in golang.

![:pv](https://counter.max.srl/get/@:pvurltreee)

(From 28/1/24)