https://github.com/tasooshi/digslash

A site mapping and enumeration tool for Web applications analysis
https://github.com/tasooshi/digslash

crawler mapping sitemap spider

Last synced: 3 months ago
JSON representation

A site mapping and enumeration tool for Web applications analysis

• Host: GitHub
• URL: https://github.com/tasooshi/digslash
• Owner: tasooshi
• License: mit
• Created: 2022-01-03T18:06:57.000Z (over 4 years ago)
• Default Branch: main
• Last Pushed: 2022-12-09T02:33:57.000Z (over 3 years ago)
• Last Synced: 2025-11-27T17:43:29.145Z (7 months ago)
• Topics: crawler, mapping, sitemap, spider
• Language: Python
• Homepage:
• Size: 23.4 KB
• Stars: 1
• Watchers: 1
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

README

          
# digslash

> A site mapping and enumeration tool for Web applications analysis

Usage:

    >>> import asyncio

    >>> from digslash import sites

    >>> website = sites.Site('https://example.com', limit=50, deduplicate=False)

    >>> asyncio.run(website.crawl())

Output example:

    >>> dict(website.results)

    {

        'https://example.com/': {

            'checksum': '17913e89fe23ba03081f5f5b650c29a0',

            'encoding': 'utf-8',

            'source': ''

        },

        'https://example.com/js/script.js': {

            'checksum': '4cdad7e5affe29e1347343e126beea09',

            'encoding': 'ascii',

            'source': 'https://example.com/'

        },

        'https://example.com/pages/about.html': {

            'checksum': 'fad033d51adc628b17268ce2669543fd',

            'encoding': 'utf-8',

            'source': 'https://example.com/'

        },

        'https://example.com/pages/contact.html': {

            'checksum': 'b12c6a2fde381552564eea6a477030f0',

            'encoding': 'utf-8',

            'source': 'https://example.com/'

        },

        'https://example.com/pages/feedback.html': {

            'checksum': '9b0482107470956f7b64c833f1ef5e59',

            'encoding': 'utf-8',

            'source': 'https://example.com/'

        },

        'https://example.com/scripts/feedback.html': {

            'checksum': 'b92c8a06f3d4a9c22e8c11606bcbd2f7',

            'encoding': 'utf-8',

            'source': 'https://example.com/pages/feedback.html'

        }

    }