Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

Awesome Lists | Featured Topics | Projects

https://github.com/DanMcInerney/xsscrapy

XSS spider - 66/66 wavsep XSS detected
https://github.com/DanMcInerney/xsscrapy

Last synced: about 1 month ago
JSON representation

XSS spider - 66/66 wavsep XSS detected

Awesome Lists containing this project

README 

        
xsscrapy

========



Fast, thorough, XSS/SQLi spider. Give it a URL and it'll test every link it finds for cross-site scripting and some SQL injection vulnerabilities. See FAQ for more details about SQLi detection.



From within the main folder run:



```shell

./xsscrapy.py -u http://example.com

```



If you wish to login then crawl:

```shell

./xsscrapy.py -u http://example.com/login_page -l loginname

```



If you wish to login with HTTP Basic Auth then crawl:

```shell

./xsscrapy.py -u http://example.com/login_page -l loginname --basic

```



If you wish to use cookies:

```shell

./xsscrapy.py -u http://example.com/login_page --cookie "SessionID=abcdef1234567890"

```



If you wish to limit simultaneous connections to 20: 

```shell

./xsscrapy.py -u http://example.com -c 20

```



If you want to rate limit to 60 requests per minute: 

```shell

./xsscrapy.py -u http://example.com/ -r 60

```



XSS vulnerabilities are reported in xsscrapy-vulns.txt



Dependencies

-------

``` shell

wget -O -u https://bootstrap.pypa.io/get-pip.py

python get-pip.py

pip install -r requirements.txt

```

May need additional libraries depending on OS.

libxml2

libxslt

zlib

libffi

openssl (sometimes libssl-dev)



Tests

-------

* Cookies

* User-Agent

* Referer

* URL variables

* End of URL

* URL path

* Forms both hidden and explicit



FAQ

-------



* If it gives an error : ```ImportError: cannot import name LinkExtractor```. This means that you don't have the latest version of scrapy. You can install it using: ```sudo pip install --upgrade scrapy```.

* It's called XSScrapy, so why SQL injection detection too? There is overlap between dangerous XSS chars and dangerous SQL injection characters, namely single and double quotes. Detecting SQL injection errors in a response is also simple and nonCPU-intensive. So although 99% of this script is strongly geared toward high and accurate detection of XSS adding simple SQL injection detection through error message discovery is a simple and effective addition. This script will not test for blind sql injection. Error messages it looks for come straight from w3af's sqli audit plugin.



License

-------



Copyright (c) 2014, Dan McInerney

All rights reserved.



Redistribution and use in source and binary forms, with or without

modification, are permitted provided that the following conditions are met:

* Redistributions of source code must retain the above copyright notice, this list of conditions and the following disclaimer.

* Redistributions in binary form must reproduce the above copyright notice, this list of conditions and the following disclaimer in the documentation and/or other materials provided with the distribution.

* Neither the name of Dan McInerney nor the names of its contributors may be used to endorse or promote products derived from this software without specific prior written permission.



THIS SOFTWARE IS PROVIDED BY THE COPYRIGHT HOLDERS AND CONTRIBUTORS "AS IS" AND

ANY EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT LIMITED TO, THE IMPLIED

WARRANTIES OF MERCHANTABILITY AND FITNESS FOR A PARTICULAR PURPOSE ARE

DISCLAIMED. IN NO EVENT SHALL  BE LIABLE FOR ANY

DIRECT, INDIRECT, INCIDENTAL, SPECIAL, EXEMPLARY, OR CONSEQUENTIAL DAMAGES

(INCLUDING, BUT NOT LIMITED TO, PROCUREMENT OF SUBSTITUTE GOODS OR SERVICES;

LOSS OF USE, DATA, OR PROFITS; OR BUSINESS INTERRUPTION) HOWEVER CAUSED AND

ON ANY THEORY OF LIABILITY, WHETHER IN CONTRACT, STRICT LIABILITY, OR TORT

(INCLUDING NEGLIGENCE OR OTHERWISE) ARISING IN ANY WAY OUT OF THE USE OF THIS

SOFTWARE, EVEN IF ADVISED OF THE POSSIBILITY OF SUCH DAMAGE.