https://github.com/yogsec/endpoints-extractor
A powerful Bash script for extracting URLs and API endpoints from HTML, JavaScript, and JSON content of web pages. Designed for security researchers, bug bounty hunters, and developers to streamline endpoint discovery. Simple to use, supports single or multiple URLs, and offers file-saving capabilities.
https://github.com/yogsec/endpoints-extractor
cybersecurity endpoints endpoints-extractor-tool get-endpoints hacking-tool yogsec
Last synced: about 1 year ago
JSON representation
A powerful Bash script for extracting URLs and API endpoints from HTML, JavaScript, and JSON content of web pages. Designed for security researchers, bug bounty hunters, and developers to streamline endpoint discovery. Simple to use, supports single or multiple URLs, and offers file-saving capabilities.
- Host: GitHub
- URL: https://github.com/yogsec/endpoints-extractor
- Owner: yogsec
- Created: 2025-01-02T15:53:29.000Z (over 1 year ago)
- Default Branch: main
- Last Pushed: 2025-02-14T13:32:32.000Z (over 1 year ago)
- Last Synced: 2025-02-14T14:34:24.248Z (over 1 year ago)
- Topics: cybersecurity, endpoints, endpoints-extractor-tool, get-endpoints, hacking-tool, yogsec
- Language: Shell
- Homepage:
- Size: 69.3 KB
- Stars: 0
- Watchers: 1
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
# Endpoints Extractor by YogSec
## Overview
The **Endpoints Extractor by YogSec** is a Bash script designed to extract URLs and API endpoints from the HTML, JavaScript, and JSON content of web pages. This tool is useful for security researchers, bug bounty hunters, and developers looking to identify exposed endpoints within their applications.
---
## Features
- Scan a single URL or a list of URLs.
- Extract URLs from HTML, JavaScript, and JSON content.
- Save the results to a file for further analysis.
- Simple and user-friendly interface.
---
## Prerequisites
- **Bash**: Ensure you are running the script in a Bash shell environment.
- **cURL**: The script uses `curl` to fetch web page content.
- **grep**: Used to extract URLs from the content.
- **sort**: Ensures the URLs are unique.
---
## Usage
### Display Help
```bash
./find_urls_endpoints.sh -h
```
### Scan a Single URL
```bash
./find_urls_endpoints.sh -u
```
Example:
```bash
./find_urls_endpoints.sh -u https://example.com
```
### Scan a List of URLs
```bash
./find_urls_endpoints.sh -l
```
Example:
```bash
./find_urls_endpoints.sh -l urls.txt
```
### Save Results to a File
```bash
./find_urls_endpoints.sh -u -s
```
Example:
```bash
./find_urls_endpoints.sh -u https://example.com -s results.txt
```
### Combined Example
Scan a list of URLs and save results to a file:
```bash
./find_urls_endpoints.sh -l urls.txt -s endpoints.txt
```
---
## Options
- `-u `: Specify a single URL to scan.
- `-l `: Specify a file containing a list of URLs.
- `-s `: Save the output to the specified file.
- `-h`: Display the help message.
---
## Example Output
For the URL `https://example.com`, the script may output:
```
https://example.com/api/v1/users
https://example.com/assets/js/script.js
https://cdn.example.com/library.js
```
---
## Troubleshooting
- **Error: Either -u or -l must be specified**: Ensure you provide a URL with `-u` or a file with `-l`.
- **Error: File does not exist**: Verify the file path is correct.
- **Empty Output**: Ensure the target URL or file contains valid HTML, JS, or JSON content with endpoints.
---
## Author
Developed by **YogSec** for extracting and analyzing web endpoints efficiently.
---
## 🌟 Let's Connect!
Hello, Hacker! 👋 We'd love to stay connected with you. Reach out to us on any of these platforms and let's build something amazing together:
🌐 **Website:** [https://yogsec.github.io/yogsec/](https://yogsec.github.io/yogsec/)
📜 **Linktree:** [https://linktr.ee/yogsec](https://linktr.ee/yogsec)
🔗 **GitHub:** [https://github.com/yogsec](https://github.com/yogsec)
💼 **LinkedIn (Company):** [https://www.linkedin.com/company/yogsec/](https://www.linkedin.com/company/yogsec/)
📷 **Instagram:** [https://www.instagram.com/yogsec.io/](https://www.instagram.com/yogsec.io/)
🐦 **Twitter (X):** [https://x.com/yogsec](https://x.com/yogsec)
👨💼 **Personal LinkedIn:** [https://www.linkedin.com/in/bug-bounty-hunter/](https://www.linkedin.com/in/bug-bounty-hunter/)
📧 **Email:** abhinavsingwal@gmail.com
---
## ☕ Buy Me a Coffee
If you find our work helpful and would like to support us, consider buying us a coffee. Your support keeps us motivated and helps us create more awesome content. ❤️
☕ **Support Us Here:** [https://buymeacoffee.com/yogsec](https://buymeacoffee.com/yogsec)