{"id":25804785,"url":"https://github.com/yogsec/endpoints-extractor","last_synced_at":"2025-06-25T00:41:02.399Z","repository":{"id":270719112,"uuid":"911260889","full_name":"yogsec/endpoints-extractor","owner":"yogsec","description":"A powerful Bash script for extracting URLs and API endpoints from HTML, JavaScript, and JSON content of web pages. Designed for security researchers, bug bounty hunters, and developers to streamline endpoint discovery. Simple to use, supports single or multiple URLs, and offers file-saving capabilities.","archived":false,"fork":false,"pushed_at":"2025-02-14T13:32:32.000Z","size":71,"stargazers_count":0,"open_issues_count":0,"forks_count":0,"subscribers_count":1,"default_branch":"main","last_synced_at":"2025-02-14T14:34:24.248Z","etag":null,"topics":["cybersecurity","endpoints","endpoints-extractor-tool","get-endpoints","hacking-tool","yogsec"],"latest_commit_sha":null,"homepage":"","language":"Shell","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/yogsec.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2025-01-02T15:53:29.000Z","updated_at":"2025-02-14T13:33:59.000Z","dependencies_parsed_at":null,"dependency_job_id":"65b00df6-e8ae-449c-9908-bcbf24feb96f","html_url":"https://github.com/yogsec/endpoints-extractor","commit_stats":null,"previous_names":["yogsec/endpoints-extractor"],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/yogsec%2Fendpoints-extractor","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/yogsec%2Fendpoints-extractor/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/yogsec%2Fendpoints-extractor/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/yogsec%2Fendpoints-extractor/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/yogsec","download_url":"https://codeload.github.com/yogsec/endpoints-extractor/tar.gz/refs/heads/main","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":241045920,"owners_count":19899744,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["cybersecurity","endpoints","endpoints-extractor-tool","get-endpoints","hacking-tool","yogsec"],"created_at":"2025-02-27T18:53:49.744Z","updated_at":"2025-02-27T18:53:50.933Z","avatar_url":"https://github.com/yogsec.png","language":"Shell","funding_links":["https://buymeacoffee.com/yogsec"],"categories":[],"sub_categories":[],"readme":"# Endpoints Extractor by YogSec\n\n## Overview\nThe **Endpoints Extractor by YogSec** is a Bash script designed to extract URLs and API endpoints from the HTML, JavaScript, and JSON content of web pages. This tool is useful for security researchers, bug bounty hunters, and developers looking to identify exposed endpoints within their applications.\n\n![endpoints](https://github.com/yogsec/endpoints-extractor/blob/main/endpoints-extractor.jpeg)\n\n---\n\n## Features\n- Scan a single URL or a list of URLs.\n- Extract URLs from HTML, JavaScript, and JSON content.\n- Save the results to a file for further analysis.\n- Simple and user-friendly interface.\n\n---\n\n## Prerequisites\n- **Bash**: Ensure you are running the script in a Bash shell environment.\n- **cURL**: The script uses `curl` to fetch web page content.\n- **grep**: Used to extract URLs from the content.\n- **sort**: Ensures the URLs are unique.\n\n---\n\n## Usage\n\n### Display Help\n```bash\n./find_urls_endpoints.sh -h\n```\n\n### Scan a Single URL\n```bash\n./find_urls_endpoints.sh -u \u003cURL\u003e\n```\nExample:\n```bash\n./find_urls_endpoints.sh -u https://example.com\n```\n\n### Scan a List of URLs\n```bash\n./find_urls_endpoints.sh -l \u003cFILE\u003e\n```\nExample:\n```bash\n./find_urls_endpoints.sh -l urls.txt\n```\n\n### Save Results to a File\n```bash\n./find_urls_endpoints.sh -u \u003cURL\u003e -s \u003cOUTPUT_FILE\u003e\n```\nExample:\n```bash\n./find_urls_endpoints.sh -u https://example.com -s results.txt\n```\n\n### Combined Example\nScan a list of URLs and save results to a file:\n```bash\n./find_urls_endpoints.sh -l urls.txt -s endpoints.txt\n```\n\n---\n\n## Options\n- `-u \u003cURL\u003e`: Specify a single URL to scan.\n- `-l \u003cFILE\u003e`: Specify a file containing a list of URLs.\n- `-s \u003cFILE\u003e`: Save the output to the specified file.\n- `-h`: Display the help message.\n\n---\n\n## Example Output\nFor the URL `https://example.com`, the script may output:\n```\nhttps://example.com/api/v1/users\nhttps://example.com/assets/js/script.js\nhttps://cdn.example.com/library.js\n```\n\n---\n\n## Troubleshooting\n- **Error: Either -u or -l must be specified**: Ensure you provide a URL with `-u` or a file with `-l`.\n- **Error: File \u003cfile\u003e does not exist**: Verify the file path is correct.\n- **Empty Output**: Ensure the target URL or file contains valid HTML, JS, or JSON content with endpoints.\n\n---\n\n## Author\nDeveloped by **YogSec** for extracting and analyzing web endpoints efficiently.\n\n---\n\n## 🌟 Let's Connect!\n\nHello, Hacker! 👋 We'd love to stay connected with you. Reach out to us on any of these platforms and let's build something amazing together:\n\n🌐 **Website:** [https://yogsec.github.io/yogsec/](https://yogsec.github.io/yogsec/)  \n📜 **Linktree:** [https://linktr.ee/yogsec](https://linktr.ee/yogsec)  \n🔗 **GitHub:** [https://github.com/yogsec](https://github.com/yogsec)  \n💼 **LinkedIn (Company):** [https://www.linkedin.com/company/yogsec/](https://www.linkedin.com/company/yogsec/)  \n📷 **Instagram:** [https://www.instagram.com/yogsec.io/](https://www.instagram.com/yogsec.io/)  \n🐦 **Twitter (X):** [https://x.com/yogsec](https://x.com/yogsec)  \n👨‍💼 **Personal LinkedIn:** [https://www.linkedin.com/in/bug-bounty-hunter/](https://www.linkedin.com/in/bug-bounty-hunter/)  \n📧 **Email:** abhinavsingwal@gmail.com\n\n---\n\n## ☕ Buy Me a Coffee\n\nIf you find our work helpful and would like to support us, consider buying us a coffee. Your support keeps us motivated and helps us create more awesome content. ❤️\n\n☕ **Support Us Here:** [https://buymeacoffee.com/yogsec](https://buymeacoffee.com/yogsec)\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fyogsec%2Fendpoints-extractor","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fyogsec%2Fendpoints-extractor","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fyogsec%2Fendpoints-extractor/lists"}