https://github.com/kremilly/linkscraper

Plunge into the depths of the web with Linkscraper! Uncover links, images, emails, and more swiftly, catering to researchers, developers, and curious explorers alike.
https://github.com/kremilly/linkscraper

cli linkscraper python scraper security security-tools utils

Last synced: 11 months ago
JSON representation

Plunge into the depths of the web with Linkscraper! Uncover links, images, emails, and more swiftly, catering to researchers, developers, and curious explorers alike.

• Host: GitHub
• URL: https://github.com/kremilly/linkscraper
• Owner: Kremilly
• License: mit
• Created: 2023-03-25T19:21:03.000Z (about 3 years ago)
• Default Branch: main
• Last Pushed: 2024-11-09T19:29:48.000Z (over 1 year ago)
• Last Synced: 2024-12-02T08:13:05.584Z (over 1 year ago)
• Topics: cli, linkscraper, python, scraper, security, security-tools, utils
• Language: Python
• Homepage: https://linkscraper.kremilly.com
• Size: 1.63 MB
• Stars: 11
• Watchers: 3
• Forks: 2
• Open Issues: 0
• Metadata Files:
  • Readme: README.md
  • Funding: .github/FUNDING.yml
  • License: LICENSE

Awesome Lists containing this project

README

          


    

    



    A powerful tool to scrape and manage links from web pages.







    📚 Documentation • 

    📝 License •  

    💡 Sponsor



## **📑 Table of Contents:**

* 🔍 Overview

  * [Introduction](https://linkscraper.kremilly.com/#introduction)

    * [Requirements](https://linkscraper.kremilly.com/#requirements)

    * [Getting started](https://linkscraper.kremilly.com/#getting-started)

  * [Parameters](https://linkscraper.kremilly.com/overview/parameters/)

  * [Dependencies](https://linkscraper.kremilly.com/overview/dependencies/)

  * [External apis use](https://linkscraper.kremilly.com/overview/external-apis/)

* 🛠 Basics

  * [Core data](https://linkscraper.kremilly.com/basics/core)

  * [Get headers](https://linkscraper.kremilly.com/basics/headers)

  * [Get cookies](https://linkscraper.kremilly.com/basics/cookies)

  * [Get links](https://linkscraper.kremilly.com/basics/get-links)

  * [Get emails](https://linkscraper.kremilly.com/basics/get-emails/)

  * Static files

    * [CSS](https://linkscraper.kremilly.com/basics/static/css/)

    * [JS](https://linkscraper.kremilly.com/basics/static/js/)

    * [Images](https://linkscraper.kremilly.com/basics/static/images/)

* 🧩 Plugins

  * [whois](https://linkscraper.kremilly.com/plugins/whois/)

  * [page-details](https://linkscraper.kremilly.com/plugins/page-details/)

  * [robots](https://linkscraper.kremilly.com/plugins/robots/)

  * [screenshot](https://linkscraper.kremilly.com/plugins/screenshot/)

  * [virustotal](https://linkscraper.kremilly.com/plugins/virustotal/)

  * [subdomains](https://linkscraper.kremilly.com/plugins/subdomains/)

  * [ip-location](https://linkscraper.kremilly.com/plugins/ip-location/)

  * [detect-fonts](https://linkscraper.kremilly.com/plugins/detect-fonts/)

  * [extract-colors](https://linkscraper.kremilly.com/plugins/extract-colors/)

  * How to get keys

    * [Imgur](https://linkscraper.kremilly.com/plugins/apis/imgur/)

    * [Google Fonts](https://linkscraper.kremilly.com/plugins/apis/google-fonts/)

    * [VirusTotal](https://linkscraper.kremilly.com/plugins/apis/virustotal/)

* ⚙️ Settings

  * [Environments](https://linkscraper.kremilly.com/settings/env/)

* 🤝 Contribute

  * [Sponsor](https://github.com/sponsors/kremilly)

  * [Report a bug](https://github.com/kremilly/linkscraper/issues)

* 📝 [License](#-license)

* 💡 [Sponsor](#-sponsor)

## 📝 License

Code licensed under [MIT License](blob/main/LICENSE)

## 💡 Sponsor

Hello Linkscraper user!

Creating and maintaining Linkscraper requires time and resources. If you find it valuable, please consider supporting its development. Your contribution, no matter the size, will help keep Linkscraper updated and improve with new features.

By contributing, you’re helping make web data extraction accessible and efficient for everyone. [Click here](https://github.com/sponsors/kremilly) to support Linkscraper. Every bit counts, and we appreciate your generosity. 🚀❤️

Thank you for being part of our journey!