https://github.com/htrgouvea/harpoon

[W.I.P] An ecosystem of crawlers for detecting: leaks, sensitive data exposure and attempts exfiltration of data
https://github.com/htrgouvea/harpoon

bing data detect exfiltrate leak notify pastebin perl sensitive-data uranus

Last synced: 3 months ago
JSON representation

[W.I.P] An ecosystem of crawlers for detecting: leaks, sensitive data exposure and attempts exfiltration of data

• Host: GitHub
• URL: https://github.com/htrgouvea/harpoon
• Owner: htrgouvea
• License: mit
• Created: 2020-01-22T15:12:13.000Z (over 6 years ago)
• Default Branch: main
• Last Pushed: 2025-03-31T22:45:50.000Z (about 1 year ago)
• Last Synced: 2025-03-31T23:28:56.607Z (about 1 year ago)
• Topics: bing, data, detect, exfiltrate, leak, notify, pastebin, perl, sensitive-data, uranus
• Language: Perl
• Homepage: https://heitorgouvea.me/
• Size: 274 KB
• Stars: 30
• Watchers: 4
• Forks: 7
• Open Issues: 7
• Metadata Files:
  • Readme: README.md
  • Contributing: .github/CONTRIBUTING.md
  • Funding: .github/FUNDING.yml
  • License: LICENSE.md
  • Code of conduct: .github/CODE_OF_CONDUCT.md
  • Security: SECURITY.md

Awesome Lists containing this project

README

          


  
Harpoon

  
An ecosystem of crawlers for detecting: leaks, sensitive data exposure and attempts exfiltration of data

  


    

      

    

    

      

    

    


    

    

    

  


---

### Summary

⚠️ __Warning:__ Harpoon is currently in __development__, you've been warned :) and please consider [contributing!](/.github/CONTRIBUTING.md)

This project is summarized in several crawlers that constitute a single ecosystem, that monitor certain channels such as: Github, Bing, Pastebin and iHaveBeenPwned? in order to perform data leak detection, exposed sensitive files and data exfiltration attempts.

---

### How it works

![Image](/files/Diagram.png)

- You can [click here](/rest-server/database/README.md) to see a diagram of the database and also a catalog on them.

---

### Download and setup

```bash

  # Download

  $ git clone https://github.com/GouveaHeitor/uranus && cd uranus

  # Building and starting MariaDB Database

  $ docker build -t uranus-database ./rest-server/database/

  $ docker run -d -p 3306:3306 --name database -e MARIADB_ROOT_PASSWORD=mypassword uranus-database

  # Building and starting the REST API

  $ docker build -t uranus-rest-server ./rest-server.

  $ docker run -d -p 80:80 --name rest-server uranus-rest-server

  # Building all crawlers/workers containers

  $ docker build -t bing-crawler ./crawlers/bing/

  $ docker build -t email-notify ./workers/email-notify

  # Running all crawlers/workers containers

  $ docker run -d --name bing bing-crawler

  $ docker run -d --name email-notify email-notify

```

---

### Contribution

Your contributions and suggestions are heartily ♥ welcome. [See here the contribution guidelines.](/.github/CONTRIBUTING.md) Please, report bugs via [issues page](https://github.com/GouveaHeitor/uranus/issues) and for security issues, see here the [security policy.](/SECURITY.md) (✿ ◕‿◕)

---

### License

This work is licensed under [MIT License.](/LICENSE.md)