{"id":20224794,"url":"https://github.com/htrgouvea/harpoon","last_synced_at":"2026-03-01T23:31:47.273Z","repository":{"id":43454321,"uuid":"235599401","full_name":"htrgouvea/harpoon","owner":"htrgouvea","description":"[W.I.P] An ecosystem of crawlers for detecting: leaks, sensitive data exposure and attempts exfiltration of data","archived":false,"fork":false,"pushed_at":"2025-03-31T22:45:50.000Z","size":281,"stargazers_count":30,"open_issues_count":7,"forks_count":7,"subscribers_count":4,"default_branch":"main","last_synced_at":"2025-03-31T23:28:56.607Z","etag":null,"topics":["bing","data","detect","exfiltrate","leak","notify","pastebin","perl","sensitive-data","uranus"],"latest_commit_sha":null,"homepage":"https://heitorgouvea.me/","language":"Perl","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/htrgouvea.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":".github/CONTRIBUTING.md","funding":".github/FUNDING.yml","license":"LICENSE.md","code_of_conduct":".github/CODE_OF_CONDUCT.md","threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":"SECURITY.md","support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null},"funding":{"github":["htrgouvea"]}},"created_at":"2020-01-22T15:12:13.000Z","updated_at":"2025-03-31T22:45:54.000Z","dependencies_parsed_at":"2025-03-31T23:35:54.562Z","dependency_job_id":null,"html_url":"https://github.com/htrgouvea/harpoon","commit_stats":null,"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/htrgouvea%2Fharpoon","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/htrgouvea%2Fharpoon/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/htrgouvea%2Fharpoon/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/htrgouvea%2Fharpoon/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/htrgouvea","download_url":"https://codeload.github.com/htrgouvea/harpoon/tar.gz/refs/heads/main","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":248252735,"owners_count":21072703,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["bing","data","detect","exfiltrate","leak","notify","pastebin","perl","sensitive-data","uranus"],"created_at":"2024-11-14T07:09:05.620Z","updated_at":"2026-03-01T23:31:47.267Z","avatar_url":"https://github.com/htrgouvea.png","language":"Perl","funding_links":["https://github.com/sponsors/htrgouvea"],"categories":[],"sub_categories":[],"readme":"\u003cp align=\"center\"\u003e\n  \u003ch3 align=\"center\"\u003eHarpoon\u003c/h3\u003e\n  \u003cp align=\"center\"\u003eAn ecosystem of crawlers for detecting: leaks, sensitive data exposure and attempts exfiltration of data\u003c/p\u003e\n  \u003cp align=\"center\"\u003e\n    \u003ca href=\"/LICENSE.md\"\u003e\n      \u003cimg src=\"https://img.shields.io/badge/license-MIT-blue.svg\"\u003e\n    \u003c/a\u003e\n    \u003ca href=\"https://github.com/GouveaHeitor/uranus/releases\"\u003e\n      \u003cimg src=\"https://img.shields.io/badge/version-0.1.6-blue.svg\"\u003e\n    \u003c/a\u003e\n    \u003cbr/\u003e\n    \u003cimg src=\"https://github.com/htrgouvea/harpoon/actions/workflows/linter.yml/badge.svg\"\u003e\n    \u003cimg src=\"https://github.com/htrgouvea/harpoon/actions/workflows/zarn.yml/badge.svg\"\u003e\n    \u003cimg src=\"https://github.com/htrgouvea/harpoon/actions/workflows/security-gate.yml/badge.svg\"\u003e\n  \u003c/p\u003e\n\u003c/p\u003e\n\n---\n\n### Summary\n\n⚠️ __Warning:__ Harpoon is currently in __development__, you've been warned :) and please consider [contributing!](/.github/CONTRIBUTING.md)\n\nThis project is summarized in several crawlers that constitute a single ecosystem, that monitor certain channels such as: Github, Bing, Pastebin and iHaveBeenPwned? in order to perform data leak detection, exposed sensitive files and data exfiltration attempts.\n\n---\n\n### How it works\n\n![Image](/files/Diagram.png)\n\n\n- You can [click here](/rest-server/database/README.md) to see a diagram of the database and also a catalog on them.\n\n---\n\n### Download and setup\n\n```bash\n  # Download\n  $ git clone https://github.com/GouveaHeitor/uranus \u0026\u0026 cd uranus\n\n  # Building and starting MariaDB Database\n  $ docker build -t uranus-database ./rest-server/database/\n  $ docker run -d -p 3306:3306 --name database -e MARIADB_ROOT_PASSWORD=mypassword uranus-database\n\n  # Building and starting the REST API\n  $ docker build -t uranus-rest-server ./rest-server.\n  $ docker run -d -p 80:80 --name rest-server uranus-rest-server\n\n  # Building all crawlers/workers containers\n  $ docker build -t bing-crawler ./crawlers/bing/\n  $ docker build -t email-notify ./workers/email-notify\n\n  # Running all crawlers/workers containers\n  $ docker run -d --name bing bing-crawler\n  $ docker run -d --name email-notify email-notify\n```\n\n---\n\n### Contribution\n\nYour contributions and suggestions are heartily ♥ welcome. [See here the contribution guidelines.](/.github/CONTRIBUTING.md) Please, report bugs via [issues page](https://github.com/GouveaHeitor/uranus/issues) and for security issues, see here the [security policy.](/SECURITY.md) (✿ ◕‿◕)\n\n---\n\n### License\n\nThis work is licensed under [MIT License.](/LICENSE.md)\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fhtrgouvea%2Fharpoon","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fhtrgouvea%2Fharpoon","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fhtrgouvea%2Fharpoon/lists"}