{"id":15039730,"url":"https://github.com/s0md3v/photon","last_synced_at":"2025-05-13T16:06:07.645Z","repository":{"id":39649602,"uuid":"127466226","full_name":"s0md3v/Photon","owner":"s0md3v","description":"Incredibly fast crawler designed for OSINT.","archived":false,"fork":false,"pushed_at":"2025-03-31T10:11:03.000Z","size":358,"stargazers_count":11531,"open_issues_count":53,"forks_count":1551,"subscribers_count":322,"default_branch":"master","last_synced_at":"2025-04-22T11:39:12.158Z","etag":null,"topics":["crawler","information-gathering","osint","python","spider"],"latest_commit_sha":null,"homepage":"","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"gpl-3.0","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/s0md3v.png","metadata":{"files":{"readme":"README.md","changelog":"CHANGELOG.md","contributing":null,"funding":null,"license":"LICENSE.md","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null},"funding":{"github":"s0md3v","custom":"https://paypal.me/s0md3v"}},"created_at":"2018-03-30T19:38:22.000Z","updated_at":"2025-04-22T09:33:23.000Z","dependencies_parsed_at":"2025-04-08T07:35:26.325Z","dependency_job_id":"11fc04d8-fe0b-4e64-9bec-279c1039ec38","html_url":"https://github.com/s0md3v/Photon","commit_stats":{"total_commits":286,"total_committers":21,"mean_commits":"13.619047619047619","dds":"0.28321678321678323","last_synced_commit":"d4af460e95e5d962a53594d94d71d34d3a93f256"},"previous_names":[],"tags_count":19,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/s0md3v%2FPhoton","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/s0md3v%2FPhoton/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/s0md3v%2FPhoton/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/s0md3v%2FPhoton/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/s0md3v","download_url":"https://codeload.github.com/s0md3v/Photon/tar.gz/refs/heads/master","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":252590522,"owners_count":21772934,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["crawler","information-gathering","osint","python","spider"],"created_at":"2024-09-24T20:43:44.852Z","updated_at":"2025-05-05T22:48:39.204Z","avatar_url":"https://github.com/s0md3v.png","language":"Python","readme":"\n\u003ch1 align=\"center\"\u003e\n  \u003cbr\u003e\n  \u003ca href=\"https://github.com/s0md3v/Photon\"\u003e\u003cimg src=\"https://image.ibb.co/h5OZAK/photonsmall.png\" alt=\"Photon\"\u003e\u003c/a\u003e\n  \u003cbr\u003e\n  Photon\n  \u003cbr\u003e\n\u003c/h1\u003e\n\n\u003ch4 align=\"center\"\u003eIncredibly fast crawler designed for OSINT.\u003c/h4\u003e\n\n\u003cp align=\"center\"\u003e\n  \u003ca href=\"https://github.com/s0md3v/Photon/releases\"\u003e\n    \u003cimg src=\"https://img.shields.io/github/release/s0md3v/Photon.svg\"\u003e\n  \u003c/a\u003e\n  \u003ca href=\"https://pypi.org/project/photon/\"\u003e\n    \u003cimg src=\"https://img.shields.io/badge/pypi-@photon-red.svg?style=style=flat-square\"\n         alt=\"pypi\"\u003e\n  \u003c/a\u003e\n  \u003ca href=\"https://github.com/s0md3v/Photon/issues?q=is%3Aissue+is%3Aclosed\"\u003e\n      \u003cimg src=\"https://img.shields.io/github/issues-closed-raw/s0md3v/Photon.svg\"\u003e\n  \u003c/a\u003e\n  \u003ca href=\"https://travis-ci.com/s0md3v/Photon\"\u003e\n    \u003cimg src=\"https://img.shields.io/travis/com/s0md3v/Photon.svg\"\u003e\n  \u003c/a\u003e\n\u003c/p\u003e\n\n![demo](https://image.ibb.co/kQSUcz/demo.png)\n\n\u003cp align=\"center\"\u003e\n  \u003ca href=\"https://github.com/s0md3v/Photon/wiki\"\u003ePhoton Wiki\u003c/a\u003e •\n  \u003ca href=\"https://github.com/s0md3v/Photon/wiki/Usage\"\u003eHow To Use\u003c/a\u003e •\n  \u003ca href=\"https://github.com/s0md3v/Photon/wiki/Compatibility-\u0026-Dependencies\"\u003eCompatibility\u003c/a\u003e •\n  \u003ca href=\"https://github.com/s0md3v/Photon/wiki/Photon-Library\"\u003ePhoton Library\u003c/a\u003e •\n  \u003ca href=\"#contribution--license\"\u003eContribution\u003c/a\u003e •\n  \u003ca href=\"https://github.com/s0md3v/Photon/projects/1\"\u003eRoadmap\u003c/a\u003e\n\u003c/p\u003e\n\n### Key Features\n\n#### Data Extraction\nPhoton can extract the following data while crawling:\n\n- URLs (in-scope \u0026 out-of-scope)\n- URLs with parameters (`example.com/gallery.php?id=2`)\n- Intel (emails, social media accounts, amazon buckets etc.)\n- Files (pdf, png, xml etc.)\n- Secret keys (auth/API keys \u0026 hashes)\n- JavaScript files \u0026 Endpoints present in them\n- Strings matching custom regex pattern\n- Subdomains \u0026 DNS related data\n\nThe extracted information is saved in an organized manner or can be [exported as json](https://github.com/s0md3v/Photon/wiki/Usage#export-formatted-result).\n\n![save demo](https://image.ibb.co/dS1BqK/carbon_2.png)\n\n#### Flexible\nControl timeout, delay, add seeds, exclude URLs matching a regex pattern and other cool stuff.\nThe extensive range of [options](https://github.com/s0md3v/Photon/wiki/Usage) provided by Photon lets you crawl the web exactly the way you want.\n\n#### Genius\nPhoton's smart thread management \u0026 refined logic gives you top notch performance.\n\nStill, crawling can be resource intensive but Photon has some tricks up it's sleeves. You can fetch URLs archived by [archive.org](https://archive.org/) to be used as seeds by using `--wayback` option.\n\n#### Plugins\n- **[wayback](https://github.com/s0md3v/Photon/wiki/Usage#use-urls-from-archiveorg-as-seeds)**\n- **[dnsdumpster](https://github.com/s0md3v/Photon/wiki/Usage#dumping-dns-data)**\n- **[Exporter](https://github.com/s0md3v/Photon/wiki/Usage#export-formatted-result)**\n\n#### Docker\n\nPhoton can be launched using a lightweight Python-Alpine (103 MB) Docker image.\n\n```bash\n$ git clone https://github.com/s0md3v/Photon.git\n$ cd Photon\n$ docker build -t photon .\n$ docker run -it --name photon photon:latest -u google.com\n```\n\nTo view results, you can either head over to the local docker volume, which you can find by running `docker inspect photon` or by mounting the target loot folder:\n\n```bash\n$ docker run -it --name photon -v \"$PWD:/Photon/google.com\" photon:latest -u google.com\n```\n\n#### Frequent \u0026 Seamless Updates\nPhoton is under heavy development and updates for fixing bugs. optimizing performance \u0026 new features are being rolled regularly.\n\nIf you would like to see features and issues that are being worked on, you can do that on [Development](https://github.com/s0md3v/Photon/projects/1) project board.\n\nUpdates can be installed \u0026 checked for with the `--update` option. Photon has seamless update capabilities which means you can update Photon without losing any of your saved data.\n\n### Contribution \u0026 License\nYou can contribute in following ways:\n\n- Report bugs\n- Develop plugins\n- Add more \"APIs\" for ninja mode\n- Give suggestions to make it better\n- Fix issues \u0026 submit a pull request\n\nPlease read the [guidelines](https://github.com/s0md3v/Photon/wiki/Guidelines) before submitting a pull request or issue.\n\nDo you want to have a conversation in private? Hit me up on my [twitter](https://twitter.com/s0md3v/), inbox is open :)\n\n**Photon** is licensed under [GPL v3.0 license](https://www.gnu.org/licenses/gpl-3.0.en.html)\n","funding_links":["https://github.com/sponsors/s0md3v","https://paypal.me/s0md3v"],"categories":[],"sub_categories":[],"project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fs0md3v%2Fphoton","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fs0md3v%2Fphoton","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fs0md3v%2Fphoton/lists"}