{"id":26092966,"url":"https://github.com/just5ky/spidertrap","last_synced_at":"2025-04-12T07:41:31.817Z","repository":{"id":39968662,"uuid":"494312957","full_name":"just5ky/spidertrap","owner":"just5ky","description":"Traps web crawlers","archived":false,"fork":false,"pushed_at":"2025-03-14T14:29:12.000Z","size":132,"stargazers_count":7,"open_issues_count":0,"forks_count":1,"subscribers_count":1,"default_branch":"latest","last_synced_at":"2025-04-10T10:45:07.156Z","etag":null,"topics":["active-defense","cybersecurity","docker","spiders"],"latest_commit_sha":null,"homepage":"","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"gpl-3.0","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/just5ky.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null,"zenodo":null}},"created_at":"2022-05-20T03:55:14.000Z","updated_at":"2025-03-14T14:29:14.000Z","dependencies_parsed_at":"2024-05-27T19:33:33.594Z","dependency_job_id":"d807d562-c5b6-4457-866a-ee127f712f9e","html_url":"https://github.com/just5ky/spidertrap","commit_stats":null,"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/just5ky%2Fspidertrap","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/just5ky%2Fspidertrap/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/just5ky%2Fspidertrap/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/just5ky%2Fspidertrap/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/just5ky","download_url":"https://codeload.github.com/just5ky/spidertrap/tar.gz/refs/heads/latest","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":248536995,"owners_count":21120683,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["active-defense","cybersecurity","docker","spiders"],"created_at":"2025-03-09T11:11:21.640Z","updated_at":"2025-04-12T07:41:31.794Z","avatar_url":"https://github.com/just5ky.png","language":"Python","funding_links":[],"categories":[],"sub_categories":[],"readme":"# [Spidertrap](https://github.com/adhdproject/spidertrap) dockerized\nTrap web crawlers and spiders in an infinite set of dynamically\ngenerated webpages.\n\n![Docker Build](https://github.com/just5ky/spidertrap/workflows/Docker/badge.svg) ![Docker Pulls](https://img.shields.io/docker/pulls/justsky/spidertrap) ![Docker Size](https://img.shields.io/docker/image-size/justsky/spidertrap?color=orange)\n\nThis is a fork of [ADHDproject/Spidertrap](https://github.com/adhdproject/spidertrap) with added logging.\n\n####  Supports multi-arch\n```sh\n╰─❯ docker run --rm mplatform/mquery justsky/spidertrap:latest\nImage: justsky/spidertrap:latest (digest: sha256:98b61a1853b966015197024d2c8c9e82edab5367ee51bd7f5503d445e367df84)\n * Manifest List: Yes (Image type: application/vnd.docker.distribution.manifest.list.v2+json)\n * Supported platforms:\n   - linux/amd64\n   - linux/arm64\n   - linux/arm/v7\n   - linux/386\n   - linux/ppc64le\n   - linux/s390x\n```\n\n## Install and run\n---\n#### Using dockerhub image\n`docker run --rm --name spidertrap -v .:/log/ -p 80:80 justsky/spidertrap`\n\n#### Using github container repo image\n\n`docker run --rm --name spidertrap -v .:/log/ -p 80:80 ghcr.io/just5ky/spidertrap:latest`\n\nOR\n\n#### Using docker-compose\n\n```yml\nversion \"3\"\n\nservices:\n  spidertrap:\n    name: spidertrap\n    image: justsky/spidertrap\n    restart: unless-stopped\n    port:\n      - 80:80\n    volumes:\n      - .:/log/\n```\n\nThen visit 127.0.0.1:80 in a web\nbrowser. \n\nYou should see a page containing randomly generated links. If\nyou click on a link it will take you to a page with more randomly\ngenerated links.\n\n## Logging\n---\nLogs will be saved in spidertrap.log with Apache common log format\n\n```log\n1.2.3.4 - - [21/May/2022 09:59:55] \"GET /yf/XhuQwxZqdZwFG_6_U HTTP/1.1\" 200 -\n1.2.3.4 - - [21/May/2022 09:59:56] \"GET /favicon.ico HTTP/1.1\" 200 -\n```\n\nTrapping a Wget Spider\n--------------------\n\n`sudo wget -m http://127.0.0.1:80`\n\nWget will run until either it or Spidertrap is killed.\n\nBuild it yourself\n---\n\n- Clone this Repo\n- Inside the repo, run this\n\n ```sh\n docker build -t spidertrap .\n ```\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fjust5ky%2Fspidertrap","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fjust5ky%2Fspidertrap","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fjust5ky%2Fspidertrap/lists"}