{"id":16611646,"url":"https://github.com/shufo/plug_robots","last_synced_at":"2025-10-29T18:30:30.875Z","repository":{"id":19511599,"uuid":"87211918","full_name":"shufo/plug_robots","owner":"shufo","description":"An Elixir plug serving robots.txt.","archived":false,"fork":false,"pushed_at":"2023-12-15T05:42:35.000Z","size":6,"stargazers_count":3,"open_issues_count":4,"forks_count":1,"subscribers_count":3,"default_branch":"master","last_synced_at":"2025-02-06T22:54:27.534Z","etag":null,"topics":["elixir"],"latest_commit_sha":null,"homepage":"https://hex.pm/packages/plug_robots","language":"Elixir","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/shufo.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2017-04-04T16:45:55.000Z","updated_at":"2020-01-12T18:58:07.000Z","dependencies_parsed_at":"2023-12-15T06:49:48.585Z","dependency_job_id":null,"html_url":"https://github.com/shufo/plug_robots","commit_stats":{"total_commits":1,"total_committers":1,"mean_commits":1.0,"dds":0.0,"last_synced_commit":"4a72927f6b4045fc4141da78dcba850bcdf66e55"},"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/shufo%2Fplug_robots","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/shufo%2Fplug_robots/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/shufo%2Fplug_robots/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/shufo%2Fplug_robots/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/shufo","download_url":"https://codeload.github.com/shufo/plug_robots/tar.gz/refs/heads/master","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":238864184,"owners_count":19543489,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["elixir"],"created_at":"2024-10-12T01:38:50.585Z","updated_at":"2025-10-29T18:30:25.596Z","avatar_url":"https://github.com/shufo.png","language":"Elixir","funding_links":[],"categories":[],"sub_categories":[],"readme":"# PlugRobots\n\nAn Elixir plug serving robots.txt.\n\n## Installation\n\nAdd plug_robots to your list of dependencies in mix.exs:\n\n\n```elixir\ndef deps do\n  [{:plug_robots, \"~\u003e 0.1.0\"}]\nend\n```\n\n## Usage\n\n- Add it to your endpoint before the router\n\n`endpoint.ex`\n\n```elixir\nplug PlugRobots, rules: :allow_all\n\nplug MyApp.Router\n```\n\n## Examples\n\n- Deny all crawler\n\n```elixir\nplug PlugRobots, rules: :deny_all\n\nplug MyApp.Router\n```\n\n- Returns different rules by environment\n\n```elixir\ncase Mix.env do\n    :prod -\u003e plug PlugRobots, rules: :allow_all\n    _     -\u003e plug PlugRobots, rules: :deny_all\nend\n\nplug MyApp.Router\n```\n\n- Returns custom rules\n\n```elixir\n@googlebot_rule \"\"\"\nUser-agent: GoogleBot\nDisallow: /images/dogs.jpg\n\"\"\"\n\nplug PlugRobots, rules: @googlebot_rule\n\nplug MyApp.Router\n```\n### Options\n\n- `rules`\n  - `:allow_all`: Allow all crawlers to all path\n  - `:deny_all`: Disallow all crawlers to all path\n  - string: any other custom rules\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fshufo%2Fplug_robots","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fshufo%2Fplug_robots","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fshufo%2Fplug_robots/lists"}