{"id":25720036,"url":"https://github.com/gregwhitaker/roboto","last_synced_at":"2026-04-27T16:33:35.100Z","repository":{"id":82732614,"uuid":"134349691","full_name":"gregwhitaker/roboto","owner":"gregwhitaker","description":"Module for Spring Boot applications that automatically generates robots.txt and sitemap.xml files","archived":false,"fork":false,"pushed_at":"2018-05-27T05:26:36.000Z","size":163,"stargazers_count":2,"open_issues_count":1,"forks_count":0,"subscribers_count":1,"default_branch":"master","last_synced_at":"2025-10-29T09:54:15.008Z","etag":null,"topics":["robots","seo","sitemap","spring","spring-boot","spring-mvc"],"latest_commit_sha":null,"homepage":"","language":"Java","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"apache-2.0","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/gregwhitaker.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2018-05-22T02:29:30.000Z","updated_at":"2024-07-20T21:26:55.000Z","dependencies_parsed_at":null,"dependency_job_id":"4e8a1d09-08ed-4ec1-b252-2072a2fcfd8c","html_url":"https://github.com/gregwhitaker/roboto","commit_stats":null,"previous_names":[],"tags_count":1,"template":false,"template_full_name":null,"purl":"pkg:github/gregwhitaker/roboto","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/gregwhitaker%2Froboto","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/gregwhitaker%2Froboto/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/gregwhitaker%2Froboto/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/gregwhitaker%2Froboto/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/gregwhitaker","download_url":"https://codeload.github.com/gregwhitaker/roboto/tar.gz/refs/heads/master","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/gregwhitaker%2Froboto/sbom","scorecard":null,"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":286080680,"owners_count":32345805,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2026-04-26T23:26:28.701Z","status":"online","status_checked_at":"2026-04-27T02:00:06.769Z","response_time":128,"last_error":null,"robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":true,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["robots","seo","sitemap","spring","spring-boot","spring-mvc"],"created_at":"2025-02-25T17:36:25.330Z","updated_at":"2026-04-27T16:33:35.096Z","avatar_url":"https://github.com/gregwhitaker.png","language":"Java","funding_links":[],"categories":[],"sub_categories":[],"readme":"# roboto\n[![Build Status](https://travis-ci.org/gregwhitaker/roboto.svg?branch=master)](https://travis-ci.org/gregwhitaker/roboto)\n\nModule for Spring Boot applications that automatically generates [robots.txt](http://www.robotstxt.org/) and [sitemap.xml](https://www.sitemaps.org/protocol.html) files based on standard \ncontroller annotations.\n\n## How does it work?\n1. Simply annotate your main Spring application class with the `@EnableRoboto` annotation like so:\n\n        @SpringBootApplication\n        @EnableRoboto\n        public class Application {\n        \n            public static void main(String... args) {\n                SpringApplication.run(Application.class, args);\n            }\n        }\n\n2. Next, use the `@DisallowRobots` annotation to mark methods and/or controllers that you would like to be excluded from search engine indexing.\n\n    For Example:\n    \n        @Controller\n        @DisallowRobots\n        public class FooController {\n        \n            @GetMapping(\"/foo/1\")\n            public String foo1(Model model) {\n                model.addAttribute(\"message\", \"This is Foo1\");\n                return \"foo\";\n            }\n            \n            @GetMapping(\"/foo/2\")\n            public String foo2(Model model) {\n                model.addAttribute(\"message\", \"This is Foo2\");\n                return \"foo\";\n            }\n        }\n        \n    Or\n    \n        @Controller\n        public class FooController {\n        \n            @GetMapping(\"/foo/1\")\n            @DisallowRobots\n            public String foo1(Model model) {\n                model.addAttribute(\"message\", \"This is Foo1\");\n                return \"foo\";\n            }\n            \n            @GetMapping(\"/foo/2\")\n            public String foo2(Model model) {\n                model.addAttribute(\"message\", \"This is Foo2\");\n                return \"foo\";\n            }\n        }\n\n3. That's all there is to it. Your robots.txt and sitemap.xml files are now automatically accessible at `/robots.txt` \nand `/sitemap.xml`.\n\n## Getting Roboto\nRoboto libraries are available via JCenter.\n\n* [roboto-springboot](https://bintray.com/gregwhitaker/maven/roboto-springboot) - Use this library if you are integrating with Spring Boot.\n\n## Examples\nPlease see the included [example projects](roboto-examples) for demonstrations on how to configure and use Roboto.\n\n## Bugs and Feedback\nFor bugs, questions, and discussions please use the [Github Issues](https://github.com/gregwhitaker/roboto/issues).\n\n## License\nCopyright 2018 Greg Whitaker\n\nLicensed under the Apache License, Version 2.0 (the \"License\");\nyou may not use this file except in compliance with the License.\nYou may obtain a copy of the License at\n\n   http://www.apache.org/licenses/LICENSE-2.0\n\nUnless required by applicable law or agreed to in writing, software\ndistributed under the License is distributed on an \"AS IS\" BASIS,\nWITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.\nSee the License for the specific language governing permissions and\nlimitations under the License.\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fgregwhitaker%2Froboto","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fgregwhitaker%2Froboto","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fgregwhitaker%2Froboto/lists"}