https://github.com/florianwendelborn/robogen
🤖 Robots.txt generator done right.
https://github.com/florianwendelborn/robogen
npm-package robots-generator robots-txt
Last synced: 4 months ago
JSON representation
🤖 Robots.txt generator done right.
- Host: GitHub
- URL: https://github.com/florianwendelborn/robogen
- Owner: FlorianWendelborn
- License: mit
- Created: 2017-01-29T06:08:31.000Z (over 8 years ago)
- Default Branch: master
- Last Pushed: 2017-03-09T14:44:46.000Z (over 8 years ago)
- Last Synced: 2025-01-02T13:46:47.818Z (6 months ago)
- Topics: npm-package, robots-generator, robots-txt
- Language: JavaScript
- Homepage: https://npmjs.com/package/robogen
- Size: 3.91 KB
- Stars: 3
- Watchers: 2
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: readme.md
- License: license.md
Awesome Lists containing this project
README
# robogen
> Robots.txt generator done right.
Takes an array of objects that describe rules. Converts them to an appropriate `robots.txt`.
[](https://slack.dodekeract.com)
## Usage
Generate a `robots.txt`:
```js
import robogen from 'robogen'
const robotsTXT = robogen([{
userAgent: '*',
allow: '/',
disallow: ['/secret', '/private']
}, {
userAgent: ['Bingbot', 'MSNBot'],
disallow: '/'
}])
console.log(robotsTXT)
```
This will output
```http
User-agent: *
Allow: /
Disallow: /secret
Disallow: /private
User-agent: Bingbot
User-agent: MSNBot
Disallow: /
```
## Install
With [npm](https://npmjs.org/) installed, run
```sh
$ npm install robogen
```
## Acknowledgments
robogen was inspired by [robots-generator](https://npmjs.com/package/robots-generator)
## See Also
- [`noffle/common-readme`](https://github.com/noffle/common-readme)
## License
[MIT](license.md)