{"id":26722956,"url":"https://github.com/useallfive/grunt-phantom-crawler","last_synced_at":"2025-03-27T20:38:26.108Z","repository":{"id":17339030,"uuid":"20110325","full_name":"UseAllFive/grunt-phantom-crawler","owner":"UseAllFive","description":"Crawl a site and generate urls and sitemap with phantomjs","archived":false,"fork":false,"pushed_at":"2014-05-27T01:11:18.000Z","size":108,"stargazers_count":0,"open_issues_count":0,"forks_count":0,"subscribers_count":21,"default_branch":"master","last_synced_at":"2024-12-20T07:07:36.002Z","etag":null,"topics":[],"latest_commit_sha":null,"homepage":null,"language":"JavaScript","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/UseAllFive.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE-MIT","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null}},"created_at":"2014-05-23T18:46:59.000Z","updated_at":"2014-05-28T22:55:53.000Z","dependencies_parsed_at":"2022-09-25T08:33:46.510Z","dependency_job_id":null,"html_url":"https://github.com/UseAllFive/grunt-phantom-crawler","commit_stats":null,"previous_names":[],"tags_count":1,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/UseAllFive%2Fgrunt-phantom-crawler","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/UseAllFive%2Fgrunt-phantom-crawler/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/UseAllFive%2Fgrunt-phantom-crawler/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/UseAllFive%2Fgrunt-phantom-crawler/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/UseAllFive","download_url":"https://codeload.github.com/UseAllFive/grunt-phantom-crawler/tar.gz/refs/heads/master","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":245923364,"owners_count":20694713,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":[],"created_at":"2025-03-27T20:38:25.439Z","updated_at":"2025-03-27T20:38:26.094Z","avatar_url":"https://github.com/UseAllFive.png","language":"JavaScript","funding_links":[],"categories":[],"sub_categories":[],"readme":"# grunt-phantom-crawler\n\n\u003e Crawl a site and generate a list of urls with phantomjs\n\n## Getting Started\nThis plugin requires Grunt `~0.4.5`\n\nIf you haven't used [Grunt](http://gruntjs.com/) before, be sure to check out the [Getting Started](http://gruntjs.com/getting-started) guide, as it explains how to create a [Gruntfile](http://gruntjs.com/sample-gruntfile) as well as install and use Grunt plugins. Once you're familiar with that process, you may install this plugin with this command:\n\n```shell\nnpm install grunt-phantom-crawler --save-dev\n```\n\nOnce the plugin has been installed, it may be enabled inside your Gruntfile with this line of JavaScript:\n\n```js\ngrunt.loadNpmTasks('grunt-phantom-crawler');\n```\n\n## The \"phantom-crawler\" task\n\n### Overview\nIn your project's Gruntfile, add a section named `phantom-crawler` to the data object passed into `grunt.initConfig()`.\n\n```js\ngrunt.initConfig({\n  'phantom-crawler': {\n    options: {\n      // Task-specific options go here.\n    },\n    your_target: {\n      // Target-specific file lists and/or options go here.\n    },\n  },\n});\n```\n\n### Options\n\n#### options.baseUrl\nType: `String`\nDefault value: `'http://localhost'`\n\nThe base url of the site you want to crawl.\n\n#### options.startingPath\nType: `String`\nDefault value: `'/'`\n\nThe path in the site from which crawling will commence.\n\n#### options.filePath\nType: `String`\nDefault value: `'config/paths.js'`\n\nThe filesystem path to which the urls will be output.\n\n#### options.depth\nType: `String`\nDefault value: `'5'`\n\nHow many levels deep the crawler will travel\n\n### Usage Examples\n\n```js\ngrunt.initConfig({\n  'phantom-crawler': {\n    options: {\n      'baseUrl': 'http://localhost:8080',\n      'depth': 2\n    }\n  },\n});\n```\n\n## Release History\n_(Nothing yet)_\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fuseallfive%2Fgrunt-phantom-crawler","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fuseallfive%2Fgrunt-phantom-crawler","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fuseallfive%2Fgrunt-phantom-crawler/lists"}