{"id":13510371,"url":"https://github.com/fiveisprime/screpl","last_synced_at":"2025-07-12T17:35:39.349Z","repository":{"id":13705088,"uuid":"16399017","full_name":"fiveisprime/screpl","owner":"fiveisprime","description":"A pluggable command line based scraper with REPL support.","archived":false,"fork":false,"pushed_at":"2014-09-29T22:19:38.000Z","size":1591,"stargazers_count":30,"open_issues_count":0,"forks_count":1,"subscribers_count":4,"default_branch":"master","last_synced_at":"2025-04-13T00:47:26.613Z","etag":null,"topics":[],"latest_commit_sha":null,"homepage":"http://npm.im/screpl","language":"JavaScript","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"isc","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/fiveisprime.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null}},"created_at":"2014-01-31T03:55:18.000Z","updated_at":"2020-05-08T21:03:36.000Z","dependencies_parsed_at":"2022-09-06T12:12:10.545Z","dependency_job_id":null,"html_url":"https://github.com/fiveisprime/screpl","commit_stats":null,"previous_names":[],"tags_count":6,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/fiveisprime%2Fscrepl","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/fiveisprime%2Fscrepl/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/fiveisprime%2Fscrepl/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/fiveisprime%2Fscrepl/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/fiveisprime","download_url":"https://codeload.github.com/fiveisprime/screpl/tar.gz/refs/heads/master","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":250582035,"owners_count":21453796,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":[],"created_at":"2024-08-01T02:01:36.257Z","updated_at":"2025-04-24T07:27:38.757Z","avatar_url":"https://github.com/fiveisprime.png","language":"JavaScript","funding_links":[],"categories":["JavaScript","others"],"sub_categories":[],"readme":"SCREPL [![Build Status](https://travis-ci.org/fiveisprime/screpl.svg?branch=master)](https://travis-ci.org/fiveisprime/screpl) [![NPM version](https://badge.fury.io/js/screpl.svg)](http://badge.fury.io/js/screpl)\n======\n\nA pluggable command line based scraper with REPL support.\n\n# Installation\n```\n\u003e npm install screpl -g \n```\n# Usage\n\nPass a URL to SCREPL then use the `$` variable as a jQuery object.\n\n```shell\nUsage: screpl \u003curl\u003e\n\nOptions:\n\n  -h, --help              output usage information\n  -V, --version           output the version number\n  -r, --require \u003cmodule\u003e  require a plugin module\n```\n\n# Plugins\n\nCheck out the plugin example in the examples directory.\n\nPlugins are node modules that expose a function which accepts the REPL context.\nAttach variables and functions to the context to make them accessible at\nrun-time.\n\n```javascript\nmodule.exports = function(context) {\n\n  context.getText = function() {\n\n    //\n    // Access the jQuery object from within the plugin.\n    //\n    context.$('p').each(function() {\n      out.push(this.text());\n    });\n\n    //\n    // The return value will be written to standard out.\n    //\n    return out.join(' ');\n  };\n};\n```\n\nRequire your plugin using the `--require` option.\n\n```shell\n$ screpl http://example.com --require plugin.js\n\n  request loaded with 200\n  use the variable `$` to access the result\n\n\u003e getText()\n'\\nWelcome to exmaple.com.\\nChances...'\n```\n\n### Plugins Already Available \n\n```\nwriteFile($(\"body\").html(), 'index.html')\npostHttp($(\"body\").html(), 'http://yourserver.com')\n\n```\n\n**Variables and functions exposed through plugins will autocomplete.**\n\n# License\n\nCopyright (c) 2014, Matt Hernandez \u003cmatt@modulus.io\u003e\n\nPermission to use, copy, modify, and/or distribute this software for any\npurpose with or without fee is hereby granted, provided that the above\ncopyright notice and this permission notice appear in all copies.\n\nTHE SOFTWARE IS PROVIDED \"AS IS\" AND THE AUTHOR DISCLAIMS ALL WARRANTIES WITH\nREGARD TO THIS SOFTWARE INCLUDING ALL IMPLIED WARRANTIES OF MERCHANTABILITY AND\nFITNESS. IN NO EVENT SHALL THE AUTHOR BE LIABLE FOR ANY SPECIAL, DIRECT,\nINDIRECT, OR CONSEQUENTIAL DAMAGES OR ANY DAMAGES WHATSOEVER RESULTING FROM\nLOSS OF USE, DATA OR PROFITS, WHETHER IN AN ACTION OF CONTRACT, NEGLIGENCE OR\nOTHER TORTIOUS ACTION, ARISING OUT OF OR IN CONNECTION WITH THE USE OR\nPERFORMANCE OF THIS SOFTWARE.\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Ffiveisprime%2Fscrepl","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Ffiveisprime%2Fscrepl","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Ffiveisprime%2Fscrepl/lists"}