{"id":22505318,"url":"https://github.com/azer/scrape-url","last_synced_at":"2025-10-14T01:39:44.940Z","repository":{"id":11174766,"uuid":"13550559","full_name":"azer/scrape-url","owner":"azer","description":"Scrape URLs with CSS selectors","archived":false,"fork":false,"pushed_at":"2014-04-11T08:56:40.000Z","size":201,"stargazers_count":8,"open_issues_count":0,"forks_count":2,"subscribers_count":2,"default_branch":"master","last_synced_at":"2025-04-09T07:52:06.698Z","etag":null,"topics":[],"latest_commit_sha":null,"homepage":"","language":"JavaScript","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/azer.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null}},"created_at":"2013-10-14T02:07:38.000Z","updated_at":"2016-06-28T23:49:54.000Z","dependencies_parsed_at":"2022-09-04T06:20:26.606Z","dependency_job_id":null,"html_url":"https://github.com/azer/scrape-url","commit_stats":null,"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"purl":"pkg:github/azer/scrape-url","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/azer%2Fscrape-url","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/azer%2Fscrape-url/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/azer%2Fscrape-url/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/azer%2Fscrape-url/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/azer","download_url":"https://codeload.github.com/azer/scrape-url/tar.gz/refs/heads/master","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/azer%2Fscrape-url/sbom","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":267362411,"owners_count":24075112,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","status":"online","status_checked_at":"2025-07-27T02:00:11.917Z","response_time":82,"last_error":null,"robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":true,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":[],"created_at":"2024-12-07T00:17:25.058Z","updated_at":"2025-10-14T01:39:39.917Z","avatar_url":"https://github.com/azer.png","language":"JavaScript","funding_links":[],"categories":[],"sub_categories":[],"readme":"## scrape-url\n\nScrape URLs with CSS selectors and returns elements with [jQuery-like interface](http://npmjs.org/cheerio).\n\n## Install\n\n```bash\n$ npm install scrape-url\n```\n\n## Usage\n\n```js\nscrape = require('scrape-url')\n\nscrape('http://news.ycombinator.com', '.title a', function (error, matches) {\n\n  matches[0].html()\n  // =\u003e \"Richard Feynman: Cargo Cult Science (1974)\"\n\n  matches[1].html()\n  // =\u003e \"Stanford Ovshinsky: the greatest scientist you've never heard of\"\n\n})\n```\n\nMultiple selectors can be passed:\n\n```js\nscrape('news.ycombinator.com', ['.title a', '.foo #bar', '.span .egg'], function (error, titles, foobar, spaneggs) {\n //\n})\n```\n\nTo make a post request:\n\n```js\nscrape.post({ url: 'foo.com/bar', form: { message: 'Hello World' } }, ['body .content'], function  (error, content) {\n  \n  content[0].html()\n  // =\u003e Message: 'Hello World'\n  \n})\n```\n\nYou can pass options instead of URLs:\n\n```js\nscrape({ url: 'foo.com/bar', 'headers': { 'user-agent': 'neck trimmer 5.0' } }, ['h1.title'], function (error, titles) {\n    //    \n})\n```\n\nSee `example.js` for more information.\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fazer%2Fscrape-url","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fazer%2Fscrape-url","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fazer%2Fscrape-url/lists"}