{"id":13928827,"url":"https://github.com/stav/wgrep","last_synced_at":"2025-10-27T22:49:30.127Z","repository":{"id":40464652,"uuid":"144065448","full_name":"stav/wgrep","owner":"stav","description":"Web grep: search all rendered resources used by a URI","archived":false,"fork":false,"pushed_at":"2025-09-24T21:14:42.000Z","size":456,"stargazers_count":89,"open_issues_count":2,"forks_count":8,"subscribers_count":2,"default_branch":"master","last_synced_at":"2025-10-09T11:51:52.107Z","etag":null,"topics":["grep-like","node","puppeteer","web"],"latest_commit_sha":null,"homepage":null,"language":"JavaScript","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"apache-2.0","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/stav.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2018-08-08T20:42:26.000Z","updated_at":"2025-08-27T23:11:37.000Z","dependencies_parsed_at":"2024-06-26T15:00:49.706Z","dependency_job_id":null,"html_url":"https://github.com/stav/wgrep","commit_stats":null,"previous_names":[],"tags_count":11,"template":false,"template_full_name":null,"purl":"pkg:github/stav/wgrep","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/stav%2Fwgrep","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/stav%2Fwgrep/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/stav%2Fwgrep/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/stav%2Fwgrep/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/stav","download_url":"https://codeload.github.com/stav/wgrep/tar.gz/refs/heads/master","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/stav%2Fwgrep/sbom","scorecard":null,"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":281355360,"owners_count":26486896,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","status":"online","status_checked_at":"2025-10-27T02:00:05.855Z","response_time":61,"last_error":null,"robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":true,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["grep-like","node","puppeteer","web"],"created_at":"2024-08-07T18:01:51.179Z","updated_at":"2025-10-27T22:49:30.089Z","avatar_url":"https://github.com/stav.png","language":"JavaScript","readme":"# wgrep\n\nWeb grep: search all rendered resources used by a URI\n\n[![Coverage][cov-image]][cov-url]\n[![Releases][rel-image]][rel-url]\n[![Build][build-image]][build-url]\n\nThis `node` command-line utility uses a headless browser (Puppeteer) to render\na webpage and download all resources it may need. These resources including the\noriginal HTML are all saved locally which it searches one-by-one for a text\nstring.\n\n*Since we are downloading all resources it is easy to determine the total\ndownload size.*\n\n## Features\n\n* Search using regular expressions\n* A screen capture is created (not configurable)\n\n## Installation\n\n\t$ git clone https://github.com/stav/wgrep.git\n\t$ cd wgrep\n\t$ npm install\n\n## Usage example\n\nLet's try to find the string \"stav\" from the repository website on GitHub:\n\n\t$ npx wgrep stav https://github.com/stav/wgrep\n\n\tCalling for \"stav\" in \"output\" from \"https://github.com/stav/wgrep\" with user \"undefined\"\n\tLooking in \"output\" for 'stav'\n\tFound 1 files\n\t[ 'output/stav/wgrep/index.html' ]\n\nIt was only found in the `index.html` page.\n\nNow let's see what the total download size was:\n\n\t$ du -sh output\n\t1.4M    output\n\n## Options\n\n\t$ wgrep --help\n\n\tUsage: wgrep [options] \u003cregex\u003e \u003curl\u003e\n\n\tOptions:\n\t  -V, --version                output the version number\n\t  -d, --directory \u003cdirectory\u003e  The output directory (default: \"output\")\n\t  -u, --username \u003cusername\u003e    The user to authenticate as\n\t  -h, --help                   output usage information\n\n## Tests\n\n\t$ npm test\n\n\t$ npm run test-e2e\n\n## Contributing\n\nPlease file any issues you have.\n\nIf you fix a bug or add new features it would be great to have you fork this\nrepo and submit a pull request:\n\n1. Fork it (`https://github.com/yourname/yourproject/fork`)\n2. Create your feature branch (`git checkout -b feature/fooBar`)\n3. Commit your changes (`git commit -am 'Add some fooBar'`)\n4. Push to the branch (`git push origin feature/fooBar`)\n5. Create a new Pull Request\n\n## License\n\nApache 2.0\n\n\n[rel-image]:   https://img.shields.io/github/release/stav/wgrep.svg\n[cov-image]:   https://codecov.io/gh/stav/wgrep/branch/master/graph/badge.svg\n[build-image]: https://github.com/stav/wgrep/actions/workflows/tests.yml/badge.svg\n\n[rel-url]:     https://github.com/stav/wgrep/releases\n[cov-url]:     https://codecov.io/github/stav/wgrep\n[build-url]:   https://github.com/stav/wgrep/actions\n","funding_links":[],"categories":["node"],"sub_categories":[],"project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fstav%2Fwgrep","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fstav%2Fwgrep","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fstav%2Fwgrep/lists"}