{"id":17807440,"url":"https://github.com/get-set-fetch/extension","last_synced_at":"2025-04-05T23:05:29.841Z","repository":{"id":39580209,"uuid":"135053277","full_name":"get-set-fetch/extension","owner":"get-set-fetch","description":"web scraping extension","archived":false,"fork":false,"pushed_at":"2025-03-13T06:31:07.000Z","size":4213,"stargazers_count":81,"open_issues_count":54,"forks_count":7,"subscribers_count":8,"default_branch":"master","last_synced_at":"2025-03-29T22:04:18.779Z","etag":null,"topics":["browser","crawler","extension","indexeddb","javascript","npm","scraper"],"latest_commit_sha":null,"homepage":"","language":"TypeScript","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/get-set-fetch.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2018-05-27T14:22:23.000Z","updated_at":"2025-03-14T18:17:19.000Z","dependencies_parsed_at":"2024-09-10T10:19:00.404Z","dependency_job_id":"36fe1f0a-a427-4fa8-98d6-b4f57b47b410","html_url":"https://github.com/get-set-fetch/extension","commit_stats":{"total_commits":595,"total_committers":2,"mean_commits":297.5,"dds":0.001680672268907557,"last_synced_commit":"f06aa3217b15458a51c4c27072878ddd3d374436"},"previous_names":[],"tags_count":7,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/get-set-fetch%2Fextension","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/get-set-fetch%2Fextension/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/get-set-fetch%2Fextension/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/get-set-fetch%2Fextension/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/get-set-fetch","download_url":"https://codeload.github.com/get-set-fetch/extension/tar.gz/refs/heads/master","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":247411226,"owners_count":20934653,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["browser","crawler","extension","indexeddb","javascript","npm","scraper"],"created_at":"2024-10-27T14:04:25.475Z","updated_at":"2025-04-05T23:05:29.809Z","avatar_url":"https://github.com/get-set-fetch.png","language":"TypeScript","readme":"\u003cimg src=\"https://get-set-fetch.github.io/get-set-fetch/logo.png\"\u003e\n\n\n[![FOSSA Status](https://app.fossa.io/api/projects/git%2Bgithub.com%2Fget-set-fetch%2Fget-set-fetch.svg?type=shield)](https://app.fossa.io/projects/git%2Bgithub.com%2Fget-set-fetch%2Fget-set-fetch?ref=badge_shield)\n[![dependencies Status](https://david-dm.org/get-set-fetch/extension/status.svg)](https://david-dm.org/get-set-fetch/extension)\n[![Known Vulnerabilities](https://snyk.io/test/github/get-set-fetch/extension/badge.svg?targetFile=package.json)](https://snyk.io/test/github/get-set-fetch/extension?targetFile=package.json)\n[![Build Status](https://travis-ci.org/get-set-fetch/extension.svg?branch=master)](https://travis-ci.org/get-set-fetch/extension)\n[![Coverage Status](https://coveralls.io/repos/github/get-set-fetch/extension/badge.svg?branch=master)](https://coveralls.io/github/get-set-fetch/extension?branch=master)\n\n# Browser Extension\nget-set, Fetch! is a browser extension for scraping sites through out a series of parametrizable scraping scenarios.\n\nCurrently supported browsers: \n[Chrome](https://chrome.google.com/webstore/detail/get-set-fetch-web-scraper/obanemoliijohdnhjjkdbekbhdjeolnk), \n[Firefox](https://addons.mozilla.org/en-US/firefox/addon/get-set-fetch-web-scraper/),\n[Edge](https://microsoftedge.microsoft.com/addons/detail/getset-fetch-web-scrap/bpoeflbhbglemehjccjfockpkhddppoh).\n\nThe most common use cases are handled by builtin scenarios:\n- [Scrape Static Content](https://github.com/get-set-fetch/extension/tree/master/packages/scenarios/scrape-static-content)\n  - Extracts text and binary content from static html pages based on CSS selectors.\n- [Scrape Dynamic Content](https://github.com/get-set-fetch/extension/tree/master/packages/scenarios/scrape-dynamic-content)\n  - Extracts text and binary content from dynamic (javascript) pages based on CSS selectors.\n\nYou can also install community based scenarios:\n\n- [Extract Html Headings](https://github.com/a1sabau/gsf-extension-extract-html-headings) - [v0.2.0](https://registry.npmjs.org/gsf-extension-extract-html-headings/0.2.0) \n  - \"Hello World\" example of writing a scrape scenario.\n- [Extract Article Content](https://github.com/a1sabau/gsf-extension-readability/) - [v0.2.0](https://registry.npmjs.org/gsf-extension-readability//0.2.0) \n  - Extract article content using Mozilla Readability library.\n\n\nIf you wrote a scraping scenario and want to share it, please update the above list and make a pull request.\n\nThe extension is structured as a monorepo with the following sub-packages:\n- commons: mostly typescript definitions\n- background: parses pages and stores relevant data in the builtin browser database (IndexedDB)\n- popup: toolbar appearance\n- admin: front-end for the background capabilities\n- scrape-static-content: builtin scenario\n- scrape-dynamic-content: builtin scenario\n- extension: builds the extension files and runs a comprehensive suite of integration tests\n\nYou can find technical tidbits in each sub-package readme file.\n\nA detailed documentation with a series of examples is available at [getsetfetch.org](https://getsetfetch.org/extension/getting-started.html).\n\n\n","funding_links":[],"categories":[],"sub_categories":[],"project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fget-set-fetch%2Fextension","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fget-set-fetch%2Fextension","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fget-set-fetch%2Fextension/lists"}