{"id":15045160,"url":"https://github.com/echamudi/web-design-scraper","last_synced_at":"2025-10-05T16:35:34.843Z","repository":{"id":43326767,"uuid":"328272162","full_name":"echamudi/web-design-scraper","owner":"echamudi","description":"Extract and inspect web design metrics through Chrome extension!","archived":false,"fork":false,"pushed_at":"2021-05-19T11:24:11.000Z","size":1471,"stargazers_count":12,"open_issues_count":0,"forks_count":2,"subscribers_count":2,"default_branch":"main","last_synced_at":"2025-08-31T07:28:36.472Z","etag":null,"topics":["chrome","chrome-extension","typescript","web-design"],"latest_commit_sha":null,"homepage":"","language":"TypeScript","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mpl-2.0","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/echamudi.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null}},"created_at":"2021-01-10T00:20:31.000Z","updated_at":"2025-03-04T05:35:13.000Z","dependencies_parsed_at":"2022-09-01T09:41:33.435Z","dependency_job_id":null,"html_url":"https://github.com/echamudi/web-design-scraper","commit_stats":null,"previous_names":["echamudi/smart-web-design-scraper"],"tags_count":1,"template":false,"template_full_name":null,"purl":"pkg:github/echamudi/web-design-scraper","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/echamudi%2Fweb-design-scraper","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/echamudi%2Fweb-design-scraper/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/echamudi%2Fweb-design-scraper/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/echamudi%2Fweb-design-scraper/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/echamudi","download_url":"https://codeload.github.com/echamudi/web-design-scraper/tar.gz/refs/heads/main","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/echamudi%2Fweb-design-scraper/sbom","scorecard":null,"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":278485032,"owners_count":25994935,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","status":"online","status_checked_at":"2025-10-05T02:00:06.059Z","response_time":54,"last_error":null,"robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":true,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["chrome","chrome-extension","typescript","web-design"],"created_at":"2024-09-24T20:51:31.727Z","updated_at":"2025-10-05T16:35:34.828Z","avatar_url":"https://github.com/echamudi.png","language":"TypeScript","funding_links":[],"categories":[],"sub_categories":[],"readme":"# Web Design Scraper\n\n\u003cimg src=\"./assets/logo.svg\" alt=\"Web Design Scraper Logo\" height=\"96\"/\u003e\u003ca href=\"https://chrome.google.com/webstore/detail/web-design-scraper/lhhebabfhjommcpnaapcncphgbbjlknd\" target=\"_blank\"\u003e\n\u003cimg src=\"https://storage.googleapis.com/chrome-gcs-uploader.appspot.com/image/WlD8wC6g8khYWPJUsQceQkhXSlv1/iNEddTyWiMfLSwFD6qGq.png\" alt=\"Chrome Web Store\" height=\"48\"/\u003e\n\u003c/a\u003e\n\nWeb Design Scraper is a tool to extract objective web design measurements from a web page. This repo contains the early implementation of the web design scraping concept that we coined in [our research paper](https://ieeexplore.ieee.org/abstract/document/9271770).\n\n\u003c!-- This tool can run in the following environments:\n- Web browser (Google Chrome extension)\n- CLI (using puppeteer) --\u003e\n\n[![Web Design Scraper Screenshot](https://raw.githubusercontent.com/echamudi/echamudi/master/project-screenshots/web-design-scraper.png)](https://github.com/echamudi/web-design-scraper)\n\n\n## Project Goals\n\nThe extracted web design measurements from this tool can be used for:\n- Auditing web designs through objective measurements\n- Understanding and comparing web design patterns between different websites\n\nThe JSON output can also be used as machine learning inputs for:\n- Predicting the usability of websites\n- Classifying website based on certain design measurements\n- Scoring website quality and design aesthetic\n\n## Extracted Design Information\n\nCurrently this tool can extract the following design information:\n- Symmetry\n- Complexity\n- Density\n- Cohesion\n- Economy\n- Simplicty\n- Font size families\n- Text size distribution\n- Color count rank\n- Vibrant colors\n\nThere are [more measurements](./web-design-factors.md) planned to be included in this tool.\n\n## Running this Project\n\nTo run this project, you can either install the published version from the [chrome web store](https://chrome.google.com/webstore/detail/web-design-scraper/lhhebabfhjommcpnaapcncphgbbjlknd) or [build](#build) it by yourself.\n\nThis repo might contain the more updated version of the tool than the published one.\n\n## Building\n\n\u003c!-- ### Chrome Extension --\u003e\n\nYou need node.js installed in your machine to build the chrome extension. \nIf you have it already, please follow the following steps to build the extension:\n\n1. Clone this repository and open the folder in terminal.\n\n2. Run the following commands:\n\n    ```\n    npm install\n    npm run build:chrome\n    ```\n\n    The commands above will produce the chrome extension inside `./chrome-ext-dist` folder.\n\n3. Then, you can run the extension by [sideloading](https://developer.chrome.com/docs/extensions/mv2/getstarted/#unpacked) the `./chrome-ext-dist` folder to Google Chrome.\n\n\u003c!-- ### Puppeteer\n\n*to be added soon* --\u003e\n\n## Tools and Libraries\n\nThis tool is built by using TypeScript, React, Webpack, SCSS, Farbic UI, Vibrant, Jest, and [other libraries](./package.json).\n\n## Future Development\n\n- [ ] Implement user configuration\n- [ ] Implement [more measurements](./web-design-factors.md)\n- [ ] Allow users to analyze displayed viewport only\n- [ ] Compile for Puppeteer to allow analyzing webpages through CLI\n- [ ] Use WebWorker to optimize performance\n\n## Research Paper\n\n- A. Namoun, A. Alshanqiti, E. Chamudi and M. A. Rahmon, \"Web Design Scraping: Enabling Factors, Opportunities and Research Directions,\" 2020 12th International Conference on Information Technology and Electrical Engineering (ICITEE), Yogyakarta, 2020, pp. 104-109, doi: [10.1109/ICITEE49829.2020.9271770.](https://ieeexplore.ieee.org/abstract/document/9271770)\n\n## License\n\nCopyright © 2020 Web Design Scraper Team\n\nWeb Design Scraper code is licensed under MPL-2.0. Images, logos, docs, and articles in this project are released under CC-BY-SA-4.0.\n\nLibraries, dependencies, and tools used in this project are tied with [their licenses](./licenses.csv).\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fechamudi%2Fweb-design-scraper","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fechamudi%2Fweb-design-scraper","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fechamudi%2Fweb-design-scraper/lists"}