{"id":30106114,"url":"https://github.com/blocklet/snap-kit","last_synced_at":"2025-08-10T01:03:59.819Z","repository":{"id":294559290,"uuid":"986805915","full_name":"blocklet/snap-kit","owner":"blocklet","description":"Snap Kit is a powerful, Puppeteer-based service designed for seamless web automation. It enables you to effortlessly capture high-fidelity web page screenshots and efficiently scrape web content for precise data extraction.","archived":false,"fork":false,"pushed_at":"2025-07-13T15:18:41.000Z","size":3215,"stargazers_count":0,"open_issues_count":0,"forks_count":0,"subscribers_count":12,"default_branch":"master","last_synced_at":"2025-07-13T17:28:31.056Z","etag":null,"topics":["browser-automation","puppeteer","self-hosting","web-crawling","web-screenshot"],"latest_commit_sha":null,"homepage":"https://snap.createblocklet.dev/","language":"TypeScript","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/blocklet.png","metadata":{"files":{"readme":"README.md","changelog":"CHANGELOG.md","contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null,"zenodo":null}},"created_at":"2025-05-20T06:39:47.000Z","updated_at":"2025-07-13T15:18:45.000Z","dependencies_parsed_at":"2025-05-21T02:26:39.784Z","dependency_job_id":"1d50576c-33e5-4448-bdf2-5773fe6d1eef","html_url":"https://github.com/blocklet/snap-kit","commit_stats":null,"previous_names":["blocklet/snap-kit"],"tags_count":0,"template":false,"template_full_name":null,"purl":"pkg:github/blocklet/snap-kit","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/blocklet%2Fsnap-kit","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/blocklet%2Fsnap-kit/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/blocklet%2Fsnap-kit/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/blocklet%2Fsnap-kit/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/blocklet","download_url":"https://codeload.github.com/blocklet/snap-kit/tar.gz/refs/heads/master","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/blocklet%2Fsnap-kit/sbom","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":269659448,"owners_count":24455112,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","status":"online","status_checked_at":"2025-08-09T02:00:10.424Z","response_time":111,"last_error":null,"robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":true,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["browser-automation","puppeteer","self-hosting","web-crawling","web-screenshot"],"created_at":"2025-08-10T01:01:47.013Z","updated_at":"2025-08-10T01:03:59.786Z","avatar_url":"https://github.com/blocklet.png","language":"TypeScript","funding_links":[],"categories":[],"sub_categories":[],"readme":"# Snap Kit\n\nThis repository contains three modules:\n\n## Snap Kit\n\n`blocklets/snap-kit`\n\nA [Blocklet](https://www.arcblock.io/en).\n\nThis is a Puppeteer-based service designed for seamless web automation. It allows you to effortlessly capture high-fidelity web page screenshots and efficiently scrape web content for precise data extraction.\n\n[Documentation](https://github.com/blocklet/snap-kit/blob/master/blocklets/snap-kit/blocklet.md)\n\n## @arcblock/crawler\n\n`packages/crawler`\n\nA crawler module designed for Blocklets. It supports batch crawling of HTML, webpage screenshots, title, description, and more, based on URL or Sitemap.\n\n[Documentation](https://github.com/blocklet/snap-kit/blob/master/packages/crawler/README.md)\n\n## @arcblock/crawler-middleware\n\n`packages/crawler-middleware`\n\nA Snap Kit middleware for Blocklets.\n\nThis Express middleware provides pre-rendered HTML generated by SnapKit for Blocklets. It enables them to serve complete HTML content to web spiders, which is crucial for SEO and ensuring that search engines can properly index dynamically generated content.\n\n[Documentation](https://github.com/blocklet/snap-kit/blob/master/packages/middleware/README.md)\n\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fblocklet%2Fsnap-kit","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fblocklet%2Fsnap-kit","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fblocklet%2Fsnap-kit/lists"}