{"id":18355426,"url":"https://github.com/charto/cget","last_synced_at":"2025-10-14T11:36:22.972Z","repository":{"id":57196438,"uuid":"47026034","full_name":"charto/cget","owner":"charto","description":"Robust streaming cache for HTTP requests","archived":false,"fork":false,"pushed_at":"2018-06-05T13:11:05.000Z","size":98,"stargazers_count":1,"open_issues_count":0,"forks_count":7,"subscribers_count":2,"default_branch":"master","last_synced_at":"2025-08-24T08:14:21.266Z","etag":null,"topics":[],"latest_commit_sha":null,"homepage":null,"language":"TypeScript","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/charto.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null}},"created_at":"2015-11-28T14:15:19.000Z","updated_at":"2022-01-20T11:45:20.000Z","dependencies_parsed_at":"2022-08-27T12:02:54.204Z","dependency_job_id":null,"html_url":"https://github.com/charto/cget","commit_stats":null,"previous_names":[],"tags_count":9,"template":false,"template_full_name":null,"purl":"pkg:github/charto/cget","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/charto%2Fcget","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/charto%2Fcget/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/charto%2Fcget/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/charto%2Fcget/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/charto","download_url":"https://codeload.github.com/charto/cget/tar.gz/refs/heads/master","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/charto%2Fcget/sbom","scorecard":{"id":274706,"data":{"date":"2025-08-11","repo":{"name":"github.com/charto/cget","commit":"5a7d6962692d57a03854f65ff9288f6a2d0b3e69"},"scorecard":{"version":"v5.2.1-40-gf6ed084d","commit":"f6ed084d17c9236477efd66e5b258b9d4cc7b389"},"score":3,"checks":[{"name":"Pinned-Dependencies","score":-1,"reason":"no dependencies found","details":null,"documentation":{"short":"Determines if the project has declared and pinned the dependencies of its build process.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#pinned-dependencies"}},{"name":"Packaging","score":-1,"reason":"packaging workflow not detected","details":["Warn: no GitHub/GitLab publishing workflow detected."],"documentation":{"short":"Determines if the project is published as a package that others can easily download, install, easily update, and uninstall.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#packaging"}},{"name":"Maintained","score":0,"reason":"0 commit(s) and 0 issue activity found in the last 90 days -- score normalized to 0","details":null,"documentation":{"short":"Determines if the project is \"actively maintained\".","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#maintained"}},{"name":"Code-Review","score":0,"reason":"Found 0/30 approved changesets -- score normalized to 0","details":null,"documentation":{"short":"Determines if the project requires human code review before pull requests (aka merge requests) are merged.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#code-review"}},{"name":"Dangerous-Workflow","score":-1,"reason":"no workflows found","details":null,"documentation":{"short":"Determines if the project's GitHub Action workflows avoid dangerous patterns.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#dangerous-workflow"}},{"name":"Binary-Artifacts","score":10,"reason":"no binaries found in the repo","details":null,"documentation":{"short":"Determines if the project has generated executable (binary) artifacts in the source repository.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#binary-artifacts"}},{"name":"Token-Permissions","score":-1,"reason":"No tokens found","details":null,"documentation":{"short":"Determines if the project's workflows follow the principle of least privilege.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#token-permissions"}},{"name":"SAST","score":0,"reason":"no SAST tool detected","details":["Warn: no pull requests merged into dev branch"],"documentation":{"short":"Determines if the project uses static code analysis.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#sast"}},{"name":"CII-Best-Practices","score":0,"reason":"no effort to earn an OpenSSF best practices badge detected","details":null,"documentation":{"short":"Determines if the project has an OpenSSF (formerly CII) Best Practices Badge.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#cii-best-practices"}},{"name":"Security-Policy","score":0,"reason":"security policy file not detected","details":["Warn: no security policy file detected","Warn: no security file to analyze","Warn: no security file to analyze","Warn: no security file to analyze"],"documentation":{"short":"Determines if the project has published a security policy.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#security-policy"}},{"name":"Vulnerabilities","score":10,"reason":"0 existing vulnerabilities detected","details":null,"documentation":{"short":"Determines if the project has open, known unfixed vulnerabilities.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#vulnerabilities"}},{"name":"Fuzzing","score":0,"reason":"project is not fuzzed","details":["Warn: no fuzzer integrations found"],"documentation":{"short":"Determines if the project uses fuzzing.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#fuzzing"}},{"name":"License","score":10,"reason":"license file detected","details":["Info: project has a license file: LICENSE:0","Info: FSF or OSI recognized license: MIT License: LICENSE:0"],"documentation":{"short":"Determines if the project has defined a license.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#license"}},{"name":"Signed-Releases","score":-1,"reason":"no releases found","details":null,"documentation":{"short":"Determines if the project cryptographically signs release artifacts.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#signed-releases"}},{"name":"Branch-Protection","score":0,"reason":"branch protection not enabled on development/release branches","details":["Warn: branch protection not enabled for branch 'master'"],"documentation":{"short":"Determines if the default and release branches are protected with GitHub's branch protection settings.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#branch-protection"}}]},"last_synced_at":"2025-08-17T14:09:29.418Z","repository_id":57196438,"created_at":"2025-08-17T14:09:29.418Z","updated_at":"2025-08-17T14:09:29.418Z"},"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":279019052,"owners_count":26086516,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","status":"online","status_checked_at":"2025-10-14T02:00:06.444Z","response_time":60,"last_error":null,"robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":true,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":[],"created_at":"2024-11-05T22:06:52.940Z","updated_at":"2025-10-14T11:36:22.938Z","avatar_url":"https://github.com/charto.png","language":"TypeScript","funding_links":[],"categories":[],"sub_categories":[],"readme":"cget\n====\n\n[![build status](https://travis-ci.org/charto/cget.svg?branch=master)](http://travis-ci.org/charto/cget)\n[![dependency status](https://david-dm.org/charto/cget.svg)](https://david-dm.org/charto/cget)\n[![npm version](https://img.shields.io/npm/v/cget.svg)](https://www.npmjs.com/package/cget)\n\n`cget` is a robust streaming parallel download manager with a filesystem cache and a simple API.\n\nFeatures\n--------\n\n- Promise-based API, returns HTTP headers and a Node.js stream with contents.\n- Filesystem cache mirrors remote hosts and their directory structure.\n  - Easy to bypass `cget` and look at cached files.\n- Stores headers in separate `.header.json` files.\n- Caches HTTP errors to avoid repeating failing requests.\n- Limits concurrent downloads automatically using [cwait](https://github.com/charto/cwait#readme).\n- Follows and caches redirect headers.\n- Built on top of [request](https://github.com/request/request).\n- Optionally allow streaming from `file://` URLs, bypassing the cache.\n- Add arbitrary files in the cache with any URI (URL or URN) as the key.\n- Written in TypeScript.\n\n`cget` is perfect for downloading and caching various schema files,\nand is used in [cxsd](https://github.com/charto/cxsd#readme)\n\nUsage\n=====\n\nCached downloads\n----------------\n\n```JavaScript\nvar Cache = require('cget').Cache;\n\n// Store files in \"cache\" subdirectory next to this script.\nvar basePath = require('path').join(__dirname, 'cache');\n\n// Initialize the download cache.\nvar cache = new Cache(basePath, {\n\n  // Allow up to 2 parallel downloads.\n  concurrency: 2\n\n});\n\n// Download a web page and print some info.\n\ncache.fetch('http://www.google.com/').then(function(result) {\n\n  console.log('Remote address:   ' + result.address.url);\n  console.log('Local cache path: ' + result.address.path);\n  console.log('HTTP status code: ' + result.status + ' ' + result.message);\n\n  console.log('Headers:');\n  console.log(result.headers);\n\n  console.log('Content:');\n  result.stream.pipe(process.stdout);\n\n});\n```\n\nRunning it the first time prints and saves the downloaded file and its headers including any redirects\nin local files, for example:\n\n- `cache/www.google.com.header.json`\n- `cache/www.google.\u003cCOUNTRY\u003e/\u003cNONCE\u003e`\n- `cache/www.google.\u003cCOUNTRY\u003e/\u003cNONCE\u003e.header.json`\n\nThe second time it prints the exact same output, but without needing a network connection.\n\nCaching arbitrary files\n-----------------------\n\nThe `store` method supports caching a string with any URI (URL or URN) as the key:\n\n```JavaScript\nvar cache = new (require('cget').Cache)();\n\ncache.store('urn:x-inspire:specification:gmlas:GeographicalNames:3.0', 'Some data');\n\ncache.store('http://inspire.ec.europa.eu/schemas/ad/4.0', 'More data');\n```\n\nLicense\n=======\n\n[The MIT License](https://raw.githubusercontent.com/charto/cget/master/LICENSE)\n\nCopyright (c) 2015-2017 BusFaster Ltd\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fcharto%2Fcget","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fcharto%2Fcget","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fcharto%2Fcget/lists"}