{"id":15451788,"url":"https://github.com/willscott/oonimap","last_synced_at":"2026-02-10T04:31:24.942Z","repository":{"id":30176842,"uuid":"121780895","full_name":"willscott/oonimap","owner":"willscott","description":"grab slices of ooni data","archived":false,"fork":false,"pushed_at":"2023-04-20T15:07:00.000Z","size":20,"stargazers_count":1,"open_issues_count":2,"forks_count":0,"subscribers_count":2,"default_branch":"master","last_synced_at":"2025-07-13T07:41:39.627Z","etag":null,"topics":[],"latest_commit_sha":null,"homepage":null,"language":"JavaScript","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/willscott.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2018-02-16T17:42:22.000Z","updated_at":"2021-01-05T22:29:59.000Z","dependencies_parsed_at":"2024-10-25T03:10:11.077Z","dependency_job_id":"6b68fcd2-8d46-46b5-a7e8-da5571a861bb","html_url":"https://github.com/willscott/oonimap","commit_stats":{"total_commits":7,"total_committers":2,"mean_commits":3.5,"dds":0.1428571428571429,"last_synced_commit":"93865d4785a529e06ce2ba45371eb0d6b9ad68e3"},"previous_names":[],"tags_count":1,"template":false,"template_full_name":null,"purl":"pkg:github/willscott/oonimap","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/willscott%2Foonimap","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/willscott%2Foonimap/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/willscott%2Foonimap/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/willscott%2Foonimap/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/willscott","download_url":"https://codeload.github.com/willscott/oonimap/tar.gz/refs/heads/master","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/willscott%2Foonimap/sbom","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":268423882,"owners_count":24248112,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","status":"online","status_checked_at":"2025-08-02T02:00:12.353Z","response_time":74,"last_error":null,"robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":true,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":[],"created_at":"2024-10-01T21:39:18.596Z","updated_at":"2026-02-10T04:31:19.912Z","avatar_url":"https://github.com/willscott.png","language":"JavaScript","funding_links":[],"categories":[],"sub_categories":[],"readme":"OONI Map\n========\n\nA downloader for all measurements meeting a specific citeria in the OONI database.\n\nInstallation\n-----\n\nAPI Usage\n=========\nOONIMap presents a stream interface to queries against the OONI data. A\nbasic example looks like:\n\n```node\n\nvar oonimap = require('oonimap');\noonimap(\"www.google.com\", null, function (record) {\n  if (record.probe_cc == \"US\" \u0026\u0026 record.probe_asn != null \u0026\u0026 record.test_keys.accessible !== true) {\n    return [record.test_start_time, record.probe_asn];\n  }\n}).on('data', function(result) {\n  console.log(result);\n});\n\n```\n\nCMD Line Usage\n======\n\nSingle File\n----\n\n```\nnode uncan.js measurement.lz4 google.com\n```\n\nwill print all JSON records within measurement.lz4 matching the selector (google.com).\n\nRelevant Environmental Variables:\n`TMPDIR` is used for extraction of .lz4 files. If the default temporary directory\nis not memory backed, consider making a `tmp` filesystem that is used.\n\nFull corpus\n------\n\n```\nnode corpus.js s3-sync/ domains.txt output.txt\n```\n\nTakes in the s3 buckets of OONI data, a list of selectors on input (either return separated, JSON encoded array),\nand a file where matching / transformed records are output to. \n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fwillscott%2Foonimap","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fwillscott%2Foonimap","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fwillscott%2Foonimap/lists"}