https://github.com/willscott/oonimap
grab slices of ooni data
https://github.com/willscott/oonimap
Last synced: 4 months ago
JSON representation
grab slices of ooni data
- Host: GitHub
- URL: https://github.com/willscott/oonimap
- Owner: willscott
- Created: 2018-02-16T17:42:22.000Z (over 8 years ago)
- Default Branch: master
- Last Pushed: 2023-04-20T15:07:00.000Z (about 3 years ago)
- Last Synced: 2025-07-13T07:41:39.627Z (11 months ago)
- Language: JavaScript
- Size: 19.5 KB
- Stars: 1
- Watchers: 2
- Forks: 0
- Open Issues: 2
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
OONI Map
========
A downloader for all measurements meeting a specific citeria in the OONI database.
Installation
-----
API Usage
=========
OONIMap presents a stream interface to queries against the OONI data. A
basic example looks like:
```node
var oonimap = require('oonimap');
oonimap("www.google.com", null, function (record) {
if (record.probe_cc == "US" && record.probe_asn != null && record.test_keys.accessible !== true) {
return [record.test_start_time, record.probe_asn];
}
}).on('data', function(result) {
console.log(result);
});
```
CMD Line Usage
======
Single File
----
```
node uncan.js measurement.lz4 google.com
```
will print all JSON records within measurement.lz4 matching the selector (google.com).
Relevant Environmental Variables:
`TMPDIR` is used for extraction of .lz4 files. If the default temporary directory
is not memory backed, consider making a `tmp` filesystem that is used.
Full corpus
------
```
node corpus.js s3-sync/ domains.txt output.txt
```
Takes in the s3 buckets of OONI data, a list of selectors on input (either return separated, JSON encoded array),
and a file where matching / transformed records are output to.