https://github.com/vweevers/about-native-addons
Collects data on all Node.js native addons found in the npm registry.
https://github.com/vweevers/about-native-addons
addons native-addons nodejs wip
Last synced: 10 months ago
JSON representation
Collects data on all Node.js native addons found in the npm registry.
- Host: GitHub
- URL: https://github.com/vweevers/about-native-addons
- Owner: vweevers
- License: mit
- Created: 2019-10-27T09:59:10.000Z (over 6 years ago)
- Default Branch: main
- Last Pushed: 2022-02-06T11:56:18.000Z (over 4 years ago)
- Last Synced: 2025-08-19T21:56:31.684Z (10 months ago)
- Topics: addons, native-addons, nodejs, wip
- Language: JavaScript
- Homepage:
- Size: 204 KB
- Stars: 6
- Watchers: 2
- Forks: 2
- Open Issues: 3
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
# about-native-addons
**Collects data on all Node.js native addons found in the npm registry.**
## Data
See [`data.md`](data.md).
## Development
To generate the above data, clone the repository and run:
```
npm i
mkdir cache
# Collect packages from npm (takes between 2 and 24 hours)
mkdir cache/raw
node bin/collect-npm-data > cache/raw/raw-01.ndjson
# Deduplicate and clean
mkdir cache/deduped
node bin/dedupe-npm-data cache/raw > cache/deduped/deduped.ndjson
# Process the data (this also takes time; subsequent runs use caches)
node bin/process-npm-data cache/deduped
```
The result is written to `data.json` and `data.md`.
To update later, make note of the last seq (sequence number) that is written to stderr by `node bin/collect-npm-data`, for example 8257575. Then pull in new and updated packages starting from there:
```
node bin/collect-npm-data 8257575 > cache/raw/raw-02.ndjson
node bin/dedupe-npm-data cache/raw > cache/deduped/deduped.ndjson
node bin/process-npm-data cache/deduped
```
The dedupe step will read `cache/raw/*.ndjson` which means it'll include `raw-01.ndjson` and `raw-02.ndjson`.
## License
[MIT](LICENSE)