https://github.com/ggerganov/ggwords
Generate language n-gram statistics
https://github.com/ggerganov/ggwords
language ngrams statistics
Last synced: about 1 month ago
JSON representation
Generate language n-gram statistics
- Host: GitHub
- URL: https://github.com/ggerganov/ggwords
- Owner: ggerganov
- License: gpl-3.0
- Created: 2022-03-28T17:32:28.000Z (over 3 years ago)
- Default Branch: master
- Last Pushed: 2022-04-11T17:39:52.000Z (over 3 years ago)
- Last Synced: 2024-10-03T13:52:06.971Z (about 1 year ago)
- Topics: language, ngrams, statistics
- Language: C++
- Homepage:
- Size: 44.2 MB
- Stars: 17
- Watchers: 4
- Forks: 1
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
# ggwords
Generate n-gram statistics by processing the contents of English books/texts.
## Usage
```bash
git clone https://github.com/ggerganov/ggwords
cd ggwords
mkdir build
cd build
cmake ..
make -j4
./bin/analyze /path/to/metadata/books.txt /path/to/books/text
```
## Sample data
The data in [./data](./data) was generated using https://github.com/pgcorpus/gutenberg