https://github.com/alimpfard/nlp-lex
Hopefully a lexer-generator that doesn't fucking suck
https://github.com/alimpfard/nlp-lex
hmm-viterbi-algorithm lexer-generator nlp-tool regex-engine
Last synced: 8 months ago
JSON representation
Hopefully a lexer-generator that doesn't fucking suck
- Host: GitHub
- URL: https://github.com/alimpfard/nlp-lex
- Owner: alimpfard
- Created: 2019-10-03T15:45:38.000Z (over 6 years ago)
- Default Branch: master
- Last Pushed: 2022-12-12T13:55:49.000Z (about 3 years ago)
- Last Synced: 2025-04-23T05:47:02.439Z (9 months ago)
- Topics: hmm-viterbi-algorithm, lexer-generator, nlp-tool, regex-engine
- Language: JavaScript
- Size: 3.61 MB
- Stars: 9
- Watchers: 1
- Forks: 0
- Open Issues: 5
-
Metadata Files:
- Readme: README-cominsys.md
Awesome Lists containing this project
README
# Steps to use
## Step 0 - build compiler
Refer to main readme
## Step 1 - compile source to library
`build/nlex --output tokeniser.obj --library --target-sys windows --object-format coff --target-arch x86_64 ../examples/test.nlex`
## Step 2.1 - build a dll
`link /dll /def:tokeniser.def tokeniser.obj`
## Step 2.2 - compile against the C wrapper
`cd ../wrapper/c`
`cc wrapper.c ../src/tokeniser.obj`
And use `a.out`
### C wrapper options format
```
./a.out [options] -- input_files...
[OPTIONS]
--json : Enable json output
--output [output_file] : write json to given file
```