https://github.com/siyuan-note/sqlite-fts5-siyuan-tokenizer
SQLite FTS5 中文单字分词器。
https://github.com/siyuan-note/sqlite-fts5-siyuan-tokenizer
Last synced: 7 days ago
JSON representation
SQLite FTS5 中文单字分词器。
- Host: GitHub
- URL: https://github.com/siyuan-note/sqlite-fts5-siyuan-tokenizer
- Owner: siyuan-note
- License: mit
- Created: 2022-04-11T14:32:36.000Z (about 3 years ago)
- Default Branch: main
- Last Pushed: 2022-04-11T14:40:10.000Z (about 3 years ago)
- Last Synced: 2024-11-10T19:43:51.731Z (8 months ago)
- Language: C
- Size: 2.17 MB
- Stars: 8
- Watchers: 3
- Forks: 4
- Open Issues: 1
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
# sqlite-fts5-siyuan-tokenizer
SQLite FTS5 中文单字分词器。
感谢 [CChan](https://ld246.com/member/CChan) 贡献。
https://ld246.com/article/1641042386027
## 共享库编译
* Linux `gcc -fPIC -lm -shared siyuan.c -o siyuan-tokenizer.so`
* macOS `gcc -fno-common -dynamiclib siyuan.c -o siyuan-tokenizer.dylib`
* Windows `gcc -shared -I "sqlite3ext.h" -o siyuan-tokenizer.so siyuan.c`
## 静态编译
https://github.com/88250/go-sqlite3