Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/hengfeiyang/bluge-demo
Demo for bluge
https://github.com/hengfeiyang/bluge-demo
Last synced: about 2 months ago
JSON representation
Demo for bluge
- Host: GitHub
- URL: https://github.com/hengfeiyang/bluge-demo
- Owner: hengfeiyang
- License: mit
- Created: 2022-12-26T09:52:23.000Z (about 2 years ago)
- Default Branch: main
- Last Pushed: 2022-12-26T10:42:44.000Z (about 2 years ago)
- Last Synced: 2024-06-21T17:54:40.680Z (6 months ago)
- Language: Go
- Size: 8.79 KB
- Stars: 0
- Watchers: 1
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
# bluge-demo
Demo for bluge
```
go run main.go
2022/12/26 18:35:14 indexed 0 documents
2022/12/26 18:35:28 indexed 1000 documents
2022/12/26 18:35:42 indexed 2000 documents
2022/12/26 18:35:57 indexed 3000 documents
2022/12/26 18:36:13 indexed 4000 documents
2022/12/26 18:36:28 indexed 5000 documents
2022/12/26 18:36:42 indexed 6000 documents
2022/12/26 18:36:56 indexed 7000 documents
2022/12/26 18:37:11 indexed 8000 documents
2022/12/26 18:37:26 indexed 9000 documents
2022/12/26 18:37:43 took 5 ms, found 10000 documents
2022/12/26 18:37:43 map[@timestamp:2022-12-26 10:35:14.029792 +0000 UTC _id:0 email:[email protected] gender:male name:John Doe phone:1234567890]
2022/12/26 18:37:43 map[@timestamp:2022-12-26 10:35:14.142486 +0000 UTC _id:1 email:[email protected] gender:male name:John Doe phone:1234567890]
2022/12/26 18:37:43 map[@timestamp:2022-12-26 10:35:14.154815 +0000 UTC _id:2 email:[email protected] gender:male name:John Doe phone:1234567890]
2022/12/26 18:37:43 map[@timestamp:2022-12-26 10:35:14.173795 +0000 UTC _id:3 email:[email protected] gender:male name:John Doe phone:1234567890]
2022/12/26 18:37:43 map[@timestamp:2022-12-26 10:35:14.195195 +0000 UTC _id:4 email:[email protected] gender:male name:John Doe phone:1234567890]
2022/12/26 18:37:43 map[@timestamp:2022-12-26 10:35:14.220206 +0000 UTC _id:5 email:[email protected] gender:male name:John Doe phone:1234567890]
2022/12/26 18:37:43 map[@timestamp:2022-12-26 10:35:14.242228 +0000 UTC _id:6 email:[email protected] gender:male name:John Doe phone:1234567890]
2022/12/26 18:37:43 map[@timestamp:2022-12-26 10:35:14.263687 +0000 UTC _id:7 email:[email protected] gender:male name:John Doe phone:1234567890]
2022/12/26 18:37:43 map[@timestamp:2022-12-26 10:35:14.276628 +0000 UTC _id:8 email:[email protected] gender:male name:John Doe phone:1234567890]
2022/12/26 18:37:43 map[@timestamp:2022-12-26 10:35:14.297706 +0000 UTC _id:9 email:[email protected] gender:male name:John Doe phone:1234567890]
```
```
ll data/index_dir
total 9536
-rw------- 1 yanghengfei staff 292K Dec 26 18:35 000000000487.seg
-rw------- 1 yanghengfei staff 15K Dec 26 18:35 000000000a3a.seg
-rw------- 1 yanghengfei staff 646K Dec 26 18:35 000000000a3c.seg
-rw------- 1 yanghengfei staff 46K Dec 26 18:36 00000000131b.seg
-rw------- 1 yanghengfei staff 31K Dec 26 18:36 00000000155a.seg
-rw------- 1 yanghengfei staff 2.1M Dec 26 18:36 000000001fdd.seg
-rw------- 1 yanghengfei staff 1.2M Dec 26 18:37 0000000030f6.seg
-rw------- 1 yanghengfei staff 330K Dec 26 18:37 000000003562.seg
-rw------- 1 yanghengfei staff 1.7K Dec 26 18:37 000000003563.seg
-rw------- 1 yanghengfei staff 1.8K Dec 26 18:37 000000003564.seg
-rw------- 1 yanghengfei staff 1.7K Dec 26 18:37 000000003565.seg
-rw------- 1 yanghengfei staff 1.7K Dec 26 18:37 000000003566.seg
-rw------- 1 yanghengfei staff 307B Dec 26 18:37 000000005c75.snp
```
Tips
> 1. if you not sleep for merge, quickly quit after write data, it maybe many seg files. because it has no time to do merge.
> 2. it will has hundreds seg files when it writing.
> 3. if you want reduce files during writing, just use batch. like: 1000 documents one batch, it will just create 10 files for 10,000 documents.