https://github.com/yhirose/cpp-searchlib
A C++17 full-text search engine library
https://github.com/yhirose/cpp-searchlib
cpp search-engine
Last synced: 11 months ago
JSON representation
A C++17 full-text search engine library
- Host: GitHub
- URL: https://github.com/yhirose/cpp-searchlib
- Owner: yhirose
- License: mit
- Created: 2020-02-24T17:55:49.000Z (about 6 years ago)
- Default Branch: master
- Last Pushed: 2021-10-18T02:47:41.000Z (over 4 years ago)
- Last Synced: 2025-04-18T09:34:33.399Z (11 months ago)
- Topics: cpp, search-engine
- Language: C++
- Homepage:
- Size: 3.09 MB
- Stars: 33
- Watchers: 3
- Forks: 7
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
# cpp-searchlib
C++17 full-text search engine library (WIP. Far from release...)
TODO:
- [ ] Save/load index to/from storage
- [ ] Posting list compression
- [ ] Search scope (document, section, paragraph)
```cpp
using namespace searchlib;
std::vector documents = {
"This is the first document.",
"This is the second document.",
"This is the third document. This is the second sentence in the third document.",
"This is not the first document."
};
// Indexing...
auto normalizer = [](auto str) { return unicode::to_lowercase(str); };
auto index = make_in_memory_index(normalizer, [&](auto &indexer) {
size_t document_id = 0;
for (const auto &doc : documents) {
indexer.index_document(document_id, UTF8PlainTextTokenizer(doc));
document_id++;
}
};
// Search...
auto expr = parse_query(*index, normalizer, R"( first not | "the second sentence" )");
auto result = perform_search(*index, *expr);
result->size(); // 2
result->document_id(0); // 2
result->search_hit_count(0); // 1
// 'the second sentence'
result->term_position(0, 1); // 7
result->term_length(0, 1); // 3
auto [pos, len] = index->text_range(*result, 0, 1); // 36, 19
result->document_id(1); // 3
result->search_hit_count(1); // 2
// 'not'
result->term_position(1, 0); // 2
result->term_length(1, 0); // 1
auto [pos, len] = index->text_range(*result, 1, 0); // 8, 3
// 'first'
result->term_position(1, 1); // 4
result->term_length(1, 1); // 1
auto [pos, len] = index->text_range(*result, 1, 1); // 16, 5
```