Data

Tools

Indexes

Applications

Experiments

Awesome

An open API service indexing awesome lists of open source software.

https://github.com/meilisearch/engine-team

Repository gathering the development process of the core-team
https://github.com/meilisearch/engine-team

Last synced: 7 months ago
JSON representation

Repository gathering the development process of the core-team

Awesome Lists containing this project

README 

          


  Meilisearch logo




Meilisearch Engine Team


This repository is the central reference for developing and maintaining the engine team repositories.





  Meilisearch |

  Documentation |

  Discord |

  Website |

  Blog |

  LinkedIn |

  Twitter |

  FAQ




The engine team owns all the following repositories:



Main ones used to build Meilisearch:



- [**Meilisearch**](https://github.com/meilisearch/meilisearch): the main Engine team repository containing the search engine.

- [**Charabia**](https://github.com/meilisearch/charabia/): the tokenizer used by the search engine (in Meilisearch and in Milli).

- [**Grenad**](https://github.com/meilisearch/grenad): tools to sort, merge, write, and read immutable key-value pairs.

- [**Heed**](https://github.com/meilisearch/heed): a fully typed LMDB/MDBX wrapper with minimum overhead, uses bytemuck internally.

- [**lmdb-rs**](https://github.com/meilisearch/lmdb-rs/): a fork of [mozilla/lmdb-rs](https://github.com/mozilla/lmdb-rs).

- [**lmdb**](https://github.com/meilisearch/lmdb): a fork of [LMDB/lmdb](https://github.com/LMDB/lmdb).

- [**Segment**](https://github.com/meilisearch/segment): an unofficial segment analytics client for Rust used by Meilisearch.

- [**Deserr**](https://github.com/meilisearch/deserr/): a crate for deserializing data, with the ability to return custom, type-specific errors upon failure

- [**Arroy**](https://github.com/meilisearch/arroy): search for vectors in space that are close to a given query vector, with the interface of [Annoy](https://github.com/spotify/annoy/#full-python-api).

- [**Obkv**](https://github.com/meilisearch/obkv): a micro key-value store where the key is always one byte.

- [**Bumparaw-collections**](https://github.com/meilisearch/bumparaw-collections): Collections backed by `bumpalo` and `serde_json::value::RawValue`

- [**Bbqueue**](https://github.com/meilisearch/bbqueue): A SPSC, lockless, no_std, thread safe, queue, based on BipBuffers



For testing:



- [**cargo-flaky**](https://github.com/meilisearch/cargo-flaky): cargo extension to help you find flaky tests in you test suite. Used in the [Meilisearch CI](https://github.com/meilisearch/meilisearch/actions/workflows/flaky.yml) every week.

- [**Yaup**](https://github.com/meilisearch/yaup/): a fork of [`serde_url_params`](https://github.com/boxdot/serde-url-params-rs) for `GET /search` tests.



Misc:



- [**Bench board**](https://github.com/meilisearch/benchboard): benchmark dashboard that displays results of benchmark runs and allow to compare results across commits and workloads.

- [**external-benchmarks**](https://github.com/meilisearch/external-benchmarks) (private only): benchmarks applied on concrete usecase to measure the impact of the engine team.

- [**Madness**](https://github.com/meilisearch/madness): library for mDNS service discovery and advertisement. Not used by Meilisearch currently.

- [**segseg**](https://github.com/meilisearch/segseg): a POC of a segment based search engine

- [**Mainspector**](https://github.com/meilisearch/mainspector): same as Devspector but on the [`main` branch](https://github.com/meilisearch/specifications). Visit [this website](https://specs.meilisearch.com/).

- [**Strois**](https://github.com/meilisearch/strois): an S3 synchronous SDK based on rusty_s3 and ureq.

- [**Open API**](https://github.com/meilisearch/open-api): a repository containing the OpenAPI file related to Meilisearch API.

- [**Meilisearch importer**](https://github.com/meilisearch/meilisearch-importer): a tool to easily import millions of documents into Meilisearch.

- [**vector-store-relevancy-benchmark**](https://github.com/meilisearch/vector-store-relevancy-benchmark): to test the relevancy of the hybrid search.

- [**Alberto**](https://github.com/meilisearch/alberto): A program that displays the size of the documents in a Meilisearch database.



Archived repositories:



- [**Milli**](https://github.com/meilisearch/milli): the new search engine in development.

- [**Jayson**](https://github.com/meilisearch/jayson): heavily modified version of [miniserde](https://github.com/dtolnay/miniserde), with only the deserialization part.

- [**Transplant**](https://github.com/meilisearch/transplant): the temporary repository that integrates Milli as search engine. The final goal of Transplant code base is to be integrated into the MeiliSearch repository and will correspond to the v0.21.0 release.

- Raft work that has been archived

  - [**Meilipod**](https://github.com/meilisearch/meilipod) (private only)

  - [**Raft**](https://github.com/meilisearch/raft) (private only)

  - [**raft-metrics**](https://github.com/meilisearch/raft-metrics) (private only)

- [**Nelson**](https://github.com/meilisearch/nelson/): small mocking library for Rust. Used in the past in the Meilisearch test suite.

- [**meili-aoc**](https://github.com/meilisearch/meili-aoc) (internal): Advent of Code repository

- [**Devspector**](https://github.com/meilisearch/devspector): website using Meilisearch to search into the specification repository, on the [`develop` branch](https://github.com/meilisearch/specifications/tree/develop). Visit [this website](https://specs.meilisearch.dev/).



# TOC



- [Resources](./resources)

- [Release changelogs](./meilisearch-release-changelog)

- [Issue templates](./issue-templates)