An open API service indexing awesome lists of open source software.

https://github.com/scribd/brutus

Brute-force in-memory vector search
https://github.com/scribd/brutus

Last synced: 1 day ago
JSON representation

Brute-force in-memory vector search

Awesome Lists containing this project

README

          

ifdef::env-github[]
:tip-caption: :bulb:
:note-caption: :information_source:
:important-caption: :heavy_exclamation_mark:
:caution-caption: :fire:
:warning-caption: :warning:
endif::[]
:toc: macro

= Brutus

An API for performing brute force vector search backed by pre-computed data in
S3.

toc::[]

== Development

This project uses Rust, so builds and tests can be done with:

* `cargo build`
* `cargo test`
* _etc_

Optionally for hot-reloading of the service during development:

[source,bash]
----
cargo install cargo-watch catflap
----

=== Testing against localstack

[source,bash]
----
cargo test --feature integration
----

To run the hot-reloading webserver:

[source,bash]
----
./scripts/live-reload
----

You can then open link:http://localhost:5000[localhost:5000]

=== Data file schema

chunk_id:long
chunk_text:string
chunk_embedding:array
element:float
page:integer
doc_id:long
chunk_sequence:integer