Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/mithril-security/blindai-preview
Blindai Preview (no longer used, merged with the main repo blindai)
https://github.com/mithril-security/blindai-preview
Last synced: about 2 months ago
JSON representation
Blindai Preview (no longer used, merged with the main repo blindai)
- Host: GitHub
- URL: https://github.com/mithril-security/blindai-preview
- Owner: mithril-security
- License: apache-2.0
- Archived: true
- Created: 2023-01-16T15:41:47.000Z (over 1 year ago)
- Default Branch: main
- Last Pushed: 2023-03-26T18:15:34.000Z (over 1 year ago)
- Last Synced: 2024-07-28T17:39:17.402Z (about 2 months ago)
- Language: Rust
- Homepage:
- Size: 5.43 MB
- Stars: 24
- Watchers: 2
- Forks: 0
- Open Issues: 2
-
Metadata Files:
- Readme: README.md
- License: LICENSE.md
Awesome Lists containing this project
README
[![Contributors][contributors-shield]][contributors-url]
[![Forks][forks-shield]][forks-url]
[![Stargazers][stars-shield]][stars-url]
[![Issues][issues-shield]][issues-url]
[![Apache License][license-shield]][license-url]
BlindAI
[![Website][website-shield]][website-url]
[![Blog][blog-shield]][blog-url]
[![LinkedIn][linkedin-shield]][linkedin-url]
BlindAI is an AI inference server with an added privacy layer, protecting the data sent to models.
Explore the docs Β»
Try Demo
Β·
Report Bug
Β·
Request Feature
Table of Contents
## π About The Project
BlindAI facilitates **privacy-friendly AI model deployment** by letting AI engineers upload and delete models to their secure server instance using our **Python API**. Clients can then connect to the server, upload their data and run models on it without compromising on privacy.
Data sent by users to the AI model is kept **confidential at all times**. Neither the AI service provider nor the Cloud provider (if applicable), can see the data.
Confidentiality is assured by hardware-enforced **Trusted Execution Environments**. We explain how they keep data and models safe in detail [here](./docs/docs/concepts/privacy.md).
### Built With
[![Rust][Rust]][Rust-url] [![Python][Python]][Python-url] [![Intel-SGX][Intel-SGX]][Intel-sgx-url] [![Tract][Tract]][tract-url]
## π Getting Started
We strongly recommend for you to get started with our [Quick tour](./docs/docs/getting-started/quick-tour.ipynb) to discover BlindAI with a hands-on example using [COVID-Net](https://github.com/lindawangg/COVID-Net).
But hereβs a taste of what using BlindAI could look like π
### AI company's side
#### Uploading and deleting models
An AI company AI company want to provide their model as an an easy-to-use service. They upload it to the server, which is assigned a model ID.
```py
response = client_1.upload_model(model="./COVID-Net-CXR-2.onnx")
MODEL_ID = response.model_id
print(MODEL_ID)8afcdab8-209e-4b93-9403-f3ea2dc0c3ae
```When collaborating with clients is done, the AI company can delete their model from the server.
```py
# AI company deletes model after use
client_1.delete_model(MODEL_ID)
```### Client's side
#### Running a model on confidential data
The client wants to feed their confidential data to the model while protecting it from third-party access. They connect and run the model on the following confidential image.
![](./docs/assets/positive_image.png)
```py
pos_ret = client_2.run_model(MODEL_ID, positive)
print("Probability of Covid for positive image is", pos_ret.output[0].as_flat()[0][1])Probability of Covid for positive image is 0.890598714351654
```_For more examples, please refer to the [Documentation](https://blindai.mithrilsecurity.io/en/latest/)_
### Installation
**π₯ Recommended π₯**
#### Deploying BlindAI on Azure DCsv3 VM
+ β No requirement to have your own Intel SGX-ready device or a particular distribution.
+ β Secure. Hardware security guarantees protect your data and model from any third-party access.
+ β Can be more expensive than local deployment.You can deploy the server in your Azure DCsv3 VM using our docker image with the following command:
```bash
docker run -it -e BLINDAI_AZURE_DCS3_PATCH=1 -p 9923:9923 -p 9924:9924 \
--device /dev/sgx/enclave --device /dev/sgx/provision \
-v /var/run/aesmd/aesm.socket:/var/run/aesmd/aesm.socket \
mithrilsecuritysas/blindai-preview-server:latest /root/start.sh
```For alternative deployment methods (*on-premise, testing only...*) or more information, visit [our installation guide](https://github.com/mithril-security/blindai-preview/blob/main/docs/docs/getting-started/installation.md).
## π Getting help
* Go to our [Discord](https://discord.com/invite/TxEHagpWd4) #support channel
* Report bugs by [opening an issue on our BlindAI GitHub](https://github.com/mithril-security/blindai/issues)
* [Book a meeting](https://calendly.com/contact-mithril-security/15mins?month=2023-03) with us## π License
Distributed under the Apache License, version 2.0. See [`LICENSE.md`](https://www.apache.org/licenses/LICENSE-2.0) for more information.
## π Contact
Mithril Security - [@MithrilSecurity](https://twitter.com/MithrilSecurity) - [email protected]
Project Link: [https://github.com/mithril-security/blindai-preview](https://github.com/mithril-security/blindai-preview)
[contributors-shield]: https://img.shields.io/github/contributors/mithril-security/blindai.svg?style=for-the-badge
[contributors-url]: https://github.com/mithril-security/blindai/graphs/contributors
[forks-shield]: https://img.shields.io/github/forks/mithril-security/blindai.svg?style=for-the-badge
[forks-url]: https://github.com/mithril-security/blindai/network/members
[stars-shield]: https://img.shields.io/github/stars/mithril-security/blindai.svg?style=for-the-badge
[stars-url]: https://github.com/mithril-security/blindai/stargazers
[issues-shield]: https://img.shields.io/github/issues/mithril-security/blindai.svg?style=for-the-badge
[issues-url]: https://github.com/mithril-security/blindai/issues
[license-shield]: https://img.shields.io/github/license/mithril-security/blindai.svg?style=for-the-badge
[license-url]: https://github.com/mithril-security/blindai/blob/master/LICENSE.txt
[linkedin-shield]: https://img.shields.io/badge/-Jobs-black.svg?style=for-the-badge&logo=linkedin&colorB=555
[linkedin-url]: https://www.linkedin.com/company/mithril-security-company/
[website-url]: https://www.mithrilsecurity.io
[website-shield]: https://img.shields.io/badge/website-000000?style=for-the-badge&colorB=555
[blog-url]: https://blog.mithrilsecurity.io/
[blog-shield]: https://img.shields.io/badge/Blog-000?style=for-the-badge&logo=ghost&logoColor=yellow&colorB=555
[product-screenshot]: images/screenshot.png
[Python]: https://img.shields.io/badge/Python-FFD43B?style=for-the-badge&logo=python&logoColor=blue
[Python-url]: https://www.python.org/
[Rust]: https://img.shields.io/badge/rust-FFD43B?style=for-the-badge&logo=rust&logoColor=black
[Rust-url]: https://www.rust-lang.org/fr
[Intel-SGX]: https://img.shields.io/badge/SGX-FFD43B?style=for-the-badge&logo=intel&logoColor=black
[Intel-sgx-url]: https://www.intel.fr/content/www/fr/fr/architecture-and-technology/software-guard-extensions.html
[Tract]: https://img.shields.io/badge/Tract-FFD43B?style=for-the-badge
[tract-url]: https://github.com/mithril-security/tract/tree/6e4620659837eebeaba40ab3eeda67d33a99c7cf