Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

https://github.com/mithril-security/blindai

Confidential AI deployment with secure enclaves :lock:
https://github.com/mithril-security/blindai

ai confidential-computing enclave inference intel-sgx machine-learning onnx privacy python3 rust sgx

Last synced: about 23 hours ago
JSON representation

Confidential AI deployment with secure enclaves :lock:

Host: GitHub
URL: https://github.com/mithril-security/blindai
Owner: mithril-security
License: apache-2.0
Created: 2022-02-06T14:07:35.000Z (over 2 years ago)
Default Branch: main
Last Pushed: 2024-03-19T15:35:39.000Z (3 months ago)
Last Synced: 2024-05-17T04:04:46.244Z (30 days ago)
Topics: ai, confidential-computing, enclave, inference, intel-sgx, machine-learning, onnx, privacy, python3, rust, sgx
Language: Rust
Homepage: https://www.mithrilsecurity.io/
Size: 43.8 MB
Stars: 490
Watchers: 12
Forks: 35
Open Issues: 4
Metadata Files:
- Readme: README.md
- License: LICENSE.md

Lists

Awesome-SGX-Open-Source - https://github.com/mithril-security/blindai
awesome-stars - mithril-security/blindai - Confidential AI deployment with secure enclaves :lock: (Rust)

README

        

[![Contributors][contributors-shield]][contributors-url]

[![Forks][forks-shield]][forks-url]

[![Stargazers][stars-shield]][stars-url]

[![Issues][issues-shield]][issues-url]

[![Apache License][license-shield]][license-url]






  

    

  

BlindAI


[![Website][website-shield]][website-url]

[![Blog][blog-shield]][blog-url]

[![LinkedIn][linkedin-shield]][linkedin-url]

> :warning: **Warning**: Unfortunately, BlindAI is not actively maintained at the moment. Thus, **you should not use BlindAI for processing sensitive data**. If you have a use case that involves confidential data and are interested in using BlindAI, please **contact us** to discuss potential support and collaboration.

> 

  


    BlindAI is an AI privacy solution, allowing users to query popular AI models or serve their own models whilst ensuring that users' data remains private every step of the way.

	



    Explore the docs »

    


    


    Try Demo

    ·

    Report Bug

    ·

    Request Feature

  



  Table of Contents

  


    

      About The Project

      

        Built With

      

    

    

      Getting Started

      

        BlindAI API

        BlindAI Core

      

    

    Usage

    Getting Help

    License

    Contact

  


## 🔒 About The Project

**BlindAI** is an **open-source solution** to query and deploy AI models while **guaranteeing data privacy**. The querying of models is done via our **easy-to-use Python library**.

Data sent by users to the AI model is kept **confidential at all times** by hardware-enforced **Trusted Execution Environments**. We explain how they keep data and models safe in detail [here](https://blindai.mithrilsecurity.io/en/latest/docs/getting-started/confidential_computing/).

There are two main scenarios for BlindAI:

- **BlindAI API**: Using BlindAI to query popular AI models hosted by Mithril Security.

- **BlindAI Core**: Using BlindAI's underlying technology to host your own BlindAI server instance to securely deploy your own models.

You can find our more about BlindAI API and BlindAI Core [here](https://blindai.mithrilsecurity.io/en/latest/docs/getting-started/blindai_structure/).

### Built With 

[![Rust][Rust]][Rust-url] [![Python][Python]][Python-url] [![Intel-SGX][Intel-SGX]][Intel-sgx-url] [![Tract][Tract]][tract-url]

(back to top)


## 🚀 Getting Started

We strongly recommend for you to get started with our [Quick tour](https://blindai.mithrilsecurity.io/en/latest/docs/getting-started/quick-tour/) to discover BlindAI with the open-source model Whisper.

But here’s a taste of what using BlindAI could look like 🍒

### BlindAI API

```py

transcript = blindai.api.Audio.transcribe(

    file="patient_104678.wav"

)

print(transcript)

The patient is a 55-year old male with known coronary artery disease.

```

### BlindAI.Core

#### AI company's side: uploading and deleting models

An AI company AI company want to provide their model as an an easy-to-use service. They upload it to the server, which is assigned a model ID.

```py

response = client_1.upload_model(model="./COVID-Net-CXR-2.onnx")

MODEL_ID = response.model_id

print(MODEL_ID)

8afcdab8-209e-4b93-9403-f3ea2dc0c3ae

```

When collaborating with clients is done, the AI company can delete their model from the server.

```py

# AI company deletes model after use

client_1.delete_model(MODEL_ID)

```

#### Client's side: running a model on confidential data

The client wants to feed their confidential data to the model while protecting it from third-party access. They connect and run the model on the following confidential image.

![](https://github.com/mithril-security/blindai/blob/main/docs/assets/positive_image.png)

```py

pos_ret = client_2.run_model(MODEL_ID, positive)

print("Probability of Covid for positive image is", pos_ret.output[0].as_flat()[0][1])

Probability of Covid for positive image is 0.890598714351654

```

_For more examples, please refer to the [Documentation](https://blindai.mithrilsecurity.io/en/latest/)_

(back to top)


## 🙋 Getting help

* Go to our [Discord](https://discord.com/invite/TxEHagpWd4) #support channel

* Report bugs by [opening an issue on our BlindAI GitHub](https://github.com/mithril-security/blindai/issues)

* [Book a meeting](https://calendly.com/contact-mithril-security/15mins?month=2023-03) with us

## 📜 License

Distributed under the Apache License, version 2.0. See [`LICENSE.md`](https://www.apache.org/licenses/LICENSE-2.0) for more information.

## 📇 Contact

Mithril Security - [@MithrilSecurity](https://twitter.com/MithrilSecurity) - [email protected]

Project Link: [https://github.com/mithril-security/blindai](https://github.com/mithril-security/blindai)

(back to top)


[contributors-shield]: https://img.shields.io/github/contributors/mithril-security/blindai.svg?style=for-the-badge

[contributors-url]: https://github.com/mithril-security/blindai/graphs/contributors

[forks-shield]: https://img.shields.io/github/forks/mithril-security/blindai.svg?style=for-the-badge

[forks-url]: https://github.com/mithril-security/blindai/network/members

[stars-shield]: https://img.shields.io/github/stars/mithril-security/blindai.svg?style=for-the-badge

[stars-url]: https://github.com/mithril-security/blindai/stargazers

[issues-shield]: https://img.shields.io/github/issues/mithril-security/blindai.svg?style=for-the-badge

[issues-url]: https://github.com/mithril-security/blindai/issues

[license-shield]: https://img.shields.io/github/license/mithril-security/blindai.svg?style=for-the-badge

[license-url]: https://github.com/mithril-security/blindai/blob/master/LICENSE.md

[linkedin-shield]: https://img.shields.io/badge/LinkedIn-0077B5?style=for-the-badge&logo=linkedin&logoColor=white&colorB=555

[linkedin-url]: https://www.linkedin.com/company/mithril-security-company/

[website-url]: https://www.mithrilsecurity.io

[website-shield]: https://img.shields.io/badge/website-000000?style=for-the-badge&colorB=555

[blog-url]: https://blog.mithrilsecurity.io/

[blog-shield]: https://img.shields.io/badge/Blog-000?style=for-the-badge&logo=ghost&logoColor=yellow&colorB=555

[product-screenshot]: images/screenshot.png

[Python]: https://img.shields.io/badge/Python-FFD43B?style=for-the-badge&logo=python&logoColor=blue

[Python-url]: https://www.python.org/

[Rust]: https://img.shields.io/badge/rust-FFD43B?style=for-the-badge&logo=rust&logoColor=black

[Rust-url]: https://www.rust-lang.org/fr

[Intel-SGX]: https://img.shields.io/badge/SGX-FFD43B?style=for-the-badge&logo=intel&logoColor=black

[Intel-sgx-url]: https://www.intel.fr/content/www/fr/fr/architecture-and-technology/software-guard-extensions.html

[Tract]: https://img.shields.io/badge/Tract-FFD43B?style=for-the-badge

[tract-url]: https://github.com/mithril-security/tract/tree/6e4620659837eebeaba40ab3eeda67d33a99c7cf