Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/cado-security/masked-ai
Masked Python SDK wrapper for OpenAI API. Use public LLM APIs securely.
https://github.com/cado-security/masked-ai
Last synced: about 1 month ago
JSON representation
Masked Python SDK wrapper for OpenAI API. Use public LLM APIs securely.
- Host: GitHub
- URL: https://github.com/cado-security/masked-ai
- Owner: cado-security
- License: apache-2.0
- Created: 2023-03-06T14:06:24.000Z (almost 2 years ago)
- Default Branch: main
- Last Pushed: 2023-03-30T13:25:13.000Z (over 1 year ago)
- Last Synced: 2024-10-01T15:38:36.051Z (2 months ago)
- Language: Python
- Size: 1.49 MB
- Stars: 111
- Watchers: 5
- Forks: 13
- Open Issues: 2
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
- awesome-privacy-engineering - Masked AI - Python SDK and CLI wrappers that enable safer usage of public large language models (LLMs) like OpenAI/GPT4 by removing sensitive data from prompts and replacing it with fake data before submitting to the OpenAI API. (Awesome Privacy Engineering [](https://awesome.re) / De-Identification and Anonymization)
README
# Masked-AI
[](https://badge.fury.io/py/masked-ai)
Masked-AI is a Python SDK and CLI wrappers that enable the usage of public LLM (Language Model) APIs such as OpenAI/GPT4 more securely.
It does this by:
1. Replacing sensitive data (for example e-mail addresses) with fake data in it's place
2. Sending the request to the API
3. Then replacing the sensitive data back into the output
The result is that you get the same output from the API, without having to send the sensitive data.
Note that we make no gurantees as to the completeness of the redaction - you remain responsible for any data you send out. For more, please see the the License.
### Flow:
## How to use
You can deploy Masked-AI straight from pip ("pip3 install masked-ai") or from our GitHub repo ("python3 setup.py install"). It can be used as both a python library or over the CLI.
### 1. Example 1: Simple `echo' command with Masked-AI:
### 2. Example 2: OpenAI Completion API cURL command + Masked-AI CLI tool:
```
./masker --debug --prompt "Hello, my name is Adam, say my name" curl https://api.openai.com/v1/completions -H "Content-Type: application/json" -H "Authorization: Bearer " -d '{"model": "text-davinci-003", "prompt": "{prompt_placeholder}"}'
```
Notes:
* Don't forget to change `` to your own OpenAI key
* Masked-AI will look for the string `{prompt_placeholder}` in the command, and will replace it with the masked `--prompt`.
Here is an example outout
**So, what is happening here?**
1. If we look at the output, the prompt that is actually being sent to the API (marked with blue) is `Hello, my name is , say my name`, Masked-AI replaces the name "Adam" with a placholder.
2. Then if we look at the raw return value from the cURL command (the important part is marked in red), we can see that OpenAI returned the following completion: `Hello, !"`
3. Lastly, the reconstruction stage (marked purple), where Masked-AI takes the output, and replace the placeholders back with the real data, which in this case, `Hello, Adam!`
### 3. Example 3: Same as the above, but with Python:
```python
import os
import openai
from masked_ai import Masker
# Load your API key from an environment variable or secret management service
openai.api_key = os.getenv("OPENAI_API_KEY")
data = "My name is Adam and my IP address is 8.8.8.8. Now, write a one line poem:"
masker = Masker(data)
print('Masked: ', masker.masked_data)
response = openai.Completion.create(
model="text-davinci-003",
prompt=masker.masked_data,
temperature=0,
max_tokens=1000,
)
generated_text = response.choices[0].text
print('Raw response: ', response)
unmasked = masker.unmask_data(generated_text)
print('Result:', unmasked)
```
## How to contribute:
The main area to contribute is to add more Masks, for example, we currently have: `IPMask`, `EmailMask`, `CreditCardMask`, and more - but there is always more to add!
Clone the repo, create a new branch, and simply go to `core/masks.py`, create a new class that inherent from `MaskBase` (in the same module), and implement the `find` method: `def find(data: str) -> Tuple[str, Dict[str, str]]:`. Once you created the class, it will automatically be part of the masking process.
Here is an example for masking IP addresses:
```python
class IPMask(MaskBase):
@staticmethod
def find(data: str) -> Tuple[str, Dict[str, str]]:
return re.findall(r"\b\d{1,3}\.\d{1,3}\.\d{1,3}\.\d{1,3}\b", data)
```
And don't forget to add tests `tests/core/test_masks.py`! :)
## How to make a new release:
1. Go to the Repo's Releases page (https://github.com/cado-security/masked-ai/releases) - and click "Draft a new release"
2. Make the tag and the name of the release follow the following format: [Major].[Minor].[Patch] (i.e. 1.0.0)
3. Add release notes to the description and click "Publish Release"
4. This will kick off a GitHub Action Workflow named `publish.yml` with 4 steps: Linux, Windows, MacOS and Pypi
5. The PyPi stage will automatically upload package, but for the CLI tools you'd need to manually copy the artifacts from the workflow to the release notes you just created