https://github.com/philterd/phinder-pii-elasticsearch-plugin

An Elasticsearch plugin to redact PII from search results.
https://github.com/philterd/phinder-pii-elasticsearch-plugin

elasticsearch pii plugin redaction

Last synced: 6 months ago
JSON representation

An Elasticsearch plugin to redact PII from search results.

Host: GitHub
URL: https://github.com/philterd/phinder-pii-elasticsearch-plugin
Owner: philterd
License: apache-2.0
Created: 2025-01-16T21:13:24.000Z (9 months ago)
Default Branch: main
Last Pushed: 2025-03-24T21:56:42.000Z (7 months ago)
Last Synced: 2025-03-24T22:31:27.406Z (7 months ago)
Topics: elasticsearch, pii, plugin, redaction
Language: Java
Homepage: https://www.philterd.ai
Size: 149 KB
Stars: 1
Watchers: 1
Forks: 0
Open Issues: 0
Metadata Files:
- Readme: README.md
- License: LICENSE.txt
- Codeowners: .github/CODEOWNERS

Awesome Lists containing this project

README

# Phinder PII Plugin for Elasticsearch

This repository is a plugin for Elasticsearch that redacts PII from search results. It uses the [phileas](https://github.com/philterd/phileas/) library for redaction.

There is also a [version](https://github.com/philterd/phinder-pii-opensearch-plugin) available for OpenSearch which serves as the upstream for this repository.

## Build and Install

To build the plugin:

```
./gradlew build
```

To install the plugin:

```
/usr/share/elasticsearch/bin/elasticsearch-plugin install --batch file:/path/to/phinder-1.0.0-SNAPSHOT.zip
```

## Using Docker

To quickly run Elasticsearch and the plugin for development or testing:

```
docker compose build
docker compose up
```

## Usage

To use the plugin, create an index and then index some documents:

```
curl -s -X PUT "http://localhost:9200/sample_index" -H 'Content-Type: application/json'
```

```
curl -s -X POST "http://localhost:9200/sample_index/_doc" -H 'Content-Type: application/json' -d'
{
"name": "Another Example",
"description": "My email is something@something.com ok!"
}'

curl -s -X POST "http://localhost:9200/sample_index/_doc" -H 'Content-Type: application/json' -d'
{
"name": "Yet Another Example",
"description": "No email addresses in this one"
}'

curl -s -X POST "http://localhost:9200/sample_index/_doc" -H 'Content-Type: application/json' -d'
{
"name": "A Third Example",
"description": "tom@tom.com"
}'

```

Next, do a search providing a filter policy and specifying which field you want to redact. (For more on policies, see Phileas' documentation on [Policies](https://philterd.github.io/phileas/filter_policies/filter_policies/).) In this example,
we are going to redact email addresses that appear in the `description` field:

```
curl -s http://localhost:9200/sample_index/_search -H "Content-Type: application/json" -d'
{
"ext": {
"phinder": {
"field": "description",
"policy": "{\"identifiers\": {\"emailAddress\":{\"emailAddressFilterStrategies\":[{\"strategy\":\"REDACT\",\"redactionFormat\":\"{{{REDACTED-%t}}}\"}]}}}"
}
},
"query": {
"match_all": {}
}
}'
```

The value of `field` in the request can be a single field, or a comma-separated list of fields to redact.

In the response, you will see the email address in the indexed document has been redacted:

```
{
"took": 2,
"timed_out": false,
"_shards": {
"total": 1,
"successful": 1,
"skipped": 0,
"failed": 0
},
"hits": {
"total": {
"value": 3,
"relation": "eq"
},
"max_score": 1,
"hits": [
{
"_index": "sample_index",
"_id": "3sZ8cJQBeC9RICk83_tV",
"_score": 1,
"_source": {
"name": "Another Example",
"description": "My email is {{{REDACTED-email-address}}} ok!"
}
},
{
"_index": "sample_index",
"_id": "38Z8cJQBeC9RICk83_t1",
"_score": 1,
"_source": {
"name": "Yet Another Example",
"description": "No email addresses in this one"
}
},
{
"_index": "sample_index",
"_id": "4MZ8cJQBeC9RICk83_uI",
"_score": 1,
"_source": {
"name": "A Third Example",
"description": "{{{REDACTED-email-address}}}"
}
}
]
}
}
```

## License
This code is licensed under the Apache 2.0 License. See [LICENSE.txt](LICENSE.txt).

ecosyste.ms

Data

Tools

Indexes

Applications

Experiments

Awesome

https://github.com/philterd/phinder-pii-elasticsearch-plugin

Awesome Lists containing this project

README