Ecosyste.ms: Awesome

https://github.com/microsoft/presidio

Context aware, pluggable and customizable data protection and de-identification SDK for text and images

anonymization anonymization-service data-anonymization data-loss-prevention data-masking data-protection data-scrubbing de-identification dlp microsoft pii pii-anonymization pii-anonymization-service pii-detection presidio privacy privacy-protection python text-anonymization transformers

Last synced: 29 Sep 2024

https://github.com/capitalone/dataprofiler

What's in your data? Extract schema, statistics and entities from datasets

avro csv data-analysis data-labels data-science dataprofiling dataset gdpr graph-data machine-learning network-data nlp npi pandas pii privacy python security sensitive-data tabular-data

Last synced: 26 Sep 2024

https://github.com/capitalone/DataProfiler

What's in your data? Extract schema, statistics and entities from datasets

avro csv data-analysis data-labels data-science dataprofiling dataset gdpr graph-data machine-learning network-data nlp npi pandas pii privacy python security sensitive-data tabular-data

Last synced: 01 Aug 2024

https://github.com/securitybunker/databunker

Secure SDK/vault for personal records/PII built to comply with GDPR

anonymization application-server ccpa compliance data-anonymization data-protection database encryption gdpr legaltech passportjs pii piidata privacy privacy-by-design secure-storage security tokenization user-consent vault

Last synced: 30 Sep 2024

https://github.com/redhuntlabs/Octopii

An AI-powered Personal Identifiable Information (PII) scanner.

blackhat cloud cybersecurity image-processing machine-learning nlp ocr optical-character-recognition pii pii-detection python

Last synced: 01 Aug 2024

https://github.com/tokern/piicatcher

Scan databases and data warehouses for PII data. Tag tables and columns in data catalogs like Amundsen and Datahub

aws-athena aws-glue aws-redshift catalog data data-catalog database phi pii python snowflake

Last synced: 03 Oct 2024

https://github.com/microsoft/presidio-research

This package features data-science related tasks for developing new recognizers for Presidio. It is used for the evaluation of the entire system, as well as for evaluating specific PII recognizers or PII detection models.

deep-learning flair machine-learning named-entity-recognition natural-language-processing ner nlp pii privacy spacy transformers

Last synced: 30 Sep 2024

https://github.com/samber/slog-formatter

🚨 slog: Attribute formatting

anonymization error formatter formatting go golang handler log-level logger logging middleware pii slog structured-logging

Last synced: 30 Jul 2024

https://github.com/googlecloudplatform/dlp-dataflow-deidentification

Multi Cloud Data Tokenization Solution By Using Dataflow and Cloud DLP

beam bigquery data dataflow dlp pii tokenization

Last synced: 28 Sep 2024

https://github.com/deliciousinsights/mongoose-pii

A Mongoose plugin that lets you transparently cipher stored PII and use securely-hashed passwords

bcrypt mongodb mongoose mongoose-plugin password passwords pii pii-ciphering security

Last synced: 27 Sep 2024

https://github.com/edwardcooper/piidetect

A package to build an end-to-end pipeline for detecting personally identifiable information from text.

nlp pii pii-detection word2vec

Last synced: 02 Aug 2024

https://github.com/PovertyAction/PII_detection

Application and python script to identify, remove, and/or recode personally identifiable information (PII) from field experiment datasets.

deidentification field-survey natural-language-processing pii

Last synced: 02 Aug 2024

https://github.com/dotfurther/OpenDiscoverSDK

.NET 6 API for document file format identification, text/metadata/attachment/embedded object/sensitive item (PII/PHI)/entity extraction.

archive csharp dotnet email embedded-objects entity-extraction extraction file-deduplication file-format-detection file-identification indexing metadata microsoft-office phi pii pii-detection pst sdk text text-extraction

Last synced: 01 Aug 2024

https://github.com/datafog/datafog-instructor

local-llm ollama pii pydantic

Last synced: 01 Oct 2024

https://github.com/dotfurther/OpenDiscoverPlatformCaseStudy

Case study using dotfurther's Open Discover Platform with the RavenDB document store to rapidly create a full-text search/eDiscovery/information governance capable demonstration application.

archive-extractor data-breach document-ingestion ediscovery file-deduplication file-format-detection file-identification full-text full-text-extraction full-text-search indexing-engine information-governance information-governance-catalog metadata personally-identifiable-information pii pii-detection ravendb text-extraction

Last synced: 01 Aug 2024

https://github.com/HabaneroCake/pii-filter

A personally identifiable information (PII) filter.

dutch pii pii-detection

Last synced: 02 Aug 2024

https://github.com/kangaroos-are-cool/directoryscanner

A go module for scanning directories for sensitive information (or anything you'd like really)

gathering go golang information infosec pii regex scanning sensitive

Last synced: 02 Aug 2024