https://github.com/dmtrinh/syntheticdata

https://github.com/dmtrinh/syntheticdata

Last synced: about 1 month ago
JSON representation

• Host: GitHub
• URL: https://github.com/dmtrinh/syntheticdata
• Owner: dmtrinh
• Created: 2021-02-11T07:48:15.000Z (almost 4 years ago)
• Default Branch: main
• Last Pushed: 2023-10-31T14:56:49.000Z (about 1 year ago)
• Last Synced: 2023-10-31T17:41:41.948Z (about 1 year ago)
• Language: Jupyter Notebook
• Size: 2.43 MB
• Stars: 0
• Watchers: 1
• Forks: 1
• Open Issues: 0
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

README

        
# SyntheticData

Getting access to good data for model development and testing is almost always a challenge especially when the data is sensitive or includes personally identifiable information (PII).  Attempts to preserve privacy through anonymization techniques such as hashing, masking, and even noise obfuscation are sometimes insufficient.  The [attack on the Netflix Prize dataset](https://arxiv.org/pdf/cs/0610105.pdf) and studies looking at [limitations of current methods used for protecting health care data](https://www.semanticscholar.org/paper/Practicing-Differential-Privacy-in-Health-Care%3A-A-Dankar-Emam/65a537c9cd327c2925676f59ddffa01cf4afbe51) demonstrate just how difficult privacy preservation is.  Even when sensitive and/or identifying variables are removed from the dataset, other variables can act as identifiers when they are combined.

Despite being around for a long time, synthetic data is enjoying a renaissance given the ever-growing need for realistic data.  And since synthetic data is algorithmically generated with machine learning techniques and never directly based on actual real events or individuals, a high degree of privacy can be assured.

## Getting Started

The [Lending Club dataset](https://www.kaggle.com/datasets/wordsforthewise/lending-club) is used in the notebook for demonstration.  However, you are free to use other datasets and adapt the code as appropriate.

Other datasets to consider:

* [Credit Card Transactions](https://www.kaggle.com/datasets/mlg-ulb/creditcardfraud)

* [Traffic Violations in Maryland County](https://www.kaggle.com/datasets/rounak041993/traffic-violations-in-maryland-county)

* [Airline Passenger Satisfaction](https://www.kaggle.com/datasets/teejmahal20/airline-passenger-satisfaction)

## Evaluation Approach

Synthetic data can be evaluated against the authentic data based on three fundamental dimensions:

* Statistical proximity

* Privacy preservation

* Usefulness / utility

The "usefulness" dimension focuses on a synthetic dataset's ability to behave similarly as the authentic dataset when used to build ML models.  A high-level workflow to evaluate usefulness could be:

```mermaid

flowchart TD

  subgraph AD[Authentic Dataset]

    subgraph TD[Training data - 80%]

    end

    subgraph RD[Reserved data - 20%]

    end

  end

  TD-->SDG[Synthetic Data Generator]

  SDG-->SD[Synthetic Dataset]

  SD-->TMLM1[Train ML model]

  TMLM1-->E1[Evaluate model performance]

  RD-.->E1

  TD-->TMLM2[Train ML model]

  TMLM2-->E2[Evaluate model performance]

  RD-.->E2

  E1-->C[Compare]

  E2-->C

```