https://github.com/minitechy/betavae_dis
Investigating Disentanglement in beta-VAE within a Linear Gaussian Setting
https://github.com/minitechy/betavae_dis
beta-vae machine-learning nonlinear-optimization numerical-analysis
Last synced: about 2 months ago
JSON representation
Investigating Disentanglement in beta-VAE within a Linear Gaussian Setting
- Host: GitHub
- URL: https://github.com/minitechy/betavae_dis
- Owner: Minitechy
- Created: 2024-02-20T07:52:52.000Z (over 1 year ago)
- Default Branch: main
- Last Pushed: 2024-02-20T08:10:23.000Z (over 1 year ago)
- Last Synced: 2025-02-02T17:58:57.408Z (4 months ago)
- Topics: beta-vae, machine-learning, nonlinear-optimization, numerical-analysis
- Language: Jupyter Notebook
- Homepage:
- Size: 1.24 MB
- Stars: 0
- Watchers: 1
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
## Abstract:
This research investigates the disentanglement property within the $\beta$-VAE framework, focusing on unraveling latent representations into semantically meaningful and independent factors. Disentanglement is characterized by variations in a single latent variable corresponding to variations in a specific generative parameter, yielding interpretable and transferable representations. The goal is to achieve a disentangled representation where each latent variable exclusively captures a distinct generative factor, elucidating the underlying factors of variation in the data. The study specifically explores disentanglement in a linear Gaussian setting using the $\gamma\lambda$-VAE model, chosen for its controllability of reconstruction error. We propose a mutual information-based metric, $I_m$, where $m$ denotes the dimension of the latent variable, to assess disentanglement across three scenarios: no correlation, partial correlation, and full correlation among generative variables. Additionally, we conduct a comparative analysis between our metric and contemporary metrics like the SAP metric in the linear Gaussian framework across the aforementioned scenarios. This comparative examination aims to reveal the strengths and limitations of each metric in assessing disentanglement.