An open API service indexing awesome lists of open source software.

https://github.com/computorg/published-202402-elmasri-optimal


https://github.com/computorg/published-202402-elmasri-optimal

Last synced: 1 day ago
JSON representation

Awesome Lists containing this project

README

          

# Optimal projection for parametric importance sampling in high dimensions
Maxime El Masri, Jérôme Morio, Florian Simatos
2024-03-11

### Citation

Maxime El Masri, Jérôme Morio and Florian Simatos (March 2024). Optimal projection for parametric importance sampling in high dimensions. Computo.

### Badges

[![build and
publish](https://github.com/computorg/published-202402-elmasri-optimal/actions/workflows/build.yml/badge.svg)](https://github.com/computorg/published-202402-elmasri-optimal/actions/workflows/build.yml)
[![reviews](https://img.shields.io/badge/review-report-blue)](https://github.com/computorg/published-202402-elmasri-optimal/issues?q=is%3Aopen+is%3Aissue+label%3Areview)
[![SWH](https://archive.softwareheritage.org/badge/origin/https://github.com/computorg/published-202402-elmasri-optimal)](https://archive.softwareheritage.org/browse/origin/?origin_url=https://github.com/computorg/published-202402-elmasri-optimal)
[![DOI:10.57750/jjza-6j82](https://img.shields.io/badge/DOI-10.57750%2Fjjza--6j82-034E79.svg)](https://doi.org/10.57750/jjza-6j82)
[![Creative Commons
License](https://i.creativecommons.org/l/by/4.0/80x15.png)](http://creativecommons.org/licenses/by/4.0/)

### Authors’ affiliations

- Maxime El Masri (ONERA/DTIS, ISAE-SUPAERO, Université de Toulouse)
- [Jérôme Morio](https://www.onera.fr/en/staff/jerome-morio?destination=node/981) (ONERA/DTIS, Université de Toulouse)
- [Florian Simatos](https://pagespro.isae-supaero.fr/florian-simatos/) (ISAE-SUPAERO, Université de Toulouse)

### Abstract

We propose a dimension reduction strategy in order to improve the
performance of importance sampling in high dimensions. The idea is to
estimate variance terms in a small number of suitably chosen directions.
We first prove that the optimal directions, i.e., the ones that minimize
the Kullback–Leibler divergence with the optimal auxiliary density, are
the eigenvectors associated with extreme (small or large) eigenvalues of
the optimal covariance matrix. We then perform extensive numerical
experiments showing that as dimension increases, these directions give
estimations which are very close to optimal. Moreover, we demonstrate
that the estimation remains accurate even when a simple empirical
estimator of the covariance matrix is used to compute these directions.
The theoretical and numerical results open the way for different
generalizations, in particular the incorporation of such ideas in
adaptive importance sampling schemes.