Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

Awesome Lists | Featured Topics | Projects

https://github.com/fluiddyn/fluidfft

:chart_with_upwards_trend: Common API (C++ and Python) for Fast Fourier Transform HPC libraries (publish-only mirror)
https://github.com/fluiddyn/fluidfft

cuda cython fft fftw3-binding mpi pythran spectral-methods

Last synced: 21 days ago
JSON representation

:chart_with_upwards_trend: Common API (C++ and Python) for Fast Fourier Transform HPC libraries (publish-only mirror)

Awesome Lists containing this project

README

        

![FluidFFT](https://foss.heptapod.net/fluiddyn/fluidfft/-/blob/branch/default/doc/logo.svg)
===========================================================================================

*Efficient and easy Fast Fourier Transform for Python*

[![Latest version](https://img.shields.io/pypi/v/fluidfft.svg)](https://pypi.org/project/fluidfft/)
![Supported Python versions](https://img.shields.io/pypi/pyversions/fluidfft.svg)
[![Documentation status](https://readthedocs.org/projects/fluidfft/badge/?version=latest)](http://fluidfft.readthedocs.org)
[![Code coverage](https://codecov.io/gh/fluiddyn/fluidfft/branch/branch%2Fdefault/graph/badge.svg)](https://codecov.io/gh/fluiddyn/fluidfft)
[![Heptapod CI](https://foss.heptapod.net/fluiddyn/fluidfft/badges/branch/default/pipeline.svg)](https://foss.heptapod.net/fluiddyn/fluidfft/-/pipelines)
[![Github Actions Linux](https://github.com/fluiddyn/fluidfft/actions/workflows/ci-linux.yml/badge.svg?branch=branch/default)](https://github.com/fluiddyn/fluidfft/actions/workflows/ci-linux.yml)
[![Github Actions Pixi](https://github.com/fluiddyn/fluidfft/actions/workflows/ci-pixi.yml/badge.svg?branch=branch/default)](https://github.com/fluiddyn/fluidfft/actions/workflows/ci-pixi.yml)

Fluidfft provides C++ classes and their Python wrapper classes written
in Cython useful to perform Fast Fourier Transform (FFT) with different
libraries, in particular

- [fftw3](http://www.fftw.org/) and
[fftw3-mpi](http://www.fftw.org/fftw3_doc/Distributed_002dmemory-FFTW-with-MPI.html)
- [pfft](https://github.com/mpip/pfft)
- [p3dfft](https://github.com/sdsc/p3dfft)
- [mpi4py-fft](https://bitbucket.org/mpi4py/mpi4py-fft)
- [cufft](https://developer.nvidia.com/cufft) (fft library by CUDA
running on GPU)

[pfft](https://github.com/mpip/pfft),
[p3dfft](https://github.com/sdsc/p3dfft) and
[mpi4py-fft](https://bitbucket.org/mpi4py/mpi4py-fft) are specialized in
computing FFT efficiently on several cores of big clusters. The data can
be split in pencils and can be distributed on several processes.

**Documentation**:

Getting started
---------------

To try fluidfft without installation:
[![Binder notebook](https://mybinder.org/badge_logo.svg)](https://mybinder.org/v2/gh/fluiddyn/fluidfft/branch%2Fdefault?urlpath=lab/tree/doc/ipynb)

For a **basic installation** which relies only on a `pyFFTW` interface;
or provided you have the optional FFT libaries, that you need, installed
and discoverable in your path (see environment variables `LIBRARY_PATH`,
`LD_LIBRARY_PATH`, `CPATH`) it should be sufficient to run:

pip install fluidfft [--user]

Add `--user` flag if you are installing without setting up a virtual
environment.

Installation
------------

To take full advantage of fluidfft, consider installing the following
(optional) dependencies and configurations before installing fluidfft.
Click on the links to know more:

1. OpenMPI or equivalent
2. FFT libraries such as MPI-enabled FFTW (for 2D and 3D solvers) and
P3DFFT, PFFT (for 3D solvers) either using a package manager or
[from
source](https://fluidfft.readthedocs.io/en/latest/install/fft_libs.html)
3. Python packages `fluiddyn cython pyfftw pythran mpi4py`
4. [A C++11 compiler and BLAS
libraries](https://github.com/serge-sans-paille/pythran#installation)
and
[configure](https://fluidfft.readthedocs.io/en/latest/install.html#dependencies)
`~/.pythranrc` to customize compilation of Pythran extensions
5. [Configure](https://fluidfft.readthedocs.io/en/latest/install.html#basic-installation-with-pip)
`~/.fluidfft-site.cfg` to detect the FFT libraries and install
`fluidfft`

**Note**: Detailed instructions to install the above dependencies using
Anaconda / Miniconda or in a specific operating system such as Ubuntu,
macOS etc. can be found
[here](https://fluiddyn.readthedocs.io/en/latest/get_good_Python_env.html).

### C++ API

See a [working minimal example with
Makefile](https://fluidfft.readthedocs.io/en/latest/examples/cpp.html)
which illustrates how to use the C++ API.

Tests
-----

From the root directory:

make tests
make tests_mpi

Or, from the root directory or any of the \"test\" directories:

pytest -s
mpirun -np 2 pytest -s

How does it work?
-----------------

Fluidfft provides classes to use in a transparent way all these
libraries with an unified API. These classes are not limited to just
performing Fourier transforms. They are also an elegant solution to
efficiently perform operations on data in real and spectral spaces
(gradient, divergence, rotational, sum over wavenumbers, computation of
spectra, etc.) and easily deal with the data distribution (gather the
data on one process, scatter the data to many processes) without having
to know the internal organization of every FFT library.

Fluidfft hides the internal complication of (distributed) FFT libraries
and allows the user to find (by benchmarking) and to choose the most
efficient solution for a particular case. Fluidfft is therefore a very
useful tool to write HPC applications using FFT, as for example
pseudo-spectral simulation codes. In particular, fluidfft is used in the
Computational Fluid Dynamics (CFD) framework
[fluidsim](http://fluidsim.readthedocs.org).

License
-------

Fluidfft is distributed under the
[CeCILL](http://www.cecill.info/index.en.html) License, a GPL compatible
french license.

Metapapers and citations
------------------------

If you use FluidFFT to produce scientific articles, please cite our
metapapers presenting the [FluidDyn
project](https://openresearchsoftware.metajnl.com/articles/10.5334/jors.237/)
and
[Fluidfft](https://openresearchsoftware.metajnl.com/articles/10.5334/jors.238/):