https://github.com/patrick-kidger/sympytorch

Turning SymPy expressions into PyTorch modules.
https://github.com/patrick-kidger/sympytorch

pytorch sympy

Last synced: 11 days ago
JSON representation

Turning SymPy expressions into PyTorch modules.

• Host: GitHub
• URL: https://github.com/patrick-kidger/sympytorch
• Owner: patrick-kidger
• License: apache-2.0
• Created: 2021-02-23T22:14:34.000Z (over 3 years ago)
• Default Branch: master
• Last Pushed: 2023-07-24T22:55:46.000Z (over 1 year ago)
• Last Synced: 2024-10-17T10:06:48.094Z (24 days ago)
• Topics: pytorch, sympy
• Language: Python
• Homepage:
• Size: 59.6 KB
• Stars: 140
• Watchers: 11
• Forks: 19
• Open Issues: 4
• Metadata Files:
  • Readme: README.md
  • Funding: .github/FUNDING.yml
  • License: LICENSE

Awesome Lists containing this project

README

        
sympytorch


Turn SymPy expressions into PyTorch Modules.

SymPy floats (optionally) become trainable parameters. SymPy symbols are inputs to the Module.

Optimise your symbolic expressions via gradient descent!

## Installation

```bash

pip install sympytorch

```

Requires Python 3.7+ and PyTorch 1.6.0+ and SymPy 1.7.1+.

## Example

```python

import sympy, torch, sympytorch

x = sympy.symbols('x_name')

cosx = 1.0 * sympy.cos(x)

sinx = 2.0 * sympy.sin(x)

mod = sympytorch.SymPyModule(expressions=[cosx, sinx])

x_ = torch.rand(3)

out = mod(x_name=x_)  # out has shape (3, 2)

assert torch.equal(out[:, 0], x_.cos())

assert torch.equal(out[:, 1], 2 * x_.sin())

assert out.requires_grad  # from the two Parameters initialised as 1.0 and 2.0

assert {x.item() for x in mod.parameters()} == {1.0, 2.0}

```

## API

```python

sympytorch.SymPyModule(*, expressions, extra_funcs=None)

```

Where:

- `expressions` is a list of SymPy expressions.

- `extra_funcs` is a dictionary mapping from custom `sympy.Function`s to their PyTorch implementation. Defaults to no extra functions.

Instances of `SymPyModule` can be called, passing the values of the symbols as in the above example.

`SymPyModule` has a method `.sympy()`, which returns the corresponding list of SymPy expressions. (Which may not be the same as the expressions it was initialised with, if the values of its Parameters have been changed, i.e. have been learnt.)

Wrapping floats in `sympy.UnevaluatedExpr` will cause them not to be trained, by registering them as buffers rather than parameters.

```python

sympytorch.hide_floats(expression)

```

As a convenience, `hide_floats` will take an expression and return a new expression with every float wrapped in a `sympy.UnevaluatedExpr`, so that it is interpreted as a buffer rather than a parameter.

## Extensions

Not every PyTorch or SymPy operation is supported -- just the ones that I found I've needed! There's a dictionary [here](./sympytorch/sympy_module.py#L12) that lists the supported operations. Feel free to submit PRs for any extra operations you think should be in by default. You can also use the `extra_funcs` argument to specify extra functions, including custom functions.