https://github.com/electronicvisions/jaxsnn
jaxsnn is an event-based approach to machine-learning-inspired training and simulation of SNNs, including support for the BrainScaleS-2 neuromorphic backend.
https://github.com/electronicvisions/jaxsnn
Last synced: 5 months ago
JSON representation
jaxsnn is an event-based approach to machine-learning-inspired training and simulation of SNNs, including support for the BrainScaleS-2 neuromorphic backend.
- Host: GitHub
- URL: https://github.com/electronicvisions/jaxsnn
- Owner: electronicvisions
- License: lgpl-2.1
- Created: 2023-05-05T13:20:39.000Z (about 3 years ago)
- Default Branch: main
- Last Pushed: 2025-11-26T10:15:21.000Z (7 months ago)
- Last Synced: 2025-11-28T03:20:03.781Z (7 months ago)
- Language: Python
- Homepage:
- Size: 5.97 MB
- Stars: 27
- Watchers: 2
- Forks: 2
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- License: LICENSE
- Citation: CITATION.cff
Awesome Lists containing this project
README
# jaxsnn
`jaxsnn` (pronounced like Jackson /ˈdʒæksən/) is an event-based approach to
machine-learning-inspired training and simulation of SNNs, including support
for neuromorphic backends (BrainScaleS-2).
We build upon [jax](https://github.com/google/jax), a Python library providing
autograd and XLA functionality for high-performance machine learning research.
## Installation
We provide a pypi build of the software that lacks support for the
BrainScaleS-2 neuromorphic hardware system. The usual `pip install jaxsnn`
stuff should work, but YMMV.
## Building the Software
The software builds upon existing libraries, such as
[jax](https://github.com/google/jax),
[optax](https://github.com/deepmind/optax),
and [tree-math](https://github.com/google/tree-math).
When using the neuromorphic BrainScaleS-2 backend, the software stack of the
platform is required.
We provide a container image (based on the [Apptainer format](https://apptainer.org/)) including all build-time and runtime dependencies.
Feel free to download the most recent version from [here](https://openproject.bioai.eu/containers/).
For all following steps, we assume that the most recent Apptainer container is located at `/containers/stable/latest`.
### Github-based Build
To build this project from public resources, adhere to the following guide:
```shell
# 1) Most of the following steps will be executed within a apptainer container
# To keep the steps clutter-free, we start by defining an alias
shopt -s expand_aliases
alias c="apptainer exec --app dls /containers/stable/latest"
# 2) Prepare a fresh workspace and change directory into it
mkdir workspace && cd workspace
# 3) Fetch a current copy of the symwaf2ic build tool
git clone https://github.com/electronicvisions/waf -b symwaf2ic symwaf2ic
# 4) Build symwaf2ic
c make -C symwaf2ic
ln -s symwaf2ic/waf
# 5) Setup your workspace and clone all dependencies (--clone-depth=1 to skip history)
c ./waf setup --repo-db-url=https://github.com/electronicvisions/projects --project=jaxsnn
# 6) Load PPU cross-compiler toolchain (or build https://github.com/electronicvisions/oppulance)
module load ppu-toolchain
# 7) Build the project
# Adjust -j1 to your own needs, beware that high parallelism will increase memory consumption!
c ./waf configure
c ./waf build -j1
# 8) Install the project to ./bin and ./lib
c ./waf install
# 9) If you run programs outside waf, you'll need to add ./lib and ./bin to your path specifications
export APPTAINERENV_PREPEND_PATH=`pwd`/bin:$APPTAINERENV_PREPEND_PATH
export APPTAINERENV_LD_LIBRARY_PATH=`pwd`/lib:$APPTAINERENV_LD_LIBRARY_PATH
export PYTHONPATH=`pwd`/lib:$PYTHONPATH
export PYTHONPATH=`pwd`/lib/python3.10/site-packages:$PYTHONPATH
# 10) To validate that your build was successful, execute the following example
python -m jaxsnn.examples.event.yinyang_analytical
```
## Structure
`jaxsnn` is split into two parts. Training of **SNNs** is done in the init/apply style.
### Time Discrete
`jaxsnn.discrete` simulates **SNNs** by treating time in a discrete way. It uses euler steps of a fixed size to advance the network forward in time which draws inspiration from [norse](www.github.com/norse/norse).
### Time Continuous
`jaxsnn.event` treats time continously and allows jumping from one event to the next one. It's core functionality consists of the `step` function, which does three things:
1. Find the next threshold crossing
2. Integrate the neuron to this point in time
3. Apply the discontinuity after the threshold crossing
`jaxsnn.event.modules.leaky_integrate_and_fire` provides multiple neuron types which can be used to build larger networks. Each neuron type defines the three functions mentioned above.
### BSS-2 Connection
`jaxsnn.event.hardware` provides functionality to connect to the [BSS-2 system](https://www.frontiersin.org/articles/10.3389/fnins.2022.795876/full) and to conduct learning experiments on dedicated neuromorphic hardware.
## First Steps
We provide multiple examples for usage of `jaxsnn`.
Time discrete learning using surrogate gradients on the Yin-Yang dataset:
```bash
python -m jaxsnn.examples.discrete.yinyang
```
Event-based two layer feed-forward network with analytical gradients:
```bash
python -m jaxsnn.examples.event.yinyang_analytical
```
Event-based two-layer feed-forward network with gradients computed using the EventProp algorithm:
```bash
python -m jaxsnn.examples.event.yinyang_layered_event_prop
```
Event-based recurrent network with gradients computed using the EventProp algorithm:
```bash
python -m jaxsnn.examples.event.yinyang_recurrent_event_prop
```
### BSS-2
If you want to work with the BSS-2 system, a working example is provided:
```bash
python -m jaxsnn.examples.event.yinyang_bss2
```
The operation point calibration script is `src/pyjaxsnn/jaxsnn/event/hardware/calib/neuron_calib.py`.
Example:
```bash
srun -p cube --wafer 69 --fpga-without-aout 0 --pty c python ./neuron_calib.py \
--wafer W69F0 \
--threshold 150 \
--tau-syn 6e-6 \
--tau-mem 12e-6 \
--refractory-time 30e-6 \
--synapse-dac-bias 1000
--calib-dir src/pyjaxsnn/jaxsnn/event/hardware/calib
```
If you want to study the behaviour that different hardware artifacts (noise on the spike times) have on the performance of SNNs, check out this example:
```bash
python -m jaxsnn.examples.event.hardware.yinyang_mock
```
You can switch between an actual execution on BSS-2 and a pure software mock mode, in which the hardware is emulated by a second software network. You can
add noise to spikes from this first network or limit the dynamic range (like it is on BSS-2).
## TODO
- The mapping between the hardware neuron modules `HardwareRecurrentLIF` (which can simulate multiple feed-forward layers) and the populations / projections is not yet implemented cleanly and is hacked into the tasks (experiment returns a list of spikes for two layers, which are merged together, projections are hardcoded)
## Acknowledgements
The software in this repository has been developed by staff and students
of Heidelberg University as part of the research carried out by the
Electronic Vision(s) group at the Kirchhoff-Institute for Physics.
This work has received funding from the EC Horizon 2020 Framework Programme
under grant agreements 785907 (HBP SGA2) and 945539 (HBP SGA3), the Deutsche
Forschungsgemeinschaft (DFG, German Research Foundation) under Germany's
Excellence Strategy EXC 2181/1-390900948 (the Heidelberg STRUCTURES Excellence
Cluster), the German Federal Ministry of Education and Research under grant
number 16ES1127 as part of the Pilotinnovationswettbewerb Energieeffizientes
KI-System, the Helmholtz Association Initiative and Networking Fund [Advanced
Computing Architectures (ACA)] under Project SO-092, as well as from the
Manfred Stärk Foundation, and the Lautenschläger-Forschungspreis 2018 for
Karlheinz Meier.
## Licensing
`SPDX-License-Identifier: LGPL-2.1-or-later`