https://github.com/statusfailed/rda
https://github.com/statusfailed/rda
Last synced: 11 months ago
JSON representation
- Host: GitHub
- URL: https://github.com/statusfailed/rda
- Owner: statusfailed
- License: mit
- Created: 2020-01-28T01:59:47.000Z (about 6 years ago)
- Default Branch: master
- Last Pushed: 2022-11-15T18:43:59.000Z (over 3 years ago)
- Last Synced: 2025-04-14T05:17:53.568Z (11 months ago)
- Language: Haskell
- Size: 38.1 KB
- Stars: 4
- Watchers: 3
- Forks: 1
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- Changelog: CHANGELOG.md
- License: LICENSE
Awesome Lists containing this project
README
# Reverse Derivative Ascent
A library for training circuit models as in the paper
[Reverse Derivative Ascent: A Categorical Approach to Learning Boolean Circuits][paper]
[paper]: http://catgrad.com/p/reverse-derivative-ascent/paper.pdf
This library provides three main things:
* A type-safe, `Integer`-backed implementation of Bitvectors
* Some tools for compositionally building circuit models as in
our [reverse derivative ascent] paper (including computing their reverse
derivative)
* A brute-force implementation of the reverse derivative, which computes the
same results as the compositional one, but slower.
# User Guide
For now, see the project [act-2020-experiments](https://github.com/statusfailed/act-2020-experiments),
which gives a couple example applications: we build a model on the
[Iris dataset](http://archive.ics.uci.edu/ml/datasets/Iris/),
and on a subset of [MNIST](http://yann.lecun.com/exdb/mnist/).