https://github.com/glouw/tinn

A tiny neural network library
https://github.com/glouw/tinn

ansi back c feed forward network neural propagation tiny

Last synced: 27 days ago
JSON representation

A tiny neural network library

• Host: GitHub
• URL: https://github.com/glouw/tinn
• Owner: glouw
• License: mit
• Created: 2018-03-27T07:16:59.000Z (over 6 years ago)
• Default Branch: master
• Last Pushed: 2021-01-17T23:06:12.000Z (almost 4 years ago)
• Last Synced: 2024-09-27T02:27:07.546Z (about 1 month ago)
• Topics: ansi, back, c, feed, forward, network, neural, propagation, tiny
• Language: C
• Homepage:
• Size: 68.4 KB
• Stars: 2,105
• Watchers: 90
• Forks: 188
• Open Issues: 13
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

README

        
![](img/logo.PNG)

Tinn (Tiny Neural Network) is a 200 line dependency free neural network library written in C99.

For a demo on how to learn hand written digits, get some training data:

    wget http://archive.ics.uci.edu/ml/machine-learning-databases/semeion/semeion.data

    make; ./test

The training data consists of hand written digits written both slowly and quickly.

Each line in the data set corresponds to one handwritten digit. Each digit is 16x16 pixels in size

giving 256 inputs to the neural network.

At the end of the line 10 digits signify the hand written digit:

    0: 1 0 0 0 0 0 0 0 0 0

    1: 0 1 0 0 0 0 0 0 0 0

    2: 0 0 1 0 0 0 0 0 0 0

    3: 0 0 0 1 0 0 0 0 0 0

    4: 0 0 0 0 1 0 0 0 0 0

    ...

    9: 0 0 0 0 0 0 0 0 0 1

This gives 10 outputs to the neural network. The test program will output the

accuracy for each digit. Expect above 99% accuracy for the correct digit, and

less that 0.1% accuracy for the other digits.

## Features

* Portable - Runs where a C99 or C++98 compiler is present.

* Sigmoidal activation.

* One hidden layer.

## Tips

* Tinn will never use more than the C standard library.

* Tinn is great for embedded systems. Train a model on your powerful desktop and load

it onto a microcontroller and use the analog to digital converter to predict real time events.

* The Tinn source code will always be less than 200 lines. Functions externed in the Tinn header

are protected with the _xt_ namespace standing for _externed tinn_.

* Tinn can easily be multi-threaded with a bit of ingenuity but the master branch will remain

single threaded to aid development for embedded systems.

* Tinn does not seed the random number generator. Do not forget to do so yourself.

* Always shuffle your input data. Shuffle again after every training iteration.

* Get greater training accuracy by annealing your learning rate. For instance, multiply

your learning rate by 0.99 every training iteration. This will zero in on a good learning minima.

## Disclaimer

Tinn is a practice in minimalism.

Tinn is not a fully featured neural network C library like Kann, or Genann:

    https://github.com/attractivechaos/kann

    https://github.com/codeplea/genann

## Ports

    Rust: https://github.com/dvdplm/rustinn

## Other

 [A Tutorial using Tinn NN and CTypes](https://medium.com/@cknorow/creating-a-python-interface-to-a-c-library-a-tutorial-using-tinn-nn-d935707dd225)

 [Tiny Neural Network Library in 200 Lines of Code](https://hackaday.com/2018/04/08/tiny-neural-network-library-in-200-lines-of-code/)