https://github.com/stypox/neural-network
Fully-connected neural network trained using derivatives
https://github.com/stypox/neural-network
Last synced: about 1 year ago
JSON representation
Fully-connected neural network trained using derivatives
- Host: GitHub
- URL: https://github.com/stypox/neural-network
- Owner: Stypox
- Created: 2019-05-26T17:36:15.000Z (almost 7 years ago)
- Default Branch: master
- Last Pushed: 2021-08-24T15:30:06.000Z (over 4 years ago)
- Last Synced: 2025-02-08T20:47:33.536Z (about 1 year ago)
- Language: C++
- Size: 163 KB
- Stars: 3
- Watchers: 3
- Forks: 1
- Open Issues: 1
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
# Neural network
This is a fully connected neural network implementation from the ground up, without using any library. It was made for practice purposes, by following [Neural Networks and Deep Learning](http://neuralnetworksanddeeplearning.com), and features both a (really really slow) Python3 and (fast) C++ implementation. It allows creating networks with multiple layers. It supports multiple activation and cost functions and allows defining more by the user, by extending the relevant class. Optimization is achieved with stochastic gradient descent (optionally keeping track of momentum), with the possibility to fine-tune multiple parameters: epochs, mini batch size, eta, regularization and momentum. By training with 100 hidden layers on the MNIST training data set, roughly 97%-98% of the test digits were correctly classified.