{"id":15674656,"url":"https://github.com/rohan-varma/neuralnets","last_synced_at":"2025-05-06T23:25:26.624Z","repository":{"id":134290387,"uuid":"67414886","full_name":"rohan-varma/neuralnets","owner":"rohan-varma","description":"🤖 bare-bones implementation of a neural network with numpy","archived":false,"fork":false,"pushed_at":"2019-01-04T04:41:37.000Z","size":13698,"stargazers_count":16,"open_issues_count":0,"forks_count":8,"subscribers_count":5,"default_branch":"master","last_synced_at":"2025-03-31T04:01:53.697Z","etag":null,"topics":["hyperparameters","momentum","neural-network"],"latest_commit_sha":null,"homepage":"","language":"Jupyter Notebook","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/rohan-varma.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2016-09-05T11:23:15.000Z","updated_at":"2023-07-24T17:31:18.000Z","dependencies_parsed_at":null,"dependency_job_id":"d442d6db-f338-4fd8-89bf-3cf183c0e28c","html_url":"https://github.com/rohan-varma/neuralnets","commit_stats":null,"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/rohan-varma%2Fneuralnets","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/rohan-varma%2Fneuralnets/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/rohan-varma%2Fneuralnets/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/rohan-varma%2Fneuralnets/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/rohan-varma","download_url":"https://codeload.github.com/rohan-varma/neuralnets/tar.gz/refs/heads/master","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":252784602,"owners_count":21803717,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["hyperparameters","momentum","neural-network"],"created_at":"2024-10-03T15:48:51.180Z","updated_at":"2025-05-06T23:25:26.602Z","avatar_url":"https://github.com/rohan-varma.png","language":"Jupyter Notebook","funding_links":[],"categories":[],"sub_categories":[],"readme":"# neuralnets\nImplementations and experiments with Neural Networks. \nAll of this code will be ported to Python 3 shortly.\nThe main file of importance is neuralnetwork.py. It contains a from-scratch implementation of a neural network with a single hidden layer, without the use of any external libraries other than numpy. \n\nThe network achieves about 96.5% accuracy on MNIST if the hyperparameters are tuned. \n\nThe implementation has a few of the bells and whistles that help neural networks learn better:\n\n  - An option for using stochastic gradient descent with minibatch learning\n  - Decaying the learning rate during training\n  - Implementation of the momentum method for better convergence \u0026 less oscillations\n  - Nesterov momentum \n  - L2 regularization to promote smaller weights\n  - The dropout method that discards hidden layer activations to prevent overfitting. \n  \nAnother interesting file is utils/utils.py. \nIt contains several of my machine learning utilities for one-hot encoding, k-fold cross-validation, splitting datasets, and hyperparameter tuning. \n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Frohan-varma%2Fneuralnets","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Frohan-varma%2Fneuralnets","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Frohan-varma%2Fneuralnets/lists"}