https://github.com/j-w-yun/optimizer-visualization

Visualize Tensorflow's optimizers.

adamoptimizer gradientdescentoptimizer learning-rate machine-learning optimization-algorithms optimizer-visualization tensorflow

Last synced: 09 Apr 2025

https://github.com/goessl/MachineLearning

An easy neural network for Java!

artificial-intelligence begginer easy-to-use hidden-layers java learning learning-rate lightweight machine-learning matrices matrix matrix-calculations neural-network neurons prediction weight weights

Last synced: 14 Apr 2025

https://github.com/goessl/machinelearning

An easy neural network for Java!

artificial-intelligence begginer easy-to-use hidden-layers java learning learning-rate lightweight machine-learning matrices matrix matrix-calculations neural-network neurons prediction weight weights

Last synced: 23 Apr 2025

https://github.com/wassname/viz_torch_optim

Videos of deep learning optimizers moving on 3D problem-landscapes

3d-graphics deep-learning learning-rate machine-learning optimization-algorithms optimizer pytorch vizualisation

Last synced: 11 Oct 2025

https://github.com/sooftware/pytorch-lr-scheduler

PyTorch implementation of some learning rate schedulers for deep learning researcher.

learning-rate lr plateau reduce scheduler transformer tri-stage warmup

Last synced: 09 Apr 2025

https://github.com/berndporr/fir1

FIR & LMS filter implementation in C++ with Python & JAVA wrappers

c-plus-plus cmake coefficients digital-signal-processing filter fir java jni-android jni-java jni-wrapper learning-rate least-squares leastsquares library lms python-extension python-library python3 signal-processing

Last synced: 27 Jul 2025

https://github.com/eBay/AutoOpt

Automatic and Simultaneous Adjustment of Learning Rate and Momentum for Stochastic Gradient Descent

hyperparameters learning-rate machine-learning momentum optimization pytorch sgd

Last synced: 08 May 2025

https://github.com/harshalmittal4/hypergradient_variants

Improved Hypergradient optimizers for ML, providing better generalization and faster convergence.

adam-optimizer hypergradient learning-rate momentum optimizers step-size

Last synced: 04 Jul 2025

https://github.com/ahundt/sharpdarts

sharpDARTS: Faster and More Accurate Differentiable Architecture Search

architecture-search cifar10 computer-vision cosine-annealing cosine-power-annealing deep-learning differentiable-hyperparamter-search hyperparameter-optimization hyperparameter-search hyperparameter-tuning imagenet learning-rate learning-rate-scheduling nas neural-architecture-search neural-networks power-cosine-annealing pytorch sota state-of-the-art

Last synced: 12 Jul 2025

https://github.com/epsoft/callbacks

callbacks in ai

callbacks learning-rate python twint

Last synced: 01 May 2025

https://github.com/timesler/lr-momentum-scheduler

Pytorch implementation of arbitrary learning rate and momentum schedules, including the One Cycle Policy

deep-learning learning-rate learning-rate-finder learning-rate-scheduling onecyclepolicy pytorch

Last synced: 14 Apr 2025

https://github.com/lefteyex/warmup

A Warmup Scheduler for Pytorch to achieve the warmup learning rate at the beginning of training.

learning-rate pytorch warmup

Last synced: 12 Oct 2025

https://github.com/mr-talhailyas/learning-rate-schedulers-packege-tensorflow-pytorch-keras

A packages containing all popular Learning Rate Schedulers. Implemented in Keras Tensorflow

cosine-decay exponential-decay k-decay keras learning-rate polynomial-decay schedule sgdr sgdr-decay sgdr-warmup step-decay tensorflow

Last synced: 26 Oct 2025

https://github.com/khaledashrafh/linear-regression

This program implements linear regression from scratch using the gradient descent algorithm in Python. It predicts car prices based on selected features and uses a dataset of cars with their respective prices.

data-preprocessing dataset feature-selection gredient-decent learning-rate linear-regression pyhton3 regression regression-models

Last synced: 12 Sep 2025

https://github.com/isadrtdinov/understanding-large-lrs

Source code for NeurIPS-2024 paper "Where Do Large Learning Rates Lead Us"

deep-learning feature-learning learning-rate loss-landscape

Last synced: 15 May 2025

https://github.com/fitushar/cyclical-learning-rates-for-training-neural-networks-with-unbalanced-data-sets

As the learning rate is one of the most important hyper-parameters to tune for training convolutional neural networks. In this paper, a powerful technique to select a range of learning rates for a neural network that named cyclical learning rate was implemented with two different skewness degrees. It is an approach to adjust where the value is cycled between a lower bound and upper bound. CLR policies are computationally simpler and can avoid the computational expense of fine tuning with fixed learning rate. It is clearly shown that changing the learning rate during the training phase provides by far better results than fixed values with similar or even smaller number of epochs.

clr clr-policies cnn cyclical-learning-rates epochs expense hyperparameters learning-rate learning-rates neural-network range skewness-degrees

Last synced: 22 Jul 2025

https://github.com/lorenzwalthert/kerasmisc

Add-on functionality for the R implementation of Keras

callback keras learning-rate

Last synced: 06 Oct 2025

https://github.com/farhaanbukhsh/neural-network

A small implementation of ANN

ann learning-rate machine-learning neural-network stress-train

Last synced: 27 Jul 2025

https://github.com/chaitanyac22/numerical_tictactoe_agent_using_reinforcement_learning

Build an RL (Reinforcement Learning) agent that learns to play Numerical Tic-Tac-Toe. The agent learns the game by Q-Learning.

actions convergence episodes epsilon-decay epsilon-greedy hyperparameter-tuning learning-rate markov-decision-process mdp-framework model-building policy q-learning q-learning-algorithm q-value q-value-iteration reinforcement-learning rewards rl states

Last synced: 27 Mar 2025

https://github.com/khaledassassins/cv--plants_seedling_classification

A robust image classifier using CNNs to efficiently classify different plant seedlings and weeds to improve crop yields and minimize the extensive human effort to do this manually.

cnn-for-visual-recognition confusion-matrix cv2-library imagedatagenerator label-binarizer learning-rate matplotlib numpy-library pandas-library seaborn tensorflow tensorflow-keras train-test-validation vgg16-model

Last synced: 12 Aug 2025

https://github.com/aryansri-0706/pytorch-learn-script-draft-for-designated-peer-reviewers-only

Pytorch Tutorial Introduction Learn Script PDF E-Book

algorithm gpu introduction learn learning-rate loss-function optimizer pdf python pytorch script tensor tutorial

Last synced: 04 Mar 2025

https://github.com/pngo1997/fashion-mnist-classification-with-tensorflow-keras

Explores image classification using a Multi-layer Feed-Forward Neural Network on the Fashion MNIST dataset.

classification deep-learning dropout hyperparameter-tuning image-classification keras keras-tensorflow learning-rate neural-network python regularization tensorflow

Last synced: 31 Dec 2025

https://github.com/pppw/fastai-v1-1cycle-for-v0_7

deep-learning fastai learning-rate

Last synced: 31 Dec 2025

https://github.com/theo-liang/python-project-analysis-for-climatewins

This project analyzes historical weather data to identify patterns and predict future weather conditions, focusing on extreme events and temperature trends across Europe.

artificial-neural-networks backpropagation confusion-matrix-heatmap convolutional-neural-networks data-optimization decision-tree-classifier deep-learning generative-adversarial-network gradient-descent hierarchical-clustering hyperparameter-tuning jupyter-notebook k-nearest-neighbor learning-rate machine-learning-algorithms overfitting python random-forest recurrent-neural-networks supervised-machine-learning

Last synced: 17 Mar 2025

https://github.com/ArtZaragozaGitHub/CV--P5_Plants_Seedling_Classification

A robust image classifier using CNNs to efficiently classify different plant seedlings and weeds to improve crop yields and minimize the extensive human effort to do this manually.

cnn-classification cnn-for-visual-recognition confusion-matrix cv2-library imagedatagenerator label-binarizer learning-rate matplotlib numpy-library opencv optimizer-visualization pandas-library preprocessing-data reducelronplateau seaborn sequential-models tensorflow tensorflow-keras train-test-validation

Last synced: 06 Nov 2025

https://github.com/dscamiss/newt

The Newton-like learning rate scheduler

artificial-intelligence learning-rate learning-rate-scheduler machine-learning machine-learning-algorithms second-order-optimization

Last synced: 10 Jun 2025

https://github.com/quantsareus/pytorch-learn-script-draft-for-designated-peer-reviewers-only

Pytorch Tutorial Introduction Learn Script PDF E-Book

activation-function algorithm e-book gpu introduction learn learning-rate loss-function optimizer pdf python pytorch script tensor tutorial

Last synced: 21 Feb 2025

https://github.com/animesh-chourey/fashion-mnist-classification

For an Image Classification task on Fashion MNIST dataset, a Convolutional Neural Network is created to learn. Different combination of activation functions, weights, optimiser, learning rate and epochs are used to find an optimal set amongst them for this particular dataset.

cnn fashion-mnist image-classification learning-rate optimiser pytorch relu-layer

Last synced: 01 Mar 2025

https://github.com/dscamiss/generalized-newtons-method

PyTorch implementation of the generalized Newton's method for learning rate selection

artificial-intelligence learning-rate learning-rate-scheduler learning-rate-scheduling machine-learning neural-networks newtons-method pytorch

Last synced: 08 Oct 2025