Projects in Awesome Lists tagged with second-order-optimization
A curated list of projects in awesome lists tagged with second-order-optimization .
https://github.com/amirgholami/PyHessian
PyHessian is a Pytorch library for second-order based analysis and training of Neural Networks
hessian hessian-free pytorch-library second-order second-order-optimization
Last synced: 27 Mar 2025
https://github.com/embersarc/epigraph
A C++ interface to formulate and solve linear, quadratic and second order cone problems.
eigen eigen-library numerical-optimization qp quadratic-programming second-order-optimization socp
Last synced: 16 Mar 2025
https://github.com/evanatyourservice/kron_torch
An implementation of PSGD Kron second-order optimizer for PyTorch
machine-learning optimization pytorch second-order-optimization
Last synced: 05 May 2025
https://github.com/ltatzel/pytorchhessianfree
PyTorch implementation of the Hessian-free optimizer
conjugate-gradient deep-learning deep-neural-networks ggn hessian-free matrix-free newtons-method optimization-algorithms pytorch-implementation second-order-optimization stochastic-optimizers
Last synced: 07 Oct 2025
https://github.com/lixilinx/psgd_tf
Tensorflow implementation of preconditioned stochastic gradient descent
affine-group deep-learning hessian-vector-product lie-groups low-rank-approximation optimization-algorithms preconditioner second-order-optimization stochastic-gradient-descent tensorflow
Last synced: 22 Jul 2025
https://github.com/evanatyourservice/psgd_jax
Implementation of PSGD optimizer in JAX
jax optax optimization preconditioning psgd second-order-optimization
Last synced: 07 Jul 2025
https://github.com/yorkerlin/structuredngd-dl
Matrix-multiplication-only KFAC; Code for ICML 2023 paper on Simplifying Momentum-based Positive-definite Submanifold Optimization with Applications to Deep Learning
deep-learning fisher hessian-free kfac natural-gradients optimization-methods optimizer pytorch-implementation second-order-optimization
Last synced: 11 Oct 2025
https://github.com/dahyun-kang/newoptpy
Newton’s second-order optimization methods in python
newton-method newtons-method optimization-algorithms quasi-newton quasi-newton-method second-order-optimization
Last synced: 12 Apr 2025
https://github.com/cor3bit/somax
Stochastic Second-Order Methods in JAX
gauss-newton-method hessian-free jax machine-learning natural-gradient quasi-newton second-order-optimization stochastic-optimization
Last synced: 19 Apr 2025
https://github.com/evanatyourservice/flat-sophia
sophia optimizer further projected towards flat areas of loss landscape
jax optax optimization second-order-optimization sophia
Last synced: 03 Feb 2026
https://github.com/dscamiss/newt
The Newton-like learning rate scheduler
artificial-intelligence learning-rate learning-rate-scheduler machine-learning machine-learning-algorithms second-order-optimization
Last synced: 10 Jun 2025
https://github.com/dscamiss/hesse
PyTorch tools for Hessian-related operations
artificial-intelligence hessian hessian-matrix machine-learning optimization python pytorch second-order-optimization
Last synced: 12 Jun 2025
https://github.com/epfml/grad-norm-smooth
Official implementation of "Gradient-Normalized Smoothness for Optimization with Approximate Hessians"
inexact-hessians second-order-optimization
Last synced: 21 Jul 2025
