An implementation of the Fibonacci method for gradient descent, featuring a TKinter GUI for inputting the function / parameters to be examined and a matplotlib plot of the function and results.
Plotting points that lie on the intersection of the given curves using gradient descent
Iterative stochastic gradient descent (SGD) linear regressor with regularization
NFNets and Adaptive Gradient Clipping for SGD implemented in PyTorch
Keras implementation of Normalizer-Free Networks and SGD - Adaptive Gradient Clipping
Training vision models with full-batch gradient descent and regularization
A tutorial on surrogate gradient learning in spiking neural networks