Gradient learning

A collection of 11 posts

An implementation of the Fibonacci method for gradient descent

An implementation of the Fibonacci method for gradient descent, featuring a TKinter GUI for inputting the function / parameters to be examined and a matplotlib plot of the function and results.

29 January 2022

Plotting points that lie on the intersection of the given curves using gradient descent

Plotting points that lie on the intersection of the given curves using gradient descent

11 January 2022

A Momentumized, Adaptive, Dual Averaged Gradient Method for Stochastic Optimization

A Momentumized, Adaptive, Dual Averaged Gradient Method for Stochastic Optimization

A Momentumized, Adaptive, Dual Averaged Gradient Method for Stochastic Optimization

27 December 2021

A Python library for easy evaluation of privacy risks in public gradients in Federated Learning

A Python library for easy evaluation of privacy risks in public gradients in Federated Learning

A Python library for easy evaluation of privacy risks in public gradients in Federated Learning

01 December 2021

A PyTorch library for stochastic gradient estimation in Deep Learning

A PyTorch library for stochastic gradient estimation in Deep Learning

A PyTorch library for stochastic gradient estimation in Deep Learning

12 November 2021

Generalized Data Weighting via Class-level Gradient Manipulation

Generalized Data Weighting via Class-level Gradient Manipulation

Generalized Data Weighting via Class-level Gradient Manipulation

04 November 2021

linear-regression

Iterative stochastic gradient descent (SGD) linear regressor with regularization

Iterative stochastic gradient descent (SGD) linear regressor with regularization

30 October 2021

NFNets and Adaptive Gradient Clipping for SGD implemented in PyTorch

NFNets and Adaptive Gradient Clipping for SGD implemented in PyTorch

04 October 2021

Keras implementation of Normalizer-Free Networks and SGD - Adaptive Gradient Clipping

Keras implementation of Normalizer-Free Networks and SGD - Adaptive Gradient Clipping

04 October 2021

Gradient learning

Training vision models with full-batch gradient descent and regularization

Training vision models with full-batch gradient descent and regularization

04 October 2021

A tutorial on surrogate gradient learning in spiking neural networks

A tutorial on surrogate gradient learning in spiking neural networks

26 September 2021