AdamP: Slowing Down the Slowdown for Momentum Optimizers on Scale-invariant Weights (ICLR 2021)
-
Updated
Jan 13, 2021 - Python
#
optimizer-algorithms
Here are 25 public repositories matching this topic...
🌹 Rose: Range-Of-Slice Equilibration PyTorch optimizer. Stateless optimization through range-normalized gradient updates.
machine-learning ai deep-learning transformers optimizer pytorch artificial-intelligence sgd gradient-descent gpt lora adam-optimizer fine-tuning diffusion-models pretraining optimizers optimizer-algorithms large-language-models llm
-
Updated
Apr 28, 2026 - Python
This project implements optimizers for TensorFlow and Keras, which can be used in the same way as Keras optimizers. Machine learning, Deep learning
machine-learning reinforcement-learning deep-learning tensorflow keras deep-reinforcement-learning optimizer machinelearning deeplearning optimizer-algorithms
-
Updated
Jun 19, 2026 - Python
Unofficial implementation of the Adan optimizer with Schedule-Free
-
Updated
Jul 8, 2024 - Python
NEAT (Nash-Equilibrium Adaptive Training) is a Keras first optimizer for conflict aware training, with an explicit NumPy reference engine, a small practical API, and optional native CPU acceleration.
-
Updated
Sep 1, 2026 - Python
AeroAttention is an innovative, quantum-enhanced attention mechanism designed for transformer models. It offers optimized memory usage and accelerated computations, enabling scalable and efficient training for advanced neural network architectures
-
Updated
Sep 28, 2025 - Python
AixrOptima is an artificial intelligence startup that speeds up the process process by integrating quantum circuits.
machine-learning quantum machine-learning-algorithms optimizer quantum-algorithms quantum-machine-learning artifical-neural-network artifical-intelligence optimizer-algorithms quantumalgorithms
-
Updated
Mar 19, 2025 - Python
Muon is an optimizer for hidden layers in neural networks
-
Updated
Jun 18, 2026 - Python
The Bird Species Classifier is an application built using a Convolutional Neural Network (CNN) to classify images of birds into one of 525 different species. It allows users to upload an image of a bird and receive a prediction of the bird species. Along with analysing the performance of various optimising algorithms.
-
Updated
Jun 28, 2024 - Jupyter Notebook
Learning about the algorithms used in machine learning, along with techniques for training and testing models.
python nlp html learning data-science gradient-descent backpropagation-learning-algorithm ia feature-engineering regression-models loss-functions metrics-visualization normalization-techniques optimizer-algorithms neuronal-networks preprocessing-data
-
Updated
May 10, 2025 - Jupyter Notebook
Training the fully connected neural network (FCNN) using different optimizers for the backpropagation algorithm and compare the number of epochs that it takes for convergence along with their classification performance. Also building an autoencoder to obtain the hidden representation and use it for classification.
-
Updated
Jul 13, 2022 - Jupyter Notebook
Deep learning on class
deep-learning tensorflow keras lstm convolutional-neural-network pooling-layers resnet50 fpt-university optimizer-algorithms
-
Updated
Sep 27, 2025 - Jupyter Notebook
Generating a TensorFlow model that predicts values in a sinewave
-
Updated
Dec 8, 2021 - Jupyter Notebook
COVID-19-Xray-Dataset Deep Learning using 3 models
deep-learning metrics tensorflow keras warnings cnn-model loss-functions imagedatagenerator optimizer-algorithms mobilenetv2-model resnet50-model
-
Updated
Oct 7, 2024 - Jupyter Notebook
A fast ML library for experimentation and training on consumer hardware
machine-learning configuration ml datasets language-model inference-server finetuning consumer-hardware pretraining optimizer-algorithms llm
-
Updated
Jun 16, 2026 - Python
Don't tune the knee. Measure it.
-
Updated
Aug 25, 2026 - Python
A NumPy based Neural Network Package Implementation
python neural-network numpy optimizer derivatives loss-functions activation-functions optimizer-algorithms
-
Updated
Jun 22, 2022 - Python
Mandatory practice works (MPWs) for MSE module Deep Learning (Spring 2026)
deep-learning linear-regression optimizer cnn pytorch image-captioning computational-graphs data-augmentation error-analysis gradcam torchvision optimizer-algorithms wandb tuning-hyperparameters
-
Updated
Jun 10, 2026 - Jupyter Notebook
AdaRankGrad: Adaptive Gradient Rank and Moments for Memory-Efficient LLMs Training and Fine-Tuning
-
Updated
Apr 22, 2025 - Python
Introduction to the Adam Optimizer with examples
-
Updated
Dec 21, 2022 - Jupyter Notebook
Add this topic to your repo
To associate your repository with the optimizer-algorithms topic, visit your repo's landing page and select "manage topics."