AdamP: Slowing Down the Slowdown for Momentum Optimizers on Scale-invariant Weights (ICLR 2021)
-
Updated
Jan 13, 2021 - Python
#
optimizer-algorithms
Here are 14 public repositories matching this topic...
🌹 Rose: Range-Of-Slice Equilibration PyTorch optimizer. Stateless optimization through range-normalized gradient updates.
machine-learning ai deep-learning transformers optimizer pytorch artificial-intelligence sgd gradient-descent gpt lora adam-optimizer fine-tuning diffusion-models pretraining optimizers optimizer-algorithms large-language-models llm
-
Updated
Apr 28, 2026 - Python
This project implements optimizers for TensorFlow and Keras, which can be used in the same way as Keras optimizers. Machine learning, Deep learning
machine-learning reinforcement-learning deep-learning tensorflow keras deep-reinforcement-learning optimizer machinelearning deeplearning optimizer-algorithms
-
Updated
Jun 19, 2026 - Python
Unofficial implementation of the Adan optimizer with Schedule-Free
-
Updated
Jul 8, 2024 - Python
NEAT (Nash-Equilibrium Adaptive Training) is a Keras first optimizer for conflict aware training, with an explicit NumPy reference engine, a small practical API, and optional native CPU acceleration.
-
Updated
Sep 1, 2026 - Python
AeroAttention is an innovative, quantum-enhanced attention mechanism designed for transformer models. It offers optimized memory usage and accelerated computations, enabling scalable and efficient training for advanced neural network architectures
-
Updated
Sep 28, 2025 - Python
AixrOptima is an artificial intelligence startup that speeds up the process process by integrating quantum circuits.
machine-learning quantum machine-learning-algorithms optimizer quantum-algorithms quantum-machine-learning artifical-neural-network artifical-intelligence optimizer-algorithms quantumalgorithms
-
Updated
Mar 19, 2025 - Python
Muon is an optimizer for hidden layers in neural networks
-
Updated
Jun 18, 2026 - Python
Don't tune the knee. Measure it.
-
Updated
Aug 25, 2026 - Python
A fast ML library for experimentation and training on consumer hardware
machine-learning configuration ml datasets language-model inference-server finetuning consumer-hardware pretraining optimizer-algorithms llm
-
Updated
Jun 16, 2026 - Python
A NumPy based Neural Network Package Implementation
python neural-network numpy optimizer derivatives loss-functions activation-functions optimizer-algorithms
-
Updated
Jun 22, 2022 - Python
AdaRankGrad: Adaptive Gradient Rank and Moments for Memory-Efficient LLMs Training and Fine-Tuning
-
Updated
Apr 22, 2025 - Python
En el siguiente repositorio encontrarás material relacionado con optimizadores usados en metodologías de aprendizaje de maquina. In the following repository you'll find examples of optimizers used in machine learning methods
machine-learning simulation linear-algebra neural-networks gradient-descent optimization-methods optimization-algorithms convex-optimization optimizer-visualization optimizer-algorithms optimizar
-
Updated
Mar 11, 2023 - Python
Mini party optimizer to find the best team composition base on player's inventory in Genshin Impact
game opimization optimizer-algorithms genshin-impact genshin-impact-assistant genshin-impact-optimizer
-
Updated
Feb 3, 2026 - Python
Add this topic to your repo
To associate your repository with the optimizer-algorithms topic, visit your repo's landing page and select "manage topics."