Implementation of (overlap) local SGD in Pytorch
-
Updated
Jul 12, 2020 - Python
#
sgd-optimizer
Here are 50 public repositories matching this topic...
A compressed adaptive optimizer for training large-scale deep learning models using PyTorch
hashing deep-learning neural-network pytorch transformer imagenet count-min-sketch language-model adagrad adam-optimizer sgd-optimizer count-sketch sgd-momentum
-
Updated
Nov 26, 2019 - Python
Lookahead optimizer ("Lookahead Optimizer: k steps forward, 1 step back") for tensorflow
-
Updated
Sep 3, 2019 - Python
Communication-efficient decentralized SGD (Pytorch)
-
Updated
Mar 17, 2020 - Python
Implement a Neural Network trained with back propagation in Python
python machine-learning neural-network gradient-descent backpropagation stochastic-gradient-descent sgd-optimizer
-
Updated
Jul 28, 2022 - Python
JAX compilation of RDDL description files, and a differentiable planner in JAX.
control reinforcement-learning controller automatic-differentiation planning sgd policy-gradient model-based-control nonlinear-dynamics backpropagation nonlinear-optimization stochastic-gradient-descent planning-domain-definition-language planning-algorithms nonlinear-control sgd-optimizer jax rddl differentiable-simulations gradient-based-optimisation
-
Updated
Oct 14, 2026 - Python
MetaPerceptron: A Standardized Framework For Metaheuristic-Driven Multi-layer Perceptron Optimization
neural-network genetic-algorithm mlp regression-models multi-layer-perceptron particle-swarm-optimization metaheuristics global-search adam-optimizer sgd-optimizer classification-models metaheuristic-algorithms whale-optimization-algorithm nature-inspired-optimization adagrad-approach metaheuristic-based-multi-layer-perceptron gradient-free-based-multi-layer-perceptron adelta-optimizer
-
Updated
Jun 4, 2025 - Python
Nadir: Cutting-edge PyTorch optimizers for simplicity & composability! 🔥🚀💻
machine-learning optimization pytorch lion adam-optimizer adamax sgd-optimizer amsgrad adamw radam adamp adabelief
-
Updated
Jun 15, 2024 - Python
基于粒子群PSO+随机梯度下降SGD优化器的Pytorch训练框架
-
Updated
Sep 26, 2021 - Python
ND-Adam is a tailored version of Adam for training DNNs.
-
Updated
Sep 19, 2018 - Python
Object recognition AI using deep learning
-
Updated
Feb 13, 2026 - Python
Tensorflow-Keras callback implementing arXiv 1712.07628
keras-callback sgd-optimizer custom-callback early-stopping tensorflow-keras swats deep-learning-optimization swats-algorithm optimizer-switching generalization-performance
-
Updated
Mar 24, 2023 - Python
Effect of Optimizer Selection and Hyperparameter Tuning on Training Efficiency and LLM Performance
-
Updated
Apr 16, 2025 - Python
This was a project case study on nonlinear optimization. We implemented the Stochastic Quasi-Newton method, the Stochastic Proximal Gradient method and applied both to a dictionary learning problem.
-
Updated
Feb 3, 2018 - Python
MNIST Handwritten Digits Classification using 3 Layer Neural Net 98.7% Accuracy
python neural-networks pca mnist-classification dimensionality-reduction image-classification artificial-neural-networks momentum backpropagation-learning-algorithm python2 backpropagation neural-nets stochastic-gradient-descent deskew mini-batch-gradient-descent mnist-handwriting-recognition mnist-digits sgd-optimizer
-
Updated
Apr 8, 2018 - Python
This repository contains code for the PhD thesis: "A Study of Self-training Variants for Semi-supervised Image Classification" and publications.
tensorflow cnn mnist semi-supervised-learning self-training svhn vgg16 cifar10 triplet-loss fashion-mnist sgd-optimizer contrastive-loss cross-entropy-loss self-supervised-learning arcface-loss plantvillage-dataset rmsprop-optimizer wrn-28-2
-
Updated
Sep 15, 2023 - Python
This project focuses on land use and land cover classification using Convolutional Neural Networks (CNNs) and Recurrent Neural Networks (RNNs). The classification task aims to predict the category of land based on satellite or aerial images.
machine-learning deep-learning tensorflow optimizer python3 artificial-intelligence supervised-learning rnn adagrad adam-optimizer cnn-classification sgd-optimizer nadam lulc-classification rmsprop-optimizer
-
Updated
Jun 28, 2024 - Python
In compressed decentralized optimization settings, there are benefits to having multiple gossip steps between subsequent gradient iterations, even when the cost of doing so is appropriately accounted for e.g. by means of reducing the precision of compressed information.
distributed-systems machine-learning optimization distributed-computing sgd high-performance-computing optimization-methods optimization-algorithms convex-optimization federated-learning sgd-optimizer non-convex-optimization
-
Updated
Jan 11, 2022 - Python
Prevention of accidents in school zones using deep learning
machine-learning deep-learning optimization backbone ml cnn pytorch yolo object-detection coreml onnx sgd-optimizer tflite backbone-networks yolov5
-
Updated
Feb 13, 2026 - Python
LDD is gradient descent for coding agents. Twelve portable skills for any coding agent — Claude Code · Codex · Gemini CLI · Aider · Cursor · Copilot CLI · Continue.dev
-
Updated
May 31, 2026 - Python
Add this topic to your repo
To associate your repository with the sgd-optimizer topic, visit your repo's landing page and select "manage topics."