🍀 Pytorch implementation of various Attention Mechanisms, MLP, Re-parameter, Convolution, which is helpful to further understand papers.⭐⭐⭐
-
Updated
Mar 16, 2026 - Python
🍀 Pytorch implementation of various Attention Mechanisms, MLP, Re-parameter, Convolution, which is helpful to further understand papers.⭐⭐⭐
Stagewise pairwise mixing in MLX: replace a dense n-by-n layer with L sparse pairwise stages, with closed-form forward and backward passes.
To associate your repository with the linear-layers topic, visit your repo's landing page and select "manage topics."