-
Updated
Jan 9, 2024 - Python
#
retnet
Here are 4 public repositories matching this topic...
This is the repo for the MixKABRN Neural Network (Mixture of Kolmogorov-Arnold Bit Retentive Networks), and an attempt at first adapting it for training on text, and later adjust it for other modalities.
ai neural-network model architecture moe bitnet mixture-of-experts ai-models llms retnet retentive-network kolmogorov-arnold-networks
-
Updated
May 14, 2024 - Python
PyTorch research scaffold for RetNet, Block Attention Residuals, and hashed Engram memory
-
Updated
Jun 13, 2026 - Python
Add this topic to your repo
To associate your repository with the retnet topic, visit your repo's landing page and select "manage topics."