Hybrid Mamba-2 + Transformer 2.94B LLM (Nemotron-H style) — Korean 3B model pretrained from scratch on 7× NVIDIA B200 GPUs with SFT + DPO alignment
-
Updated
Mar 26, 2026 - Python
#
mamba2
Here are 18 public repositories matching this topic...
Hybrid SSM-Attention language model on Apple Silicon with MLX — interleaving Mamba-2 and Transformer for efficient inference
python machine-learning deep-learning transformer attention language-model ssm mamba hybrid-model mlx state-space-model apple-silicon llm mamba2
-
Updated
Mar 29, 2026 - Python
Mamba-2-130M encrypted inference research with CKKS on DGX Spark. Python reference, native GPU kernel, and reproducible experiments.
cryptography cuda pytorch gpu-acceleration language-models homomorphic-encryption mamba state-space-models fhe privacy-preserving-ml ckks fully-homomorphic-encryption research-prototype llm openfhe mamba2 encrypted-inference fideslib
-
Updated
Oct 2, 2026 - Python
Helix-v2 1B bilingual hybrid LLM - Nvidia
ai deep-learning german cuda transformers pytorch adapters lora mora dora hybrid-model fine-tuning state-space-models tool-use sentencepiece llm generative-ai large-language-model mamba2 gated-linear-attention
-
Updated
Jul 14, 2026 - Python
Run NVIDIA's Nemotron-Labs-TwoTower-30B-A3B block-wise diffusion LM natively on Apple Silicon with MLX — AR tower + full two-tower mask-diffusion, 4/6/8-bit + bf16.
macos text-generation nvidia moe quantization mamba mlx diffusion-model mixture-of-experts on-device-ai apple-silicon large-language-models llm nemotron diffusion-language-model mamba2
-
Updated
Jul 2, 2026 - Python
A 390M-parameter Mamba2 + Differential Attention hybrid language model
nlp deep-learning language-model hybrid-architecture mamba2 differential-attention pytorch-state-space-model
-
Updated
May 8, 2026 - Python
VerDee: Vertical Deep Network on Mamba-2 — staged LoRA (shallow/mid/deep), early-exit routing, and domain experts. Pilot on 370M; 16GB GPU friendly. Research/experiment repo.
lora state-space-model peft early-exit huggingface qlora llm-finetuning mamba2 vertical-deep-network
-
Updated
May 25, 2026 - Python
Build Your Own Mamba — From Math to Metal
-
Updated
Jun 13, 2026 - Python
GLACIER: Mamba with indexless memory. This project integrates the Mamba SSM with ICE-Lite, a virtual memory engine, to solve context rot. By adding persistent, time-aware memory, GLACIER gives Mamba the long-term recall of a Transformer while retaining its $O(N)$ speed. Apache 2.0 licensed, by Dopove.
python nlp ai deep-learning postgresql persistent-memory glacier ssm mamba state-space-model vector-database llm long-context context-memory memory-augmented transformer-alternative mamba2 context-rot ice-lite dopove
-
Updated
May 22, 2026 - Python
Native AscendC Mamba2 selective scan / SSD forward-backward custom operator for Huawei Ascend 910B3 and 950PR, with CANN, torch_npu, A100 benchmarks and msprof profiling.
pytorch ssd mamba cann performance-optimization state-space-models ascend-npu selective-scan ai-infrastructure ascendc kernel-optimization mamba2 huawei-ascend torch-npu custom-operator ascend-910b triton-ascend ascend-950
-
Updated
Oct 7, 2026 - Python
The training stack for PureByte: from a task definition to a verified GGUF specialist in 25 minutes to an hour on one consumer GPU. Synthetic look-alikes grounded in real bytes, leak checks against the exams, criteria frozen before training, multi-seed runs with controls, and proof that the C++ runtime gives the same answers.
training deep-learning model pytorch mamba byte-level model-training state-space-models training-pipeline model-training-and-evaluation mamba-state-space-models model-training-and-tuning model-training-and-optimization mamba-2 mamba2 model-training-and-inference
-
Updated
Sep 28, 2026 - Python
Unofficial PyTorch reproduction for Transformers are SSMs: Generalized Models and Efficient Algorithms Through Structured State Space Duality.
pytorch reproduction state-space-model sequence-modeling efficient-attention mamba2 unofficial-implementation
-
Updated
Jul 2, 2026 - Python
A simple, minimalistic, and explainable JAX implementation of Mamba 2 & Mamba 3
deep-learning neural-network transformer mamba jax llm mamba-state-space-models mamba-2 mamba2 mamba-ssm mamba-3
-
Updated
May 10, 2026 - Python
How much cheaper is it to inject a retrieved fact next to the answer than to make a Mamba-2 model recall it from context? A small, controlled study: inject vs long-context, 2-hop chains, and adjacency decay.
-
Updated
Sep 9, 2026 - Python
Add this topic to your repo
To associate your repository with the mamba2 topic, visit your repo's landing page and select "manage topics."