Training models with ternary quantized weights using PyTorch
-
Updated
Jun 12, 2019 - Python
#
ternary-quantization
Here are 10 public repositories matching this topic...
Pre-quantized ternary models for VLMs, multimodal, and audio — the models GGUF can't touch
quantization whisper gemma vlm model-compression multimodal edge-ai ternary-quantization huggingface apple-silicon vision-language-model qwen
-
Updated
Apr 27, 2026 - Python
QTEA: Ternary LLMs with Sparse Residual Salient Weight and By-Column Optimization
cuda quantization ternary model-compression ternary-quantization post-training-quantization low-bit-quantization llm gptq llama3 llm-quantization qwen3 emnlp-2026 sub-2-bit
-
Updated
Sep 28, 2026 - Python
1.58-bit ternary Mamba LLM for Indian languages. Weights are {-1,0,+1} — inference uses only add/sub. 3B model fits in 750MB, runs 20+ tok/s on mobile.
-
Updated
Apr 10, 2026 - Python
Colab-friendly BitNet distillation engine: collect KD traces from a teacher, train a ternary Mini-BitNet, and dry-run 7B memory. Multi-provider + Drive/S3
transformers pytorch parquet knowledge-distillation model-compression bitnet colab-notebook mixed-precision ternary-quantization large-language-model efficient-llm efficient-llm-inference activation-quantization kd-traces
-
Updated
Sep 5, 2025 - Python
Research implementation of activation-aware ternary and mixed-bit quantization for Qwen3.8-27B, targeting 7-9 GB text inference on 16 GB GPUs.
transformers pytorch quantization model-compression mixed-precision ternary-quantization large-language-models llama-cpp gguf qwen3
-
Updated
Aug 17, 2026 - Python
Independent forensics of Bonsai 2 27B ternary quantization: format and basis recovery, the trained-weights residual, and the public PTQ calibration artifact.
reproducibility quantization bonsai model-compression mixture-of-experts ternary-quantization llm gguf
-
Updated
Sep 27, 2026 - Python
PILON (Primitive-Induced Linear Operator Network) explores a compositional weight parameterization for transformer FFN layers. The goal is to replace dense FFN matrices with shared low-rank primitives plus learned composition weights.
research pytorch transformer language-model model-compression bitnet weight-sharing low-rank ternary-quantization quantization-aware-training efficient-deep-learning consumer-gpu
-
Updated
Mar 20, 2026 - Python
Run PrismML Ternary Bonsai 2 27B (PTQ1_0 packed-ternary GGUF) natively on vLLM — tensor-core fused Triton kernel, 5.9GB resident, 890 tok/s @ bs=32, 2.5x official fork with matched slots
-
Updated
Oct 1, 2026 - Python
jade_mage · agentprivacy dual-agent harness lane for JadeZaher/ternary-memory-research (fork: main tracks upstream; lane on branch harness/jade_mage; contributions go upstream by PR)
-
Updated
Sep 21, 2026 - Python
Add this topic to your repo
To associate your repository with the ternary-quantization topic, visit your repo's landing page and select "manage topics."