mqa
Here are 10 public repositories matching this topic...
A code deep-dive on one of the key innovations from Deepseek - Multihead Latent Attention (MLA)
-
Updated
Nov 9, 2025 - Python
A fast, lightweight cross-os toolkit for detecting, analyzing, organizing, and exporting MQA-encoded FLAC files.
-
Updated
Dec 10, 2025 - Python
Reference Flash Attention implementation in PyTorch with V1/V2, GQA/MQA, Triton kernels, benchmark and docs.
-
Updated
Apr 29, 2026 - Python
Docker Compose for Metadata Quality Assessment (MQA) on CKAN and European Data Portal catalogs
-
Updated
Jan 9, 2025 - Python
Metadata Quality Stack is a comprehensive toolkit for analysing metadata quality. It implements the European Data Portal's MQA methodology. Docker Compose deployment and React web application.
-
Updated
Dec 23, 2025 - Python
Empirical profiling of MHA, GQA, and MQA attention variants measuring KV-cache memory, decode throughput, and output fidelity. GQA-g2 halves KV-cache while preserving ~70% cosine similarity; MQA reduces cache by 92% but drops to ~27% similarity.
-
Updated
Jul 14, 2026 - Python
Modern LLM Attention from Scratch — MHA, GQA, MQA, RoPE, and KV-Cache implemented in pure PyTorch.
-
Updated
May 28, 2026 - Python
Add this topic to your repo
To associate your repository with the mqa topic, visit your repo's landing page and select "manage topics."