#

softmax1

Here are 2 public repositories matching this topic...

robinzixuan / OASIS

[NeurIPS 2026] Attention Sinks and Outliers in Attention Residuals

quant attention quantization attention-mechanism outlier attention-is-all-you-need llm long-context llms attention-sink attention-sinks softmax1 attention-residuals attention-outlier

Updated Sep 27, 2026
Python

robinzixuan / FROST

[ICLR 2026] FROST: Filtering Reasoning Outliers with Attention for Efficient Reasoning

outliers attention attention-mechanism reasoning softmax lrm large-language-models llm large-reasoning-models test-time-scaling efficient-reasoning overthinking softmax1

Updated Jul 14, 2026
Python

Add this topic to your repo

To associate your repository with the softmax1 topic, visit your repo's landing page and select "manage topics."