Recent Open models from last 6 Months - Nov 2025 - Apr 2026 (www.reddit.com) mistralglmgemma+1 29w
event
DeepSeek 3.2
-
I created this chart with recent open models from last 6 months. Few might be older than that possibly.
-
New LLM Position Bias Benchmark: does an LLM keep the same judgment when you swap the answer order? Judge models compare two lightly edited versions of the same story twice, with the order swapped. The median model flips in 45% of decisive case pairs. GPT-5.4 is worst at 66%. (www.reddit.com) mistralgpt-5deepseek 29w
More info, including charts, per-case metrics, raw judge outputs, and the parsed answer dump: https://github.com/lechmazur/position_bias This benchmark isolates one basic and frustrating failure mode. The model-average first-shown pick rat…
-
2x 512gb ram M3 Ultra mac studios (www.reddit.com) glmdeepseek 29w