model

Qwen3.8-27B-Coder390-EfficientThink-Opus5.5-GPT6Astra-Grok4.7-DSV4Pro-K3-SFT-RLOO-MTP-DFlash2

huggingface.co/nerkyor/Qwen3.8-27B-Coder390-EfficientThink-Opus5.5-GPT6Astra-Grok4.7-DSV4Pro-K3-SFT-RLOO-MTP-DFlash2 ↗

83887 downloads·312 likes·image-text-to-text

from the model card

Qwen3.8-27B-Coder390-EfficientThink-Opus5.5-GPT6Astra-Grok4.7-DSV4Pro-K3-SFT-RLOO-MTP-DFlash2 A model post-trained with several rounds of SFT and RLOO on top of Qwen3.8-27B-EfficientThink-SFT-SimPO-DFlash2, which is itself the official Qwen3.8-27B post-trained with SFT and SimPO. It is built to fix the original model's habit of failing to stop: it already has an answer, yet keeps re-deriving until it hits the 94K cap with no final answer. This repository provides five safetensors tiers, BF16, static FP8 Block128, NVFP4 W4A16, NVFP4 W4A4, and NVFP4 W4A4-W8A8 (mixed precision), all fully multimodal (text + image/video) with the official BF16 MTP bundled; all load in SGLang without patches, and the FP8 package is also smoke-tested on vLLM. It also has NInfer W4A4 / W4A4-W8A8 (NVFP4-NInfer/), INT8 W8A8 (INT8/W8A8/), INT8 W8A16 (INT8/W8A16/, text + image), INT4 W4A16 (INT4/W4A16/, text + image, vLLM), and GGUF Q2 / Q3 / Q4 LynnStyle (plus Q8 MTP versions), Q6K, and Q80 (GGUF/, GGUF-NInfer/, built-in MTP). Far fewer 94K truncations: under the same protocol, 4 → 1 on GPQA and 13 → 3 on LCB. No regression on any suite: GPQA 178/198, MMLU 450/500, LCB 90/100 (static FP8), vs. 177 / 444 / 83 for the original FP8. Lossless quantization: GPQA and LCB are identical across BF16, dynamic FP8, and static FP8. Two speculative-decoding options (mutually exclusive): about 180 tok/s per request wi…

discussions

recent items

← all models