Qwen 3

1. Newer Qwen models are worse at summarization? (www.reddit.com via reddit)

   45m gemmaqwenagentic

   We have summaries annotated by real humans that we benchmark various models, using an LLM as a judge, we found that in the 30B params range, Qwen 3 tops it out, followed by Gemma 4. It feels like newer Qwens are optimized to perform agenti…

2. OSCAR RotationZoo - Offline Spectral Covariance-Aware Rotation for 2-bit KV Cache Quantization (www.reddit.comhttps)

   2h gemma

3. Levi: Run AlphaEvolve on your local QWEN 30B (www.reddit.com via reddit)

   1d gpt-5qwencodex+2

   Hi r/LocalLLaMA, Wanted to share something I'm excited about. I've been fascinated by AlphaEvolve and its results for more than a year now, but running the open source frameworks gets expensive fast.

4. Looking for a local "NotebookLM for lawyers" setup – what am I doing wrong? (www.reddit.com via reddit)

   1d ragqwenchatgpt

   Hello everyone I am totally new to LocalLLMs and only used chatGPT/Claude/NotebookLM before. So bear with me 😃 I'm an attorney and would like to analyze and summarize case files locally for privacy/confidentiality reasons.

5. Gemma 4 E4B as a primary local LLM (replaced Qwen) (digg.com via hn)

   +2 2d gemmaqwen

   Gemma 4 E4B 6bit is now the local model of my choice and loaded 24/7 on my Mac (using @lmstudio), replacing Qwen3, 3.5 4B after ~9 months of usage What an insane model, congrats @GoogleDeepMind 🤠 The new setup replaces his nine-month daily…

6. Claude Code 2.1.165 + Ollama (qwen3:8b / qwen2.5-coder:7b) instantly throws "response exceeded 32000 output token maximum" even for "hi" (www.reddit.com via reddit)

   3d ollamaclaude-code

   I'm trying to use Claude Code with local Ollama models, but every prompt fails with: The strange part is that it happens even for extremely small prompts like: hi say apple What is 1+1? Answer with only one character.

7. Initial testing with llama-bench and 3 different Qwen3 models for my R9700 32GB (www.reddit.com via reddit)

   4d llama

   In a recent build I did I used dual R9700 32GB cards but I wanted to see how a single R9700 stacked up against other hardware I had access to. I created a simple benchmark with llama-bench and ran it on a few different setups.

8. PSA: Gemma 4 12B is NOT completely broken for coding and tool calling, you need a special chat template (www.reddit.com via reddit)

   4d gemmaqwenllama

   This is a PSA for people like me who tried it and hit the wall with tool calls failing left and right, so much so that harnesses like OpenCode just didn't work: There is a fix for that. You need to pass a better chat template file, which i…

← all threads